As detailed here, the way to go to break NN training over multiple machines/threads, is decompose training data set on multiple chunks and send to each node, then sum results back in main node.

There is some library who already implements these techniques? Agents to install on each node?

  • $\begingroup$ Hi. This question is off-topic here. Asking for libraries or datasets is off-topic here. See ai.stackexchange.com/help/on-topic. Please, ask your question on Data Science SE, otherwise, I will migrate this post. $\endgroup$ – nbro Aug 29 at 12:20

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.