Vowpal Wabbit (VW) uses online normalization as explained here [1].

When running VW with multiple workers, workers synchronize their models with an AllReduce at the end of each epoch.

Is it possible or is there any code/paper that explores the idea of doing online learning with multiple workers in a parameter server setting?

[1] https://arxiv.org/abs/1305.6646


migrated from stats.stackexchange.com Feb 15 '18 at 16:49

This question came from our site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.