adagrad and sparseAdam work great for sparse training because there’s separate sums for each of the parameters.

Are there any other recommended optimizers for embedding training?


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.