In this git repo the online learning algorithms are classified as first order and second order. I tried searching what it means, yet I'm unable to understand the different between such first oder and second order online learning algorithms.

What is the difference between first order and second order online learning?

  • $\begingroup$ Study the canonical second order optimization algorithm: Newton's method. Welcome to the site. $\endgroup$
    – Emre
    Commented Aug 16, 2018 at 17:03

1 Answer 1


First order and second order algorithms are algorithms which use respectively at least first derivative / second derivative.

This post explains well the definition.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.