2
$\begingroup$

I am doing some research on machine learning algorithms in the context of a seminar, which focuses on Energy-Based Modeling vs Deep Learning Modeling specifically in working with images. Now I know these are broad topics, but I was wondering what some specific similarities and differences are. I have read countless papers that say "EBMs have properties that make them better than DL in certain tasks" but I haven't really found a comprehensive motivation

  • What is the problem that EBM is solving compared to DL?
  • Why are we doing this?

I hope this is the right site for this question (I also checked theoretical CS), This brought me here.

Improve this question
New contributor
dohm is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct.
$\endgroup$
  • $\begingroup$ A new introductory article about EBMs by relevant researchers just came out, maybe you are interested: arxiv.org/abs/2101.03288 . At least I find the docs on modern EBMs somewhat lacking. $\endgroup$ – ncasas Jan 13 at 10:02
  • $\begingroup$ Also, you may find this article relevant to your question: arxiv.org/abs/1912.03263 . They reinterpret deep learning classifiers as EBMs. $\endgroup$ – ncasas Jan 13 at 10:04
  • $\begingroup$ Thanks for the paper suggestions! I've already seen the second one and found it quite interesting because I found that it highlights the connections quite well. Somehow still missing what specific tasks deep learning can't do. Will check out the first paper now $\endgroup$ – dohm Jan 13 at 11:14

Your Answer

dohm is a new contributor. Be nice, and check out our Code of Conduct.

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.