0
$\begingroup$

I have done the deeplearning.ai course on deep learning. But I cannot Understand equations like 

minGmaxDV(D,G)=Ex∼pdata(x)[logD(x)]+Ez∼pz(z)[log(1−D(G(z)))]

What kind of Maths am I am supposed to learn? I know Calculus basic Multivariable Calculus and Linear Algebra. So should I learn Probability (Advance probability maybe)?

Improve this question
$\endgroup$
  • $\begingroup$ it would help if you could tell us which part you don't understand $\endgroup$ – oW_♦ Jul 14 '19 at 22:23
  • $\begingroup$ I should you should instead focus on learning the notations rather than concepts. $\endgroup$ – Shubham Panchal Jul 15 '19 at 0:03
  • $\begingroup$ I am confused about Expectation values? $\endgroup$ – harshtiwari Jul 15 '19 at 8:19
0
$\begingroup$

Mathematical expectations are a concept from probability theory. Expressions like $E_x[...]$ denote conditional expectations and I think you will have trouble understanding Machine Learning concepts without understanding conditional expectations. (Understanding them as a mathematical concept, not on an intuitive level).

My recommendation is that you look for a beginner's course in probability theory to get a grasp of the following concepts:

  • Random variables
  • Probability distributions
  • Stochastic independence
  • Mathematical expectation
  • Conditional expectation/conditional probability
  • Law of total probability
  • Bayes' theorem

There are probably courses designed specifically for people interested in Machine Learning. Have fun!

Improve this answer
$\endgroup$
2
$\begingroup$

As Elias mentioned, the expectations are related to random variables and you would be good to go if you know about conditional probability, multivariate probability, joint and marginal distributions. I would suggest you take a course that has a syllabus on the lines of https://secure.oregonstate.edu/ap/cps/documents/view/134169.

Improve this answer
$\endgroup$
  • 1
    $\begingroup$ +1 on multivariate probability, joint distributions and marginal distributions! $\endgroup$ – Elias Strehle Jul 16 '19 at 16:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.