Questions tagged [mathematics]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
9 views

Exponentiated Gradient

I am currently trying to understand exponentiated gradient from this paper. Here is an implementation of the Algorithm in Python. So my question using exponentiated-gradient algorithm we can update ...
1
vote
1answer
21 views

How regularization helps to get rid of outliers?

I have heard regularization helps to get rid of outliers, how so? 'My intuition is, regularization shrinks parameter or even make it zero, and hence large value will have less effect on overall result'...
0
votes
2answers
73 views

ML, Statistics and Mathematics

I have just started getting my hands wet in ML and every time I try delving deeper into the concepts/code, I face the challenges of the mathematics and its cryptic notations. Coming from a Computer ...
1
vote
1answer
39 views

How do I know how to construct the layers of my CNN

I've done a CNN project with Keras and OpenCV, and I've got roughly 65% accuracy. And now I have to present this work in my University, but I'm afraid if the teachers ask me for how do I knew how to ...
2
votes
1answer
53 views

Help in understanding the maths behind Logistic Regression

I am following the lecture notes available https://www.stat.cmu.edu/~cshalizi/uADA/12/lectures/ch12.pdf I cannot understand how Eqs 12.4 and 12.5 come, why the Bernoulli probability has $1-p(x)$ in ...
0
votes
0answers
13 views

Is this interpretation of spectral normalisation mathematically correct?

Hello everyone, this is my first post. I was thinking about the mathematical interpretation for spectral normalization in neural networks the other day, and I came up with an explanation that feels ...
0
votes
1answer
19 views

Kernel Trick and Inner Product Preservation

I understand that the point of using the kernel trick is to project the problem onto a higher dimensional space, where the problem is linearly separable. In this explanation, https://www.quora.com/...
1
vote
2answers
196 views

How do I calculate the range of a F1-score from a confusion matrix of 3 class,A,B,C

Is there any support function to calculate the average F1-score range?
0
votes
2answers
49 views

Solving Bayes Theorem equation -> I can't calculate proper result

I am solving questions for an edx course on Machine Learning. One particular question is giving me a problem: Assume a patient comes into the doctor’s office to test whether they have a particular ...
0
votes
2answers
55 views

How to learn certain Maths to understand machine Learning papers?

I have done the deeplearning.ai course on deep learning. But I cannot Understand equations like minGmaxDV(D,G)=Ex∼pdata(x)[logD(x)]+Ez∼pz(z)[log(1−D(G(z)))] ...
1
vote
1answer
18 views

Choose points to maximize volume of convex hull

Suppose I have N points (labeled 1, 2, ..., k, ..., N) in D dimensions. I'd like to choose ...
1
vote
0answers
99 views

Updating Weight Using Updates on Related Data

Suppose $$ x=Ay $$ The $x$ is $M\times 1$, $y$ is $N \times 1$ and $A$ is $M\times N$ We have the data $x$ and would like to know what $y$ is. However, the matrix $A$ is too large for pseudo-...
2
votes
1answer
52 views

Elements of Statistical Learning - question on p. 18

In the following expression: What do $E_{X}$ and $E_{Y|X}$ mean, respectively? In case helpful, I note that the authors derived that expression from the following: Based on the above, how would one ...
0
votes
0answers
24 views

Proof MDS algorithm

I am studying this paper from Ali Ghosdi class I probably lack of knowledge in linear algebra but there are some steps that I don't understand. Like on the second page he talks about the distance ...
17
votes
2answers
5k views

What is GELU activation?

I was going through BERT paper which uses GELU (Gaussian Error Linear Unit) which states equation as $$ GELU(x) = xP(X ≤ x) = xΦ(x).$$ which appriximates to $$0.5x(1 + tanh[\sqrt{ 2/π}(x + 0.044715x^...
1
vote
1answer
78 views

Efficient self study plan

I am hoping for a bit of guidance from experienced practitioners / academics. I want to work through the Bishop ML book, but have minimal background. What is the fastest way to get the pre-...