# Questions tagged [derivation]

The tag has no usage guidance.

14 questions
Filter by
Sorted by
Tagged with
27 views

### Batch normalization backpropagation doubts

I have recently studied the batch normalization layer and its backpropagation process, using as my main sources the original paper and this website showing part of the derivation process, but there is ...
29 views

### Loss function for points inside polygon

I am trying to optimize some parameters that used to transform 2d points from a place to another (you may think of that as rotation & translation parameter for simplicity) The parameters are ...
21 views

### Derivation of HiddenState wrt Output of LSTM

I'm busy trying to understand the math behind LSTM RNN's. In most of the math tutorials that I've found the derivations (Backpropagation) don't consider a dense layer before the output, instead they ...
89 views

### SVM - Making sense of distance derivation

I am studying the math behind SVM. The following question is about a small but important detail during the SVM derivation. The question Why the distance between the hyperplane $w*x+b=0$ and data ...
20 views

### Deriving vectorized form of linear regression

We first have the weights of a D dimensional vector $w$ and a D dimensional predictor vector $x$, which are all indexed by $j$. There are $N$ observations, all D dimensional. $t$ is our targets, i.e, ...
74 views

### Why is it valid to remove a constant factor from the derivative of an error function?

I was reading the book 'Make your own neural network' by Tariq Rashid. In his book, he said: (Note - He's talking about normal feed forward neural networks) The $t_k$ is the target value at node $k$, ...
57 views

### How is this score function estimator derived?

In this paper they have this equation, where they use the score function estimator, to estimate the gradient of an expectation. How did they derive this?
2k views

### Is it valid to use numpy.gradient to find slope of line as well as slope of curve at any point?

what is the difference between slope of the line and slope of the curve? Is it valid to use numpy.gradient to find the slope of the line and slope of the curve at ...
129 views

### 1st order Taylor Series derivative calculation for autoregressive model

I wrote a blog post where I calculated the Taylor Series of an autoregressive function. It is not strictly the Taylor Series, but some variant (I guess). I'm mostly concerned about whether the ...
154 views

### Derivative of Loss wrt bias term

I read this and have an ambiguity. I try to understand well how to calculate the derivative of Loss w.r.t to bias. In this question, we have this definition: ...
101 views

### Maximum Entropy Policy Gradient Derivation

I am reading through the paper on Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review by Sergey Levine. I am having a difficulty in understanding this part of the ...
18 views

### back propagation through time derivation issue

I read several posts about BPTT for RNN, but I am actually a bit confused about one step in the derivation. Given $$h_t=f(b+Wh_{t-1}+Ux_t)$$ when we compute $\frac{\partial h_t}{\partial W}$, does ...