All Questions
9 questions
2
votes
0
answers
54
views
Help required in understanding how the error of a convolutional layer is calculated when filter and delta of next layer have differing dimensions
I am trying to implement a CNN in NumPy so as to better understand its inner workings
My architecture is as follows
10 images with 1 channel and with 28-pixel rows and columns (Dimension : (...
- 121
1
vote
1
answer
146
views
What is the layer above/below in a NN?
In the lecture notes of CS231n, it says (emphasis mine)
... There are three major sources of memory to keep track of:
From the intermediate volume sizes: These are the raw number of ...
- 113
2
votes
2
answers
235
views
Hello, anyone able to direct me to a "cheat sheet" of Neural Network equations with legends?
Can anyone here can direct me to a site that provides a cheat sheet of equations for Neural Networks with a legend for the notation?
It can be on any and all aspects of NN, be it forward or back ...
1
vote
1
answer
736
views
How CNN applies backpropagation to update its weights and biases?
I understand that the 3 main layers for CNN are convolutional layer, ReLU layer and pooling layer.
However, I do not understand how CNN updates its weights and biases using backpropagation.
I ...
- 101
3
votes
0
answers
123
views
Computing derivatives for backpropagation across a convolution step
This will be a long post, but I hope it'll be instructive to anyone else in my position. I'm trying to find how the derivatives of the loss function are calculated with respect to the kernels and ...
- 299
7
votes
2
answers
831
views
An error with respect to filter weights in CNN during the backpropagation
Let's say a convolutional layer takes an input $X$ with dimensions of 5x100x100 and applies 10 filters $F$ 5x5x5, thus produces an output $O$ 10 feature maps 96x96.
During the backpropagation the ...
- 436
2
votes
1
answer
2k
views
Backpropagation of convolutional neural network - confusion
I've already seen many articles about this topic and Backpropagation In Convolutional Neural Networks by Jefkine seems to be the best. Although, as author said,
For the purposes of simplicity we ...
- 21
5
votes
1
answer
1k
views
How to propagate error back to previous layer in CNN?
I have a convolutional layer (link) with an input 5x5x2 (width, height, depth):
The layer has 3 filters with dimensions 3x3x2, it produces an output with dimensions 3x3x3.
I have completed the ...
- 436
7
votes
4
answers
15k
views
When are weights updated in CNN?
In CNNs when do we update the kernel parameters using back propagation? Suppose I have batch size of 50 and training data of 1000. Do I back propagate after each batch has been presented to network or ...
- 191