All Questions
Tagged with regularization cnn
10 questions
2
votes
1
answer
63
views
What does it mean if a neural networks starts overfitting more after applying regularisation techniques
Background
I am building a CNN to categorize cytometric cell data into healthy and diseased groups.
The architecture looks as follows:
3 Convolutional layers followed by average pooling followed by 3 ...
- 121
0
votes
1
answer
152
views
What may cause the CNN layer weight regularizer to reduce the model accuracy
What may cause the accuracy reduction when using the tf.keras regularizer at layers in CNN in the symptom? The example is simple but it happens with more complex CNN causing no improvement during the ...
- 791
1
vote
0
answers
33
views
Understanding model's learning curves
I'm trying to train a Lane Detection CNN called PINet on a proprietary dataset.
Below are some of the important configuration values:
Batch size: 6
Optimizer: Adam
Learning rate: High of 1e-4 and Low ...
- 11
2
votes
1
answer
5k
views
How to reduce overfitting in a pre-trained network
I have a custom dataset with 10 classes and I am using a pre-trained resnet18 model from torch-vision. I can clearly see it's over-fitting because: the model is trained for 75 epochs with a batch size ...
- 143
0
votes
0
answers
150
views
early-stopping changes final epoch in training each time
I am training a CNN built using transfer learning with a VGG16 network as pre-trained model, and in the training I am using early-stopping as regularization technique. I have run several time the ...
- 921
2
votes
2
answers
198
views
How to build an overfitted network in order to increase performances
I am learning how to implement CNN, and searching on the internet I have found that a trick to design a good network is to first build it in such a way that it overfits, and then use regularization to ...
- 921
1
vote
0
answers
176
views
How can I regularize the output of a layer from scratch (without using Keras)?
I am trying to build a Convolutional Neural Network after reading notes from Stanford's cs231n course. I use ELU activation as activation function, and SoftMax as my classifier. Architecture is simple:...
- 11
1
vote
0
answers
265
views
High Variance on CNN
I'm using a shallow CNN for my current project [this one]. I have a training dataset consisting of 1000 samples and a test dataset of 400 samples. I'm using the test dataset to choose the best ...
- 81
1
vote
1
answer
367
views
Loss for CNN decreases and settles but training accuracy does not improve
I am training a CNN with 2 conv layers 2 Relu and max pooling and 2 FC layers the last of which has only 2 units since it's a binary classification problem. The images are spatio-temporal continuous, ...
- 90
1
vote
1
answer
1k
views
trying to decrease overfitting with regularisation in CNN
I am doing transfer learning by retraining the publicly available inception layer, without regularisation here are my initial parameters and results:
...
- 161