Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 50534

Artificial neural networks (ANN), are composed of 'neurons' - programming constructs that mimic the properties of biological neurons. A set of weighted connections between the neurons allows information to propagate through the network to solve artificial intelligence problems without the network designer having had a model of a real system.

1 vote
Accepted

Suspected Exploding Gradient in Character Generator LSTM

Exploding gradients are very common with LSTMs and recurrent neural networks because when unfold, they translate in very deep fully connected networks (see the deep learning book and more particularly …
qmeeus's user avatar
  • 1,339
2 votes

ValueError: Error when checking input: expected conv2d_13_input to have shape (3, 150, 150) ...

Change this: model.add(Conv2D(32, (3, 3), input_shape=(3, 150, 150),padding='same')) to this: model.add(Conv2D(32, (3, 3), input_shape=(150, 150, 3),padding='same')) And read the doc: https://ke …
qmeeus's user avatar
  • 1,339
1 vote
Accepted

Batch data before feed into CNN network

It's is a good practice to use batches to train neural networks. As Yann LeCun said: Training with large minibatches is bad for your health. More importantly, it's bad for your test error. Fri …
qmeeus's user avatar
  • 1,339
37 votes
Accepted

Early stopping on validation loss or on accuracy?

TLDR; Monitor the loss rather than the accuracy I will answer my own question since I think that the answers received missed the point and someone might have the same problem one day. First, let me …
qmeeus's user avatar
  • 1,339
49 votes
4 answers
35k views

Early stopping on validation loss or on accuracy?

I am currently training a neural network and I cannot decide which to use to implement my Early Stopping criteria: validation loss or a metrics like accuracy/f1score/auc/whatever calculated on the val …
qmeeus's user avatar
  • 1,339
1 vote

How to change parameters in LSTM for multivariate binary classification time series?

The sigmoid activation gives you a number between 0 and 1 (you can consider it as the probability of item i to be of class 1). To get hard predictions (0s and 1s) you just use a rule that says "I cons …
qmeeus's user avatar
  • 1,339
0 votes

Why does tanh activation work better with Pytorch than with Keras?

What is create_activation_function doing and why not use keras.activations.tanh(x)? How do you train the PT model? You also use early stopping and reduce lr on plateau? if not, remove it in the TF c …
qmeeus's user avatar
  • 1,339