Hot answers tagged

2 votes

What may cause the CNN layer weight regularizer to reduce the model accuracy

In general, I stumbled across voices in literature that we shouldn't use dropout with such a big parameter for shallow networks, as it can violate their capabilities. Example: Piotrowski, A. P., ...
Tomasz Witkowski's user avatar
1 vote

Why Relu is correct for CNN?

Welcome to the DataScience stack exchange. ReLu is not "correct" or "incorrect" but it is just one of several popular choices for a nonlinearity in neural networks. It sounds like ...
bogovicj's user avatar
  • 709
1 vote

Converting a Standard LSTM RNN over to a Transformer Model

With a bit of elastic net, dynamic gradient clipping and adjustments to the transformer model build training is progressing nicely now. Here is the build that fixed it: ...
Ted Wilmont's user avatar
1 vote

Adding multi-image context to a CNN

You can perform individual image classification using as input the whole set of related images as well. In order to do this, your initial input will be some 3d array of stacked 256x256 matrices and ...
Giovanni Amorim's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible