2

If you're getting 95% accuracy on training set, but only 75% on test set, this points to serious overfitting, which none of the measures you've listed are likely to address. It's also suspicious that validation result are so close to training, but far from test. This often happens when you change validation set during training, meaning there's effectively no ...


2

A possible cause of the problem is that you are using the mean-squared error (MSE) as loss function for a classification problem. Normally, for classification you would use categorical cross-entropy.


2

I suggest to apply a nonrandom weight initialisation in order to see the impact of random initialization. For instance, you can use the Nguyen-Widrow weight initialization. def initnw(layer): """ Nguyen-Widrow initialization function :Parameters: layer: core.Layer object Initialization layer """ ci = layer.ci cn = ...


2

You only need such a projection if you are using only dense layers for your model (i.e. a multilayer perception (MLP)). You can simply have a convolutional autoencoder, where the layers are convolutions and max pooling, and therefore the number of parameters is drastically reduced with respect to an MLP. You can check Keras' tutorial on autoencoders, ...


1

It’s not wrong. NN training is inherently stochastic. As an optimisation problem, the tuning of a NN depends on the initialisation (initialisation of the weights). So the result (the local minimum you end up in) depends on the initialisation too. There are mainly two ways to go : if this is not a problem for your use case (if only the global performance ...


1

There's nothing "wrong" with your model or code. Your model is just trained using a stochastic method. Meaning that your model will converge on the optimal values in a different way each time.


1

You can not feed your network with two inputs with different number of samples, and this also does not make sense. You have 2 inputs with shape (502,) and (1002,) (You have said you want to extract features also from your second dataset). Let's consider the batch size is 1 for the sake of simplicity. So the model takes one sample each time to move it through ...


Only top voted, non community-wiki answers of a minimum length are eligible