Questions tagged [training]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
59
votes
2answers
43k views

Training an RNN with examples of different lengths in Keras

I am trying to get started learning about RNNs and I'm using Keras. I understand the basic premise of vanilla RNN and LSTM layers, but I'm having trouble understanding a certain technical point for ...
7
votes
2answers
2k views

How to fix class imbalance in training sample?

I was very recently asked in a job interview about solutions to fix an imbalance of classes in the training dataset. Let's focus on a binary classification case. I offered two solutions: oversampling ...
26
votes
3answers
23k views

Should a model be re-trained if new observations are available?

So, I have not been able to find any literature on this subject but it seems like something worth giving a thought: What are the best practices in model training and optimization if new observations ...
22
votes
4answers
8k views

Is it always better to use the whole dataset to train the final model?

A common technique after training, validating and testing the Machine Learning model of preference is to use the complete dataset, including the testing subset, to train a final model to deploy it on, ...
7
votes
4answers
3k views

Build a tool for manually classifying training data images

I have a large number of images that I need to classify for training a clustering algorithm, and I would like to do so offline (the data is proprietary). Basically, I'd like to build a desktop survey ...
6
votes
4answers
10k views

Tool to Label Images for Supervised Classification

I have a couple thousand photos of whales taken from drones and I'm planning to build a simple binary classifier to run on these and future images to see if they contain a whale. I'd like to label ...
3
votes
1answer
582 views

“other” class in Image classification

In the MNIST dataset, you have 10 defined classes, one for each digit. But you don't have a "not a digit" class. It seems that most image classification datasets are the same. But in a business ...
2
votes
1answer
790 views

Training Keras model with multiple CSV files

I'm currently trying to train a Keras model on several large CSV files. I can fit one in memory, but not all combined. From my point of view, there are several ways to deal with this problem. I could ...
3
votes
1answer
106 views

When forecasting time series, how does one incorporate the test data back into the model after training?

When you build a classification or regression model, you typically split the data into a train data set and a test data set. The test data is a randomly selected subset of the overall data. Once you ...
2
votes
0answers
120 views

How to resolve the instability of average reward per episode in training of DQN (Deep Q-Network)?

what is shown when average reward per episode in training is unstable? If there is big difference between average reward per episode and final reward by test section, what we can say? For ...
7
votes
1answer
1k views

CNN for phoneme recognition

I am currently studying this paper, in which CNN is applied for phoneme recognition using visual representation of log mel filter banks, and limited weight sharing scheme. The visualisation of log ...
3
votes
2answers
200 views

Why can't I choose my hyper-parameter in the training set?

Say I've divided the data into 3 parts: training, validation and test. I know for example, that in Neural Networks, the number of hidden layers is a hyper parameter. Why can't I train numerous NN ...
2
votes
2answers
959 views

validation/training accuracy and overfitting

If we randomly split the data into training data and validation data, and assume the training data and validation data have similar "distributions", i.e. they are both good representations of the ...
2
votes
1answer
42 views

How to predict based on multiple samples?

I am relatively new to ML so I apologies in advance if my question shows lack of understating of the field. The problem A particular study course has a high drop-out rate and we want to reduce it. ...