Questions tagged [training]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Operation of the k-fold cross-validation method when using caret package

I have a question regarding the operation of the k-fold cross-validation method when using the caret package. As I understand it,...
1
vote
1answer
10 views

How to use External Data Sets in test set

I have a doubt regarding usage of external datasets like gdp rate, unemployment rate... etc., in test set for time series prediction. These datasets are historical and can be used along with train set,...
0
votes
0answers
6 views

FasterRCNN for Invoice fields

I am trying to train a neural network to recognize fields in a document PDF. Each document looks different, but the fields look the same. For example, I may have a field "Invoice Date" that looks like ...
0
votes
0answers
10 views

SGD Convergence in neural networks

does initialization play a role in finding a solution during training of neural networks in SGD convergence
0
votes
0answers
6 views

to train a NER model Would you make corpus case-sensitive or not? [closed]

to train a NER model Would you make corpus case-sensitive or not?
1
vote
1answer
19 views

Using GPUs of other machines in the network with Keras

My situation is as follows: I have a rather cheap laptop with Ubuntu 18.04 running on it that unfortunately is not powerful enough (old, cheap GPU) to train deep learning models with. I am located in ...
1
vote
0answers
38 views

Keras: do `sample weights` take part in the derivatives

According to Keras documentation, sample_weight can be used in order to give any sample in the training data a different importance in the loss. I have googled ...
0
votes
1answer
22 views

80-20 or 80-10-10 for training machine learning models?

I have a very basic question. 1) When is it recommended to hold part of the data for validation and when is it unnecessary? For example, when can we say it is better to have 80% training, 10% ...
0
votes
0answers
7 views

Is there any way to stop a jupyter cell mid-training and not lose the weights trained till that point?

My Deep Learning Network has been running quite some time now and has not reached halfway through its total epochs and nowhere near to the conditions to invoke the callback. However, I would like to ...
1
vote
0answers
28 views

Is the “training loop” used in AlphaGo Zero the same as an “epoch”?

I am confused about the training stage of AlphaGo Zero using the data collected from the selfplay stage. According to an AlphaGo Zero Cheat Sheet I found, the training routine is: Loop from 1 to 1,...
0
votes
3answers
28 views

Would it be okay to stop training my neural network?

When the validation error of my Neural Network that I am trying to train is slowly decreasing but not by much, is it okay to stop train the network at that point, or do I need to increase the training ...
2
votes
0answers
17 views

Training pipelines where featurization/NLP is more expensive than backprop

I'm working on a document classification project and I'm using a neural net in tensorflow, where the features are 300-dimensional word embeddings, either from fastext or word2vec (yes I know that ...
1
vote
1answer
29 views

How to adaptively sample n-dimensional data and build an optimum training set

My input space is at least 10 dimensional (after reducing it by various component analysis such as PCA) and the output space is 4 dimensional. I am building a neural network that works something like ...
0
votes
0answers
22 views

Keras: equivalence of `epochs=1000, steps_per_epoch=1` and `epochs=1, steps_per_epoch=1000`

I am training a Keras model on randomly generated data using fit_generator. Except for monitoring purposes, is A: ...
0
votes
1answer
25 views

How to re-train a model from false positives

I'm still a bit new to deep learning. What I'm still struggling, is what is the best practice in re-training a good model over time? I've trained a deep model for my binary classification problem (...
1
vote
1answer
18 views

Finding the appropriate CNN Model Architecture and Parameters

I am currently creating a CNN model that classifies whether the font is Arial, Verdana, ...
0
votes
0answers
17 views

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference?

What are the downsides of using TPUs instead of GPUs when performing neural network training or inference? From what I read on https://www.predictiveanalyticsworld.com/machinelearningtimes/should-you-...
2
votes
2answers
108 views

How to train my model efficiently?

I am new to ML and have been reading online about training bottlenecks when there are frequent updates to data. Let's say I have a built a model based on a dataset of 10M records. Now, in another 2 ...
0
votes
0answers
7 views

Reweighting training data after kernel density estimation?

I have a problem where my training set can have a bit different distribution than my test set, and I'm trying to rectify this by doing a kernel density estimation on my test set, and then applying ...
0
votes
1answer
20 views

is validation and train set should be all different files?

Let say I have train set and validation set if 'A' included in the train set. 'A' should not be include in the validation set? or some is ok?
1
vote
1answer
21 views

Data augmentation in deep training

I'm trying to understand the role of data augmentation and how it can affect the performance/accuracy of a deep model. My target application is a fire classification (fire or not, on video frames), ...
0
votes
0answers
18 views

Local RTX 2080 is 3x faster than V100 on GCP?

I have a gaming rig with an i9 CPU, 32GB RAM and RTX 2080, and I have a GCP VM with 4 vCPU, 52 GB RAM and V100. I try to train the same dataset using the same toolchain on both machines and these are ...
0
votes
2answers
23 views

Auto-Encoder customized layer training

My question is related with model-weights optimization during back propagation. In this image I'm trying to represent an auto-encoder having 7 layers where 4th one is center layer. If my ...
0
votes
0answers
35 views

Train a neural network through comparisons between images using Keras

I have a Dataset composed of 2 arrays of images and an array of desired outputs. Arrays have the same length. I have to train a neural network using keras able to recognize who is younger/older/same ...
0
votes
1answer
62 views

Does keras' model.fit() remember learning rate when called multiple times?

Let's say I'm using the Adam optimizer, and calling fit() on my model multiple times. What parameters does the fit function remember? From what I've observed, the loss function/metrics seem to ...
2
votes
1answer
47 views

A bump in CV score curve! What does it mean?

My learning curve is behaving strangely and I don't know if I'm doing anything wrong or it is because of the dataset nature. I'm using a Neural network with (30,30,15,1) layers and 'ReLU' activation ...
1
vote
1answer
18 views

Is there a link between Training, Test errors based on k fold CV and not doing CV?

I am using Matlab to train a feedforward NN using Cross validation (CV) approach. My understanding of CV approach is the following. (Please correct me where wrong) Let ...
1
vote
0answers
46 views

How to predict using the pickle model?

I am new to data science and trying to learn something. I was able to complete the prediction with 98% accuracy and i saved it as pickle model. Now while trying to predict using this model I am ...
1
vote
0answers
15 views

How many augmentated data points for each training image?

What are some useful rules of thumb for picking the number of augmenters per training image? I realize this is a hyperparameter I can vary and test: I'm just trying to get a sense for reasonable ...
1
vote
2answers
29 views

How many trees does a random forest need?

At first, I did a GridsearchCV and the best parameter is a random forest with just 100 trees. My trainset has 80.000 rows and 669 columns. My test set has 20.000 rows and 669 columns. How is it ...
1
vote
1answer
55 views

How to keep the test data from leaking into the training process of a machine learning algorithm?

I read in many different sources that I need to split my data into a training set and a test set. Then I have to make sure that the algorithm is trained only on the training data, and do my best to ...
0
votes
0answers
13 views

Is it normal that CUDA will sporadically run out of memory?

Sometimes I will train a model successfully, othertimes CUDA will run out of memory in the middle of training with the exact same network, batch size, etc. Similar behaviour like models not loading ...
0
votes
1answer
24 views

What is the main concept of using lexical,linguistic, semantic or syntactic approach in NLP for cyberbullying

I am really in need of some explanation, I am working on an NLP cyber-bullying detection tool which I will deploy to the web using Django framework, however, am stuck on some idea, can someone explain ...
0
votes
2answers
18 views

Present results of the best or the last iteration on dev set?

Which is the correct way - presenting the results of the best or the last iteration on the dev set in a paper? In research papers I usually see only one value, is it the best iteration of all? I'm ...
1
vote
1answer
52 views

Incremental training and Auto Machine Learning for big datasets

I built a NLP sentence classifier, which uses vectors from word embedding as features. Training dataset is big (100k sentences). Every sentence has 930 features. I found the best model using an auto ...
30
votes
8answers
6k views

What would I prefer - an over-fitted model or a less accurate model?

Let's say we have two models trained. And let's say we are looking for good accuracy. The first has an accuracy of 100% on training set and 84% on test set. Clearly over-fitted. The second has an ...
1
vote
0answers
17 views

Vector Autoregression forecasting with large dataset

I am trying to use VAR to forecast electricity price for a whole day and I have a dataset with over 20000 observations (price for every hour) from 2015-2017. My first intuition was to select 19975 ...
0
votes
0answers
40 views

InvalidArgumentError: Incompatible shapes while training

InvalidArgumentError: Incompatible shapes: [15,31744] vs. [15,31680][[{{node loss_4/output_loss/logistic_loss/mul}}]] Has anyone of you ever got this kind of ...
1
vote
1answer
22 views

Including the validation file in the training process after tunning

Should I include the validation file in the training process after finishing the tuning process (e.g. searching for params using the validation file)?
1
vote
2answers
45 views

How to train the machine so that it can give 'out of bound/classes' as an output for neural network

I know I was not able to word the title of the question properly. So I am trying to explain the problem here: Suppose, I built and trained a CNN to identify numbers from 0 to 9. However, when I ...
0
votes
1answer
68 views

splitting into train test by train_test_split of float values?

How to split into train test by train_test_split of float values ? I used LabelEncoder but I have about 300K lines and when I used the cross_val I saw ...
0
votes
0answers
15 views

How to convert non image data to lmdb format for caffe

I have data where the input is of size [1,1,625] ( width and height is 1 and number of channels is 625). The input size cannot be changed since I need to use the weights of a pretrained model which ...
1
vote
1answer
167 views

Is it reasonable that a problem “solved” by a traditional ANN can also be solved by a CNN?

There is a data science numerical problem, which me and my team were able to get an ANN model that predicts down to a 1% MAPE error (with roughly 70000+ trainable parameters). Given the nature of the ...
0
votes
0answers
20 views

Loss is decreasing but the predictions are not getting well

I am trying to implement a Dependency Parsing model using the transformer model in here with a few changes. On the training, my loss has decreasing trend; but the predictions at the end of 20 epochs ...
1
vote
1answer
126 views

What's the best way to train a NER model?

I am trying to do a project using NLP. My goal is to process Cyber Threat Intelligence articles like this to extract information such as actor’s name, malwares and tools used… To do that I want to ...
0
votes
0answers
17 views

Best model for removing a consistent background image

I'm working on an ML driven background replacement from photos, where the background will always be consistent, but the objects in front of that background (in this case humans) will be different - ...
0
votes
0answers
27 views

What will cause high accuracy but a big loss?

In the question of What is the relationship between the accuracy and the loss in deep learning?, @Jérémy Blain gave a fantastic interpretation of 'relationship' between accuracy and loss: 1 - low ...
0
votes
0answers
16 views

Find Correspondence between Image Pair

I have a problem with the following provided: (for some reason I can't disclose the dataset) Dataset My dataset is a bunch of raw images with a lot of strip-like objects. Each image has a lot of ...
0
votes
1answer
37 views

How to treat time based ticket prices for train/test split

I have a dataset of airfare price tickets that were scraped throughout a 6 month period where each observation represents a particular price for a specific flight on a specific date that it was ...
1
vote
2answers
58 views

Accuracy of KFold Cross Validation for Neural Network

I have a neural network that Im evaluating using 10 -Fold cross validation. The validation accuracy for a fold changes alot during training in the range of -+10% So for example the validation ...

1
2 3 4 5
7