Questions tagged [training]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
1answer
5k views

99% validation accuracy but 0% prediction results (UNET Architecture)

I am debugging results from the UNET architecture that I am using for identifying corneal reflection in eye images. While I am getting over 99% training accuracy and also very high (over 99%) ...
1
vote
2answers
141 views

Where can I find a trained neural network data to play with?

This is the trained neural network for the XOR operator: Can I find something like a trained network for recognizing hand writing digits somewhere on the internet? Is there an "official format" for ...
1
vote
2answers
384 views

Do models without parameters exist?

I am reading "A Course in Machine Learning" and, in chapter 2, the author says: "For most models, there will be associated parameters. These are the things that we use the data to decide on. ...
3
votes
1answer
263 views

Using already trained classifiers in Orange

I know that with Orange it is possible, using the 'Test & Score" widget, to test the performance of a classifier trained on a specific training set using a different test set ('Test on test data' ...
3
votes
0answers
269 views

How to add a new label to a multi-label dataset (like Open Images)

Given N classes in a multi-label dataset and a trained classifier C, how would we add a new class N+1 to the dataset, and fine-tune the trained classifier C such that it now predicts N+1 labels? (lets ...
2
votes
2answers
2k views

Why exactly using a test set for model evaluation is a bad idea?

I don't understand why using the test set for model evaluation is a bad idea. I completely understand why you should not use your test set to train your model (because in that case, you would be ...
4
votes
4answers
197 views

Extract 2 pieces of information from a string - what to use?

First of all, I am a complete newbie in regard to data science and I am not asking for the complete solution but some guidance as to what I should read up to achieve my task (what algorithms, ...
0
votes
1answer
1k views

Training the Variational Autoencoder After applying the reparameterization trick

In a Variational Autoencoders, z cannot be simply sampled from the output of the autoencoder directly since the network would not be differentiable. Instead, we have to sample from a normal ...
4
votes
1answer
7k views

How to train an image dataset in TensorFlow? [closed]

As I am new to TensorFlow, I would like to do image recognition in TensorFlow using Python. For this Image Recognition I would like to train my own image dataset and test that dataset. Please answer ...
0
votes
1answer
42 views

Evaluating loss for non classifying convolutional neural network

Sorry if my question is kind of dumb, I am very new to this field. I am trying to create a CNN that plays a variant of chess (for the examples, we'll use chess as it is close enough). My network , ...
1
vote
1answer
178 views

Prime model with mock data, good idea or not?

I am currently working on text classifier with some pretty unique characteristics. The data is composed of about 2K categories but 98% of the data lives in just one of those 2K categories. However, ...
1
vote
1answer
143 views

Help training Back-propagation Neural Network With 150k training pairs

I am currently trying to train my backpropagation to classify 150k training pairs. Each training pair is a vector of 18 Bipolar numbers and it runs through 2 hidden layers with a final output of 1 ...
1
vote
1answer
693 views

How to use live data to improve a existing model?

I am using logistic regression to train a model to predict 'click/non-click' using ['browser info', 'publisher info', , 'location', 'time', 'day']. I wanted to know the ways in which I can use the ...
3
votes
1answer
854 views

Evaluating Logistic Regression Model in Tensorflow

Following this tutorial, I have a doubt about the evaluation part in: ...
1
vote
0answers
113 views

Inconsistent validation accuracy? is that expected?

I am currently training a pattern classification network, and seem to get very inconsistent result. The network seem to overfit, but the validation accuracy is very inconsistent. I am currently ...
2
votes
1answer
357 views

Training accuracy with SGD

So I am computing the training accuracy of my CNN on a batch training data and it almost always gives 100% accuracy. But I found from somewhere that in order to get the training accuracy, it is tested ...
1
vote
0answers
813 views

Tensorflow Training Time Estimates

When I build models and before I train them, I have the habit of estimating the training time to make sure it is reasonable. This usually comes in the form of my naive estimate, training hours = ...
8
votes
1answer
1k views

CNN for phoneme recognition

I am currently studying this paper, in which CNN is applied for phoneme recognition using visual representation of log mel filter banks, and limited weight sharing scheme. The visualisation of log ...
3
votes
1answer
548 views

Understanding the training phase of the tutorial “Using Keras and Deep Deterministic Policy Gradient to play TORCS” tutorial

I am trying to understand the training phase of the tutorial Using Keras and Deep Deterministic Policy Gradient to play TORCS (mirror, code) by Ben Lau published on October 11, 2016. The tutorial ...
1
vote
1answer
544 views

GANs to augment training data

I have been reading about Generative Adversarial Networks (GANs) and was wondering if it would make sense to train a generator function only to use it for creating more training data. In a scenario ...
1
vote
0answers
58 views

Predict arguments of indicator function or the value the indicator function itself

I have an evenly-spaced timeseries $a_1, a_2, a_3,..., a_n$ and a function $f_k=\mathbf 1(a_k-a_{k-5})$, where $\mathbf 1$ is the unit step function. I want to predict $f_k$ using $a_1, a_2, a_3,..., ...
7
votes
2answers
9k views

How to deal with large training data?

Currently, I use image files and transform them into a *.npy file(saved as a numpy array) as training data. At present this training data set is nearly 3GB. Now I have more image files, so the ...
2
votes
1answer
5k views

Predict customer action from previous buying history

I'm trying to predict what service a customer wants when he comes to our office from his previous transactions history. I have 7 years transactions data(3 crore txns) and good amount of customers are ...
1
vote
1answer
3k views

Training And Testing Error Curves caret package in r

I am Running the following models Logistic regression Decision Trees SVM Naive Bayes Random Forest On the same data set. I am using Caret package in r. Its My dream to plot Training error and ...
1
vote
0answers
356 views

Tips for retraining convolutional neural networks given a drastically different loss surface

For the image dataset I am working with, I need to use B&W version of images (otherwise, I would need to build a network to give false colors to a set of my images, since they have an overpowering ...
2
votes
0answers
139 views

Multiple models vs. Single model for prediction

I am using the Darknet Convolutional Neural Networks to detect people (as in, humans) and furniture in a single image. If I train the model twice, one for people, one for furniture. I seem to get ...
15
votes
1answer
14k views

Is stratified sampling necessary (random forest, Python)?

I use Python to run a random forest model on my imbalanced dataset (the target variable was a binary class). When splitting the training and testing dataset, I struggled whether to used stratified ...
1
vote
0answers
58 views

Spark Deeplearning4j Training Problem

I am training a model in Spark using Dl4J library in Yarn-Cluster mode. When I train the model on 2 lakh data (approx 200MB) then the job succeeds but when I go to train the model with 3 lakh data (...
0
votes
6answers
10k views

Which train test split performs better: 50:50 or 60:40?

I have 10000 customer data of a supermarket. And I want to split the data into training set and testing set. So,which train test split gives me a better accuracy?
-1
votes
1answer
57 views

What is the minimum or maximum amount of trained data is used to train a classifier? [closed]

what should be the min or max size of trained datasets should be used to feed a classifier ? can we use 1 GB or more data as trained data to feed a classifier for jvm related ML frameworks?
0
votes
1answer
60 views

Picking training data

Suppose i want to have 80% training data and 20% testing data. How do i choose which 80% of the data to use for training? Should it be completely random? Like what if there is a class label with 2 ...
1
vote
1answer
74 views

Query regarding neural network model

I used the Neural Network Toolbox in matlab to train my data. I used four training algorithms, Scaled Conjugate Gradient (SCG), Gradient Descent with momentum and adaptive learning back-propagation (...
0
votes
1answer
306 views

Please suggest some good ways to test my RNN

I have developed an RNN in matlab and now its time to test it. You can set your desired number of layers and nodes and it trains data in random chunks. I also included an annealing function for ...
0
votes
2answers
91 views

Does the phenomenon of over-fitting of data varies with training algorithms?

Suppose I have a dataset which I want to train using Neural network and SVM. Is it possible that with my dataset after training, the Neural network is overfit while the SVM is not? Like can a dataset ...
0
votes
1answer
234 views

Deep learning - rule generation

I wanted to know if there is any methodology in Deep/Machine learning, where given a set of input/output values, it can derive rules for the same. Lets say I generate training input and output by $y=...
2
votes
3answers
1k views

How big should training data be?

I am solving a problem connected with medicine and from each patient I get about 100 features. It's a classification diseases problem, however measurements take a lot of time and also require money. ...
1
vote
0answers
209 views

Generating a text training dataset from a grammar

I want to generate documents based on a grammar to build a custom training database. What are the tools and techniques to generate random texts based on a given grammar. More specifically, I would ...
5
votes
2answers
5k views

Cross validation when training neural network?

The standard setup when training a neural network seems to be to split the data into train and test sets, and keep running until the scores stop improving on the test set. Now, the problem: there is ...
4
votes
1answer
227 views

Using GPS signal, determine is this person driving a cab

New York City provides tens of gigs of data of taxi routes all over the city. What I'd like to do, is use this data (or some other method), to come up with an algorithm that can take a persons GPS ...

1
5 6 7 8
9