Questions tagged [prediction]

The tag has no usage guidance.

88 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Compare large prediction with observed values

I have test scores for a lot of schools and I created a performance index calculated using the last score of a state test. This index is supossed to predict the performance of the school in the next ...
0
votes
1answer
31 views

Predicting when component will fail having its parameters data

I have a component and I need to predict when it will wear out and will need replacement. I monitor, let's say 5 parameters of this component, each one is monitored for every run cycle. So, the ...
0
votes
0answers
15 views

Can anyone please guide me how to find the accuracy, presion and recall of a tensorflow objectdetection api trained model

I have trained a tensorflow object detection api model named faster-RCNN, but I am not able to find its accuracy, precision and recall on test dataset. Kindly guide me on how to find them. I have ...
0
votes
1answer
29 views

Why am a getting wrong prediction when combining two list of samples, which individually gives correct prediction?

So I am coding in Python. I have to set of samples. Set1 contains samples of class A and the other set, Set2 contains samples of class B. These samples taken are a part of the training dataset. When I ...
0
votes
0answers
10 views

Scores of the objective function are very close to zero

For my model, I am using a square loss for the objective function. When I get the result of the prediction, the score given for each instance is very close to zero ($1*e^{-10}$). Does this mean that ...
0
votes
2answers
30 views

How can i test the performance of a model when the test data contains seen and unseen data

To test the performance of my model based on some selected features, i try to use unseen and seen data. However, when choosing the accuracy based on all data, the model is almost overfitting since ...
0
votes
0answers
19 views

Best service to host fine-tuned bert model?

I want to offer my fine-tuned bert model over the cloud. Are there any easy services to do this while only paying for usage (instead of an entire server)?
0
votes
1answer
35 views

What could make a set of the train data more predictive than the whole train data

I took a sample of my training data and balanced it and then trained my model. The results obtained are more accurate than using the whole set of train data (balanced or imbalanced). My question is: ...
0
votes
0answers
15 views

How to find prediction probability in given CNN in tensor flow?

I am very new in tenser flow. Lets assume I already have a trained convolution neutral network, now I give one new data to this CNN, and I want to see whats the prediction probability in each class. (...
0
votes
0answers
22 views

Choosing loss function in Keras for prediction binary_crossentropy or categorical_crossentropy

What loss function in keras should I chose for binary_crossentropy or categorical_crossentropy? I have data like : $w1,w2,w3,w2,w2,w1,w3,w5,w9,w5,w4...$ I want to predict sequence: input: $w1,w2,w3$...
0
votes
0answers
7 views

How to reduce complexity of inference stage in recommender systems?

Given a large set of customers and a large set of items, how to make predictions given a model like this one: https://arxiv.org/pdf/1606.07792.pdf As stated in the article: "Since there are over a ...
0
votes
1answer
31 views

Searching prediction from 4 datasets

The fourth dataset contains (train_data, test_data, previous_data, and information_history_data). The goal is to search for a user's rating on the loan to the bank. ...
0
votes
0answers
7 views

What is the difference between BAIR action free and action conditioned dataset?

The papers SV2P and SVAP talk about BAIR robot pushing dataset in 2 settings: action-free and action-conditioned. From the papers, I only understood that in action-conditioned setting, another action ...
0
votes
0answers
9 views

Logistic Regression Perfect segregation issue

Is it possible that a combination of independent variables are showing a perfect segregation in a binary logistic regression. As I am getting the warning: glm.fit: fitted probabilities numerically 0 ...
0
votes
1answer
38 views

Best metric in imbalanced classification for multi-label classification

My test data are imbalanced, i tried to use the precision or the gmean as metrics for a multi-label learning model, but both metrics are not very informative. Is there any way to use for example the ...
0
votes
0answers
17 views

Caffe CNN prediction gives poor accuracy on validation set despite success during training

I am new to Machine Learning, CNN and Caffe and I have an issue I would be very happy to solve. As part of a University project I must use a Machine Learning method to classify images into 3 classes. ...
0
votes
0answers
18 views

How can I evaluate my sequence prediction model?

I want to evaluate the performance of my prediction model , which is an VED (Variational Encoder Decoder) used for sequences prediction (it predicts the next sequence knowing the actual) I want to ...
0
votes
0answers
7 views

How to weight models for ensemble learning where models dont always have an output?

I have a problem, where I need to weight models for ensemble learning, however, some models aren't always able to give a prediction. The problem to classify 1 unit to win out of several ( 5 - 10 other ...
0
votes
1answer
23 views

Comparing different classification results with different trainig and test data

I have different samples with different sizes. The instances of each sample have different features in comparison to the instances from the other samples. For each sample i train my model and tested ...
0
votes
0answers
14 views

Drawing Trees, finding Probabilities and Predicting

My first post here :) I have some transition states. Like below, where each row reflect to a specific process: ...
0
votes
1answer
27 views

Can I test my already trained model using the data it was trained on?

I have a model that predicts multiple choice answers to questions. I used an 80/20 train test split of my questions and tuned it. The questions actually form part of a game aka 10 questions in a game....
0
votes
0answers
13 views

Convert binary outcome to multiple categorical outcome

I have a dataset containing binary labels Y with values "correct" or "wrong". I want to study the reason of wrong state, based on several conditions made from multiple features. For example I want ...
0
votes
1answer
34 views

Very low probability in naive Bayes classifier 1

I have some training data (TRAIN) and some test data (TEST). Each row of each table contains an observed class (X) and some columns of binary (Y). I'm using a Python script that is intended to predict ...
0
votes
1answer
30 views

Find suitable locations using Machine Learning

Just for fun, I am currently trying to find suitable locations to deploy new stores. So what I did so far is to take the actual sites of current stores and to assign surrounding variables to it. These ...
0
votes
1answer
37 views

Is “adding the predictions to the real data for new training and prediction” a good idea for LSTM?

Considering we have trained our model with a lot of data for "many-to-one" prediction. Then we like to forecast the future data of next 10 days. So we use last 60 of existent data and predict the ...
0
votes
0answers
27 views

Can Amazon Comprehend (Medical) be used for autocompletion of words or phrases?

"Amazon Comprehend Medical can accurately identify abbreviations, misspellings, and typos in medical text" source here. As such I believe one could use it to develop an autocorrect service, that ...
0
votes
4answers
79 views

Which type of model to use and what's my target variable

I am a beginner in Data Science field, so sorry if my question is too basic. The task is to build an ad bidding model for online marketing which allows you to deliver targeted ads to the right ...
0
votes
2answers
66 views

Predict Best Branch Locations For a Company

I have a dataset of existing 156 branches of my company with the longitude and latitude of each branch. Now we want to open 10 more branches. How can we predict the best locations for opening the new ...
0
votes
1answer
102 views

what is the best approach to my prediction problem

I'm trying to predict occupancy for every floor in a building (with the primary focus on only one "proof of concept" floor for now). I have a lot of time-series data, that tracks user's logons and ...
0
votes
1answer
575 views

Predictions with arbitrairy sequence length for stateful RNN (LSTM/GRU) in Keras

I have time series data of the following properties: input shape: (num_timesteps, num_features) output shape: (num_timesteps, num_outputs) I reshape it to batch ...
0
votes
1answer
685 views

How to Predict/Forecast street's Traffic based on previous values?

I have a dataset which has the following 5 columns: date, hour, day_of_week, street_id, counts My dataset has information about the number of cars that each ...
0
votes
0answers
368 views

How can I use machine learning methods on modelling time series data?

I face a data which records the default rate of loans by cohort.e.g. My company currently hold a portfolio comprising personal loans whose starting date was in a range from 2014 Jul till now. The ...
0
votes
2answers
33 views

How to measure accuracy of a route prediction

I developed a new route prediction algorithm and I am trying to find a metric that informs on how well a prediction was. This metric is meant to be used offline, meaning that the goal is not to ...
-1
votes
2answers
8k views

Determine accuracy of model on train data with Pandas DataFrame

I am trying to compare the accuracy of my XGBoost model output to that of a test set (data encoded in binary). My data is stored in a Pandas DataFrame. I am doing this with SKLearn by: ...
-1
votes
1answer
399 views

Q: xgboost regressor training on a large number of indicator variables results in same prediction for all rows in test

I'm training a XGBoost regressor in Python on a data set with a large number of indicator variables (one-hot-encoded from categorical variables) and a few numerical variables.The dataset size is over ...
-1
votes
1answer
113 views

Considering outliers in demand predictions

I have times series data with demand observations during months. I was wondering if, when computing demand predictions, I need to consider the outliers of the observations or not. What is your opinion ...
-1
votes
1answer
725 views

How much should I pay attention to the f1 score on this case?

I trained a model with results as below. It is a stacking model with base learners of random forest and gradient boosting. The mega model is a GLM. The dataset is imbalanced in the target class as ...
-1
votes
2answers
77 views

New to Data Science - What to use when looking for a pattern/relationship between items and an outcome

I am new to data science and I am hoping I can start applying it to my job. I have watched some videos on places like Udemy for Machine Learning and Python etc. Anyway, I have a task but I am not ...