Questions tagged [prediction]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Difference between shap values and feature contributions

I always found both concepts a bit confusing since they are quite similar. Would someone provide clear example where to apply each? Shap values ref: https://towardsdatascience.com/explain-your-model-...
0
votes
0answers
18 views

How to calculate the prediction interval?

I am recently engaged in a project of predicting the future blood glucose values of the patient. I was able to get a lower RMSE and MAE by using Gradient Boosting Algorithm. But although the error is ...
0
votes
0answers
13 views

factors in the success of startup fundraising

I have been following this paper published in 2019. There are few things that are ambiguous and not at all clearly explained. On page 7, table 2, Max Portfolio, ...
0
votes
1answer
20 views

How to compute the prediction interval for unseen data?

I want to calculate the prediction interval of individual predictions without knowing what it's target value is gonna be. For example, I am doing a blood glucose prediction of individual patients and ...
0
votes
1answer
19 views

Binary classification problem with imbalanced dataset, how to compare to random classifier

We have a very imbalanced dataset (2% of class 1). To the best of our knowledge, there is no baseline in the literature to the problem we want to solve - so we thought of comparing our performance to ...
2
votes
1answer
52 views

Predicting the missing word using fasttext pretrained word embedding models (CBOW vs skipgram)

I am trying to implement a simple word prediction algorithm for filling a gap in a sentence by choosing from several options: Driving a ---- is not fun in London streets. Apple Car Book King With ...
0
votes
1answer
16 views

Can OLS regression be used to predict from a complete sequence of data?

Reading online and following this example from scipy I understand OLS can be used to find data between gaps in a sequence (interpolate?) but I already have a complete sequence and want to predict the ...
0
votes
1answer
17 views

prediction() returning mistakenly false positives [closed]

I do not know how to interpret the result of: prediction(c(1,1,0,0), c(1,1,0,0)) prediction() functino comes from prediction {ROCR} it has this site: ...
0
votes
1answer
20 views

Dissecting performance issues with Random Forest

My task is to identify potential situation for trading and determine whether a candidate is going to succeed or not. I have a system in place to identify candidates, but there is a high rate of false ...
0
votes
1answer
19 views

NN Model accuracy and loss is not changing with the epochs!

I am building a tensorflow model for Heart Disease Prediction data-set. It has a binary outcome (0, 1). Though I am struck with such a low accuracy which is not changing with epochs. ...
0
votes
0answers
30 views

Using Neural Networks on images to predict successful vs unsuccessful trades

The context for the problem is day trading: identifying the moment when one can buy units of a stock and then wait for them to grow in value before selling them at the new price. Currently I have a ...
0
votes
0answers
9 views

Changing time period between data points based on how far into the future has to be predicted

I'm trying to predict future values using time series data. If I want to predict further into the future, say a couple days ahead, should I use a certain period of time between data points? Is it ...
2
votes
2answers
32 views

Which algorithm to use to identify clusters with a similar value?

Here, an example of my problem: 10000 observations of people with several features [age, gender, region, number of sons, ...] and a value to predict "income". There is not a general relationship ...
1
vote
1answer
41 views

Is there any way to calculate the true,false positives and negatives for a regression problem

I am trying to predict the glucose values of the patients for example values like 45,256,115 etc. based on some features. Currently I am calculating the accuracy in means of RMSE,MSE,R². Is there any ...
0
votes
1answer
21 views

Classification with feature not available at time of model creation

I have problem statement to predict the probability of solving a task depending on multiple features for e.g. when the task was created, the time needed to work on a task, etc Please find a dummy ...
0
votes
0answers
14 views

How to make ongoing prediction with panel data with Keras

I have trained a CNN model in Keras for predicting risk of an event happening, where the labels are 0 or 1(one-hot). Input data:...
0
votes
2answers
31 views

How to cluster categorical and numerical data in the same dataset?

I have a dataset in which it contains both numerical and categorical data. This can be done using supervised learning algorithms, but I am eager to see how this data can be clustered using some ...
0
votes
1answer
29 views

Class asks me to give self for Naive Bayes Model python

I try to use the following code but when I try to use fit function with my X_train and y_train, I get the following error: <...
1
vote
1answer
24 views

what metrics to evaluate rank order results?

I have searched on stackexchange and found a couple of topics like this and this but they are not quite relevant to my problem (or at least I don't know how to make them relevant to my problem). ...
1
vote
1answer
42 views

Unable to make accurate predictions?

I have a dataset of diabetes patients and I am trying to predict the next blood glucose level. I have attached an image below and I have about 1600 records in that csv file containing data of 10 ...
1
vote
1answer
17 views

Machine Learning - How to predict set of fixed fields based on past features

I have quite a large dataset (> 100k rows), which contains information for logistical shipments. (export shipments) The dataset looks like this: ...
2
votes
0answers
16 views

ML methods for prediction, using categorical variables and time

Most of the time series analysis tutorials/textbooks I found time series data, usually deal with continuous numerical variables. I am currently trying to solve a problem that deals with multivariate ...
0
votes
0answers
17 views

How to deal with different length entities in a Keras DataGenerator?

I'm solivng a prediction problem where I need to predict the demand of multiple articles based on their performance during the last 7 days. To get the most out of the data I am trying to implement a ...
1
vote
1answer
19 views

Dealing with issues in “test” predictons for single “items” (null values, standardization in place, etc)

I know this is kind of a broad question but I have tried to scour both this forum and the internet in general to no avail for this particular situation. So imagine I have a model trained for which, ...
5
votes
1answer
48 views

which algorithms can be used to extrapolate non-linear data?

I have a dataset, where target value changes in time in following way: I need to predict target value for upcoming month, however I struggle to find a method to extrapolate the function that defines ...
2
votes
1answer
18 views

Can sampling like SMOTE/UP/DOWN applied on Validation set?

I am trying to predict classification problem. For that I have used Ranger, Xgboost and naive bayes. My Response class is imbalance . 92:8 ratio. My positive Response is only 8% of whole data. ...
4
votes
1answer
181 views

Calculate confidence score of a neural network prediction

I am using a deep neural network model to make predictions. My problem is a classification(binary) problem. I wish to calculate the confidence score of each prediction. As of now, I use ...
4
votes
1answer
41 views

Why does MAE differ after prediction (Neural Network)?

I'm having trouble understanding what's happening in the following code. I already have defined x_train, y_train, x_val, y_val and x_test which define my training, validation and test sets. I'm using ...
2
votes
1answer
32 views

Using Majority Class to Predict Minority Class

Suppose I want to train a binary model in order to predict the probability of who will buy a personal loan and in the dataset only 5 percent of the examples are people who marked as bought a personal ...
1
vote
1answer
30 views

How to use random forest model to new data?

I am new to this Data Science field. I have a question to apply Random forest to new data. I have this table. ...
0
votes
2answers
36 views

prediction using LSTM

i have training data from 2015-2017 and testing data of 2018. i have multiple variables my data is multivariate time series data.i want to predict 2019 data by using test data of 2018.is it possible? ...
3
votes
1answer
38 views

Terminology - regression with one output and multiple output variables

I am trying to predict the response when the input is represented by Fourier transform. These form the features and are typically represented as a vector, $x_1,x_2,...,x_d$ where $d$ is the length of ...
3
votes
1answer
464 views

Making predictions / Loading model in TensorFlow 2.0

I use TensorFlow/Keras on a daily basis to make predictions for a project. Everything works fine but I was getting regular warnings about the transition to TensorFlow 2.0 and I thought this week I ...
0
votes
0answers
20 views

Loss is decreasing but the predictions are not getting well

I am trying to implement a Dependency Parsing model using the transformer model in here with a few changes. On the training, my loss has decreasing trend; but the predictions at the end of 20 epochs ...
2
votes
1answer
30 views

Making predictions with missing numeric data

I don't know much about how to deal with missing data. When the data is categorical it doesn't seem too bad, if I one-hot encode it without dropping any of the actual categories, the missing data is ...
1
vote
1answer
33 views

How to forecast labels forward 3 years

I have many variables that I am using to predict median gross rent. I want to predict forward 3 years this is what my labels look like: How do I either preprocess the data in order to get a 3-year ...
1
vote
0answers
17 views

Prediction issue with xgboost custom loss

I have an issue with xgboost custom objectives: I do not manage to get consistent forecasts. In other words, the scale of my forecasts is not in line with the values I would like to predict. I tried ...
0
votes
0answers
15 views

Sales Prediction for multiple customers

In e-commerce, there will be lots of customers but each customer sales will be limited in number of records? In some cases, the records will be less 5 also. In cases like this, how to predict the ...
0
votes
0answers
31 views

Metrics for multi-class classification. When the prediction is of low quality

I am having a multi-class classification problem, so prediction of an instance to which class belongs to. I am reading that the typical metrics like accuracy or score are very "strict" on such ...
1
vote
0answers
26 views

Predict with some probability the day of the month paycheck received through daily transactions

I am using R to do machine learning. I have daily shopping expenditure data of individuals over a couple of months and my goal is to be able to identify through their shopping pattern the day of the ...
0
votes
1answer
41 views

Which Machine Learning methods would be good for a beginner-level Data Science project for described dataset? [closed]

I want to do my first beginner-level project regarding Data Science. I picked my data set which is described below. I want to make a Python script which will make some predictions on our data set ...
0
votes
1answer
21 views

Why the first prediction of neural network in PyTorch is slower than following predictions?

So I have ResNet50 trained to classify images. For each prediction I track the time needed for it (input and model are moved to GPU): ...
0
votes
0answers
186 views

Weather Forecasting: CNN-LSTM or ConvLSTM?

I am trying to develop a weather forecast model where satellite images (temperature, velocity field etc) are stacked over time. Since the prediction model needs to analyze both spatial features and ...
1
vote
1answer
134 views

Machine learning in electrical circuit simulation [closed]

In the field of VLSI design, and specifically in digital circuits it is common to use electrical simulation software to find signal integrity issues. I would like to use machine learning instead of ...
2
votes
2answers
58 views

Incorrectly applying random forest model?

I am fairly new to random forest models (and data science in general), and was wondering if I am operationalizing the model I created correctly. Context: I am creating a random forest model to ...
2
votes
0answers
60 views

Results are too good.. what is wrong? How to predict correctly?

I am about to evaluate a neural network and want to check whether the predictions make sense. The variables: ...
0
votes
0answers
78 views

Convolutional Neural Network for Structured Data

I am having a student dataset which is a record of student academic details I know that that CNN is mostly used in computer vision and image processing for analyzing visual imagery But here it is ...
0
votes
1answer
45 views

Feature engineering - house price prediction (small dataset) [closed]

I am working on the task of predicting real estate prices. My dataset has only 10 variables described below. I'm thinking about feature engineering but nothing comes to mind. Variables: ...
0
votes
0answers
14 views

How to encode factor predictors in prediction models

The response variable as well as all predictor variables in my dataset are factors. I want to build a model for predicting the response variable. As I understand I have to first encode my predictor ...
0
votes
2answers
38 views

Validate via predict() or via fit()?

There are several possibilites to evaluate a model: hist = model.fit(x_train, y_train, (...) validation_data=(x_test, y_test)) or to use <...

1
2 3 4 5 6