Questions tagged [prediction]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Metrics for multi-class classification. When the prediction is of low quality

I am having a multi-class classification problem, so prediction of an instance to which class belongs to. I am reading that the typical metrics like accuracy or score are very "strict" on such ...
1
vote
0answers
20 views

Predict with some probability the day of the month paycheck received through daily transactions

I am using R to do machine learning. I have daily shopping expenditure data of individuals over a couple of months and my goal is to be able to identify through their shopping pattern the day of the ...
0
votes
1answer
37 views

Which Machine Learning methods would be good for a beginner-level Data Science project for described dataset? [closed]

I want to do my first beginner-level project regarding Data Science. I picked my data set which is described below. I want to make a Python script which will make some predictions on our data set ...
0
votes
1answer
12 views

Why the first prediction of neural network in PyTorch is slower than following predictions?

So I have ResNet50 trained to classify images. For each prediction I track the time needed for it (input and model are moved to GPU): ...
0
votes
0answers
7 views

Weather Forecasting: CNN-LSTM or ConvLSTM?

I am trying to develop a weather forecast model where satellite images (temperature, velocity field etc) are stacked over time. Since the prediction model needs to analyze both spatial features and ...
1
vote
1answer
30 views

Machine learning in electrical circuit simulation [closed]

In the field of VLSI design, and specifically in digital circuits it is common to use electrical simulation software to find signal integrity issues. I would like to use machine learning instead of ...
2
votes
2answers
48 views

Incorrectly applying random forest model?

I am fairly new to random forest models (and data science in general), and was wondering if I am operationalizing the model I created correctly. Context: I am creating a random forest model to ...
2
votes
0answers
57 views

Results are too good.. what is wrong? How to predict correctly?

I am about to evaluate a neural network and want to check whether the predictions make sense. The variables: ...
0
votes
0answers
19 views

Convolutional Neural Network for Structured Data

I am having a student dataset which is a record of student academic details I know that that CNN is mostly used in computer vision and image processing for analyzing visual imagery But here it is ...
0
votes
1answer
30 views

Feature engineering - house price prediction (small dataset) [closed]

I am working on the task of predicting real estate prices. My dataset has only 10 variables described below. I'm thinking about feature engineering but nothing comes to mind. Variables: ...
0
votes
0answers
9 views

How to encode factor predictors in prediction models

The response variable as well as all predictor variables in my dataset are factors. I want to build a model for predicting the response variable. As I understand I have to first encode my predictor ...
0
votes
2answers
32 views

Validate via predict() or via fit()?

There are several possibilites to evaluate a model: hist = model.fit(x_train, y_train, (...) validation_data=(x_test, y_test)) or to use <...
1
vote
0answers
22 views

How to deal with similar feature values but each indicates to a different information?

If I have a feature with replicated values but each of these values indicates a different piece of information. example: feature 'street name' with value 'A' which some of these 'A's are for Boston ...
0
votes
1answer
76 views

clarification on train, test and val and how to use/implement it

So far I think I understood the differences between the training, test and validation set. Basically it is like in this image: Training set: The data where the model is trained on Validation set: ...
0
votes
1answer
18 views

Why is my prediction using ARIMA better if I'm using less historic data?

I have a data set containing hourly electricity prices for since 1.01.19 until September. Since the process turned out to be (weakly) stationary, I applied an ARIMA model in Python in order to predict ...
2
votes
1answer
24 views

Neural Network Multiple | Averging predictions

I am training multiple neural networks with various parameters. I am trying to average their predictions, but I am not really sure what that means, I am confused about what to average exactly. Here is ...
0
votes
0answers
7 views

Derive main prediction for zero-one loss function

Intuitively I can see why mode of predictions is the main prediction of a zero-one loss function, but mathematically I am not sure how it is derived? Main prediction $= argmin_{y'}E_D[L(\widehat y, y'...
0
votes
0answers
8 views

pattern recognition tool

From what i've seen while searching google and the site this is most likely way simpler than what normally get's asked but i've not been able to find anything that could help me with it. What i'm ...
0
votes
0answers
6 views

SRGAN: How to adapt the model to the input image?

I wrote and trained my own SRGAN: so I obtained a generator’s model that takes 32x32 images as input and gives their improved 128x128 version as output… However, the end users of my Android app will ...
0
votes
1answer
16 views

How to measure/rate the effect of a exogenous covariate in a ARIMAX Model?

I have an ARIMA model, I'm trying to figure out how much an external variable (exogenous covariate) could improve the forecast, so I need to "synthesize" a rate that tell me the usefulness (or impact) ...
0
votes
0answers
12 views

Use sequential pattern mining rules to predict next window of a dataset

Suppose that I am performing Sequential Pattern Mining (maxgap = 1, i.e. rules for consecutive windows) and I ran the following code from arulesSequences in R Studio to determine significant rules ...
0
votes
1answer
17 views

Predicting complete time series for given parameter sets

Im searching for an approach that is able to predict a complete time series for a given parameter set. Imagine a robotic arm which has a starting position and a target position. There is a sensor ...
0
votes
2answers
150 views
3
votes
2answers
136 views

Is There a Way to Re-Calibrate Predicted Probabilities After Using Class Weights?

I have classification data with far more negative instances than positive instances. I have used class weights in my models and have achieved the discrimination I want but the predicted probabilities ...
0
votes
1answer
13 views

nltk measure the accuracy of the new features

Have been playing around the NLTK algorithm for some data prediction. Starting form this gib, I started my understanding process. However, there are some bits that don't make sense. If I have a set ...
0
votes
3answers
39 views

Predict the salaries of customers in 2019 from 2016 data

I have a spreadsheet of data with ages and salaries for 2016. For example, in 2016 there were 12988 customers who were 18 years old and earned 20k. I need to predict the salaries of customers for 2019....
2
votes
1answer
25 views

Predicting probability for each tag given already chosen tags

I have a set of tags (~10'000, will be extended over time) presented to a user. After he has selected 3 or more tags, I want to predict for each remaining tag what the chances are that the user will ...
1
vote
1answer
19 views

Finding the usage percent to perform predictive analysis for new users

Problem Statement- I have to find the average feature usage all the users and the usage of user X to suggest if he should use the feature. Example - On google home page out of all the user's avg 85% ...
0
votes
0answers
12 views

what are possible error analysis approach in tabular data?

I am working on binary classification on tabular data. The dataset is mostly made of categorical data and after fitting the data to a model I found test accuracy to be low. I want to do error analysis ...
0
votes
1answer
73 views

Decision tree classifier prediction changes from one run of the model to the next

I'm running a very basic gender ['male', 'female'] classifier using the sklearn DecisionTreeClassifier based on ...
1
vote
2answers
83 views

Splitting training and test set with financial data

I am using trees algorithms (decision tree, random forest and XGBoost) to forecast the sign of the returns in the stock market (classification). I am using this article as a reference: http://...
1
vote
1answer
62 views

Multivariate time series prediction with binary target

I have an electronic component whose sensors record temperature, current and voltage values of various sub-elements. These readings are taken at regular intervals of time and I organized them as ...
1
vote
1answer
79 views

How to predict whether the client will renew the subscription or not based on given data structure

I have a requirement where I want to predict whether the client will renew the subscription or not. And the data is something like below. Basically client's subscription end date can be anything. ...
0
votes
0answers
8 views

prediction with un-obligatory features

I am pre-processing a real-world dataset with some features with missing values. these features are not mandatory - the user doesn't have to provide them. This means the values are not missing at ...
0
votes
0answers
23 views

Predicting house pricing given a dataset consisting of [ location: date of transaction: price ]

What would be the right way to tackle the problem of predicting median house pricing, given that the data I have for training consists in a big list of entries that have the following values: ...
0
votes
0answers
17 views

Modify image with machine learning

Here's my problem: I already have a little neural network that generate images using DCGAN, that was very entertaining to do but now I'd like to modify images using ML methods. Let me explain myself: ...
1
vote
1answer
509 views

XGBOOST : model.predict_proba() and model.predict() conflicting behaviour

I have two classes : 1 and 2 The output of model.predict_proba() -> [0.333,0.6667] The output of model.predict() -> 1 This is happening for around 200 test values out of the test data of 10 lac. ...
0
votes
2answers
458 views

Prediction after one hot encoding

I have a regression model that I want to make prediction based on values that I will get from an end user. In my dataset, I have one categorical variable region ...
2
votes
1answer
104 views

How to deploy ML models in production?

Have been learning Machine Learning concepts and doing hands-on past few months. Now got a bit different doubt than implementation of code. This is regarding measures to be considered while ...
0
votes
1answer
20 views

Identifying importance of each feature in deep model

I have a deep model and I want to figure out which feature has the maximum influence on predicted result. For this I train the model with all the features I think are important, during prediction I ...
0
votes
1answer
80 views

Machine Learning based Multivariate Time Series Prediction - How to create supervised data format

Q1: I have a multivariate time series dataset. For each timestep, there are 11 features and 1 output. I am going to use supervised ML to predect the output. I understand that in univariate cases, if ...
0
votes
0answers
9 views

What's the meaning of Err in Online Time Series Predicion with Missing Values

I'm reading THIS paper about online predictions on time series with missing values. And trying to code the third algorithm in C++. The thing is that I don’t understand what they mean by $Err_{\tau}...
0
votes
0answers
37 views

Given $x_1,…,x_n$, predict $y$ without being able to train on $y$

Say we have some large training data (a time series) of a few thousand rows, i.e. $$X_1=\{x_{1,1},\ldots,x_{1,n}\} \in\mathbb{R}^n, \quad y_1\in\mathbb{R}$$ $$\quad\quad \vdots$$ $$X_m=\{x_{m,1},\...
0
votes
0answers
14 views

Find possible fearure values to predict a certain outcome

I have a dataset about patients waiting times in a health district. The data is aggregated by health provider, type of medical procedure, urgency of the procedure (3 classes) and reports the n. of ...
0
votes
1answer
55 views

Include time as a variable in regression model

I am currently working on a regression problem which requires me to predict the costs of a fixed asset. I have used several variables to do so and derived a predicted cost. However, my superior has ...
2
votes
1answer
25 views

How can I get an algorithm to have an evalutation metric based on aggregate predictions?

Let's say I have a model that makes a prediction per individual. An example data set is below. Normally, evaluation metrics (for example within the XGBoost algorthim), are used at the individual ...
0
votes
1answer
34 views

LSTM get next output with Keras

So I'm learning RNN, and tried to do a prediction LSTM, but I do not understand how the output works. I have this LSTM RNN: ...
0
votes
0answers
549 views

How to fix “'The `start` argument could not be matched to a location related to the index of the data.” Error?

When I try to predict the results using ARIMA for a specific train/test split, its throwing an error like this: "'The start argument could not be matched to a ...
2
votes
1answer
70 views

Xgboost multiple class predictive performance beats one versus rest

I have an NLP task I'm tackling with xgboost (R implementation). Before describing my doubt I'll give you some background: I have a corpus of documents for which I did topic discovery, using a term ...
0
votes
0answers
9 views

Get sequential model to output probabilities with pystruct

I have implemented a sequential model using Pystruct. The model I use is BinaryCLF and as a learner the StructuredPerceptron. So far, when I test the prediction of my model, I give as an input the ...