Questions tagged [prediction]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
40 views

Data Science project idea [on hold]

I want to determine the effect of rain on mortgage issuance. some idea on the way to proceed, which test, and analytic. I do have a dataset with rain inches, familly number, amount of the mortgage ...
1
vote
0answers
16 views

How to deal with similar feature values but each indicates to a different information?

If I have a feature with replicated values but each of these values indicates a different piece of information. example: feature 'street name' with value 'A' which some of these 'A's are for Boston ...
0
votes
1answer
20 views

clarification on train, test and val and how to use/implement it

So far I think I understood the differences between the training, test and validation set. Basically it is like in this image: Training set: The data where the model is trained on Validation set: ...
0
votes
1answer
15 views

Why is my prediction using ARIMA better if I'm using less historic data?

I have a data set containing hourly electricity prices for since 1.01.19 until September. Since the process turned out to be (weakly) stationary, I applied an ARIMA model in Python in order to predict ...
2
votes
1answer
21 views

Neural Network Multiple | Averging predictions

I am training multiple neural networks with various parameters. I am trying to average their predictions, but I am not really sure what that means, I am confused about what to average exactly. Here is ...
-2
votes
0answers
9 views

What are the algorithm for temporal prediction taking into account ponctual events

I would like to know what's are the main approach for events prediction. Let's say there are 10 potential events recorder over a period of 10 years. What would be the algorithm to predict those event ...
0
votes
0answers
4 views

Derive main prediction for zero-one loss function

Intuitively I can see why mode of predictions is the main prediction of a zero-one loss function, but mathematically I am not sure how it is derived? Main prediction $= argmin_{y'}E_D[L(\widehat y, y'...
0
votes
0answers
14 views

Event prediction. What method to choose

Being newbie in DS and ML, I have some troubles on choosing an adequate way of conducting data processing and modelling. I have the prepared dataset with the following structure ...
0
votes
0answers
6 views

pattern recognition tool

From what i've seen while searching google and the site this is most likely way simpler than what normally get's asked but i've not been able to find anything that could help me with it. What i'm ...
0
votes
0answers
4 views

SRGAN: How to adapt the model to the input image?

I wrote and trained my own SRGAN: so I obtained a generator’s model that takes 32x32 images as input and gives their improved 128x128 version as output… However, the end users of my Android app will ...
0
votes
1answer
12 views

How to measure/rate the effect of a exogenous covariate in a ARIMAX Model?

I have an ARIMA model, I'm trying to figure out how much an external variable (exogenous covariate) could improve the forecast, so I need to "synthesize" a rate that tell me the usefulness (or impact) ...
0
votes
0answers
10 views

Use sequential pattern mining rules to predict next window of a dataset

Suppose that I am performing Sequential Pattern Mining (maxgap = 1, i.e. rules for consecutive windows) and I ran the following code from arulesSequences in R Studio to determine significant rules ...
0
votes
1answer
17 views

Predicting complete time series for given parameter sets

Im searching for an approach that is able to predict a complete time series for a given parameter set. Imagine a robotic arm which has a starting position and a target position. There is a sensor ...
0
votes
2answers
119 views
3
votes
2answers
128 views

Is There a Way to Re-Calibrate Predicted Probabilities After Using Class Weights?

I have classification data with far more negative instances than positive instances. I have used class weights in my models and have achieved the discrimination I want but the predicted probabilities ...
0
votes
1answer
13 views

nltk measure the accuracy of the new features

Have been playing around the NLTK algorithm for some data prediction. Starting form this gib, I started my understanding process. However, there are some bits that don't make sense. If I have a set ...
0
votes
3answers
36 views

Predict the salaries of customers in 2019 from 2016 data

I have a spreadsheet of data with ages and salaries for 2016. For example, in 2016 there were 12988 customers who were 18 years old and earned 20k. I need to predict the salaries of customers for 2019....
2
votes
1answer
24 views

Predicting probability for each tag given already chosen tags

I have a set of tags (~10'000, will be extended over time) presented to a user. After he has selected 3 or more tags, I want to predict for each remaining tag what the chances are that the user will ...
1
vote
1answer
19 views

Finding the usage percent to perform predictive analysis for new users

Problem Statement- I have to find the average feature usage all the users and the usage of user X to suggest if he should use the feature. Example - On google home page out of all the user's avg 85% ...
0
votes
0answers
11 views

what are possible error analysis approach in tabular data?

I am working on binary classification on tabular data. The dataset is mostly made of categorical data and after fitting the data to a model I found test accuracy to be low. I want to do error analysis ...
0
votes
1answer
54 views

Decision tree classifier prediction changes from one run of the model to the next

I'm running a very basic gender ['male', 'female'] classifier using the sklearn DecisionTreeClassifier based on ...
1
vote
2answers
53 views

Splitting training and test set with financial data

I am using trees algorithms (decision tree, random forest and XGBoost) to forecast the sign of the returns in the stock market (classification). I am using this article as a reference: http://...
1
vote
1answer
41 views

Multivariate time series prediction with binary target

I have an electronic component whose sensors record temperature, current and voltage values of various sub-elements. These readings are taken at regular intervals of time and I organized them as ...
1
vote
1answer
75 views

How to predict whether the client will renew the subscription or not based on given data structure

I have a requirement where I want to predict whether the client will renew the subscription or not. And the data is something like below. Basically client's subscription end date can be anything. ...
0
votes
0answers
8 views

prediction with un-obligatory features

I am pre-processing a real-world dataset with some features with missing values. these features are not mandatory - the user doesn't have to provide them. This means the values are not missing at ...
0
votes
0answers
23 views

Predicting house pricing given a dataset consisting of [ location: date of transaction: price ]

What would be the right way to tackle the problem of predicting median house pricing, given that the data I have for training consists in a big list of entries that have the following values: ...
0
votes
0answers
13 views

Modify image with machine learning

Here's my problem: I already have a little neural network that generate images using DCGAN, that was very entertaining to do but now I'd like to modify images using ML methods. Let me explain myself: ...
1
vote
1answer
201 views

XGBOOST : model.predict_proba() and model.predict() conflicting behaviour

I have two classes : 1 and 2 The output of model.predict_proba() -> [0.333,0.6667] The output of model.predict() -> 1 This is happening for around 200 test values out of the test data of 10 lac. ...
0
votes
2answers
163 views

Prediction after one hot encoding

I have a regression model that I want to make prediction based on values that I will get from an end user. In my dataset, I have one categorical variable region ...
2
votes
1answer
62 views

How to deploy ML models in production?

Have been learning Machine Learning concepts and doing hands-on past few months. Now got a bit different doubt than implementation of code. This is regarding measures to be considered while ...
0
votes
1answer
18 views

Identifying importance of each feature in deep model

I have a deep model and I want to figure out which feature has the maximum influence on predicted result. For this I train the model with all the features I think are important, during prediction I ...
0
votes
1answer
51 views

Machine Learning based Multivariate Time Series Prediction - How to create supervised data format

Q1: I have a multivariate time series dataset. For each timestep, there are 11 features and 1 output. I am going to use supervised ML to predect the output. I understand that in univariate cases, if ...
0
votes
0answers
9 views

What's the meaning of Err in Online Time Series Predicion with Missing Values

I'm reading THIS paper about online predictions on time series with missing values. And trying to code the third algorithm in C++. The thing is that I don’t understand what they mean by $Err_{\tau}...
0
votes
0answers
36 views

Given $x_1,…,x_n$, predict $y$ without being able to train on $y$

Say we have some large training data (a time series) of a few thousand rows, i.e. $$X_1=\{x_{1,1},\ldots,x_{1,n}\} \in\mathbb{R}^n, \quad y_1\in\mathbb{R}$$ $$\quad\quad \vdots$$ $$X_m=\{x_{m,1},\...
0
votes
0answers
14 views

Find possible fearure values to predict a certain outcome

I have a dataset about patients waiting times in a health district. The data is aggregated by health provider, type of medical procedure, urgency of the procedure (3 classes) and reports the n. of ...
0
votes
1answer
46 views

Include time as a variable in regression model

I am currently working on a regression problem which requires me to predict the costs of a fixed asset. I have used several variables to do so and derived a predicted cost. However, my superior has ...
2
votes
1answer
23 views

How can I get an algorithm to have an evalutation metric based on aggregate predictions?

Let's say I have a model that makes a prediction per individual. An example data set is below. Normally, evaluation metrics (for example within the XGBoost algorthim), are used at the individual ...
0
votes
1answer
26 views

LSTM get next output with Keras

So I'm learning RNN, and tried to do a prediction LSTM, but I do not understand how the output works. I have this LSTM RNN: ...
0
votes
0answers
290 views

How to fix “'The `start` argument could not be matched to a location related to the index of the data.” Error?

When I try to predict the results using ARIMA for a specific train/test split, its throwing an error like this: "'The start argument could not be matched to a ...
2
votes
1answer
67 views

Xgboost multiple class predictive performance beats one versus rest

I have an NLP task I'm tackling with xgboost (R implementation). Before describing my doubt I'll give you some background: I have a corpus of documents for which I did topic discovery, using a term ...
0
votes
0answers
7 views

Get sequential model to output probabilities with pystruct

I have implemented a sequential model using Pystruct. The model I use is BinaryCLF and as a learner the StructuredPerceptron. So far, when I test the prediction of my model, I give as an input the ...
0
votes
0answers
10 views

Compare large prediction with observed values

I have test scores for a lot of schools and I created a performance index calculated using the last score of a state test. This index is supossed to predict the performance of the school in the next ...
0
votes
1answer
31 views

Predicting when component will fail having its parameters data

I have a component and I need to predict when it will wear out and will need replacement. I monitor, let's say 5 parameters of this component, each one is monitored for every run cycle. So, the ...
2
votes
2answers
58 views

Sequence prediction with unlimited predictions

I have a special kind of prediction problem. I have observed $M$ sequences $X_m = [x_1, x_2, ..., x_N]$ where the distance $d$ between $x_n$ and $x_{n+1}$ is drawn from the same normal distribution, ...
0
votes
0answers
31 views

Can anyone please guide me how to find the accuracy, presion and recall of a tensorflow objectdetection api trained model

I have trained a tensorflow object detection api model named faster-RCNN, but I am not able to find its accuracy, precision and recall on test dataset. Kindly guide me on how to find them. I have ...
0
votes
1answer
31 views

Why am a getting wrong prediction when combining two list of samples, which individually gives correct prediction?

So I am coding in Python. I have to set of samples. Set1 contains samples of class A and the other set, Set2 contains samples of class B. These samples taken are a part of the training dataset. When I ...
3
votes
0answers
41 views

Timeseries prediction error measurement. How to deal with diffrent time scales?

I have some time series and a prediction model. Now I would like to measure how good/bad the prediction is for different products. The problem is that for each product the time points (frequency of ...
0
votes
0answers
10 views

Scores of the objective function are very close to zero

For my model, I am using a square loss for the objective function. When I get the result of the prediction, the score given for each instance is very close to zero ($1*e^{-10}$). Does this mean that ...
0
votes
2answers
43 views

How can i test the performance of a model when the test data contains seen and unseen data

To test the performance of my model based on some selected features, i try to use unseen and seen data. However, when choosing the accuracy based on all data, the model is almost overfitting since ...
0
votes
0answers
39 views

Best service to host fine-tuned bert model?

I want to offer my fine-tuned bert model over the cloud. Are there any easy services to do this while only paying for usage (instead of an entire server)?