Newest 'data-leakage' Questions

1

vote

1answer

19 views

Preprocessing for the final model to be deployed

Typically for a ML workflow, we import the data (X and y), split the X and ...

asked Nov 29 '21 at 10:12

spectre

1,1512 silver badges13 bronze badges

0

votes

0answers

12 views

proximity matrix of random forest and data leakage

My objective is to train a random forest classifier on a binary set of data and use the resulting proximity matrix to understand the sub-populations in the data. I have read some papers on this ...

clustering random-forest data-leakage

asked Nov 4 '21 at 19:23

neuroguy123

1214 bronze badges

0

votes

0answers

26 views

Does this make data leakage in time series? # need help for understanding time series data

Does this make data leakage in time series? I already read this, data leakage when scaling time series Data leakage is when information from outside the training dataset is used to create the model. ...

time-series data-mining rnn preprocessing data-leakage

asked Oct 4 '21 at 7:32

andy

353 bronze badges

4

votes

1answer

103 views

What can I do when my test and validation scores are good, but the submission is terrible?

This is a very broad question, I understand and I'm totally fine if someone believes it's not appropriate to do it. But it's killing me not to understand this... Here's the thing, I'm doing a machine ...

nlp overfitting pipelines data-leakage

asked Sep 27 '21 at 15:37

Yuxxxxxx

412 bronze badges

0

votes

1answer

147 views

Splitting before tfidf or after?

When should I perform preprocessing and matrix creation of text data in NLP, before or after train_test_split? Below is my sample code where I have done ...

machine-learning python nlp preprocessing data-leakage

asked Aug 21 '21 at 8:26

spectre

1,1512 silver badges13 bronze badges

0

votes

0answers

24 views

Time-Series Cross-Validation for LSTM

Is it at all possible to separate my data into train/test sets with cross validation for time series data? I am experimenting with a LSTM model. Also, I am hoping to prevent data leakage/peaking in ...

time-series predictive-modeling lstm cross-validation data-leakage

asked Aug 6 '21 at 17:03

DomIsAwesomee

32 bronze badges

3

votes

1answer

67 views

Can data leakage be sometimes acceptable?

I have recently started using kaggle and I have stumbled on a few examples of practices I would consider do be data leakage. Many of them were done by people well established on the platform and I ...

preprocessing kaggle data-imputation data-leakage

asked Jul 18 '21 at 11:53

Mateusz

1156 bronze badges

1

vote

1answer

53 views

Data Leakage when preprocessing categorical features?

I am fairly new to machine learning. I came across the concept of Data Leakage. The article says that always split the data before performing preprocessing steps. My question is, do steps such as ...

machine-learning feature-engineering data-leakage

asked May 16 '21 at 10:31

Joe

454 bronze badges

1

vote

1answer

49 views

Is there potentially data leakage during imputation for time-varying sensor data?

I have a time-varying dataset that contains some missing data. I have sensors that continuously monitor some properties at evenly-spaced intervals and I would like to impute the missing values using ...

classification time-series data-imputation data-leakage

asked Mar 10 '21 at 17:50

Evan

1454 bronze badges

0

votes

0answers

8 views

Hodrick–Prescott filter on train/test split

I have a multivariate time series $X$ which has been time-based split to $X_{train}$ and $X_{test}$. If I wanted to do standard scaling without data leak, it is possible to learn the scaling ...

time-series data-leakage

asked Mar 10 '21 at 9:16

Enk9456

654 bronze badges

2

votes

1answer

44 views

Information leakage when train/test are truly i.i.d.?

I am well aware that to avoid information leakage, it is recommended to fit any transformation (e.g., standardization or imputation based on the median value) on the training dataset and applying it ...

machine-learning data-mining statistics cross-validation data-leakage

asked Feb 4 '21 at 15:27

thereandhere1

5532 silver badges13 bronze badges

1

vote

2answers

73 views

Does binning a time series with pd.qcut (using quantiles) create data leakage?

Let's say I want to predict whether a company will default on it's debt at some point in time (so binary classification) and one of the time series variables I'm using is the "revenue" of ...

time-series pandas feature-engineering features data-leakage

asked Jan 31 '21 at 9:55

Alexandre Martin

211 bronze badge

1

vote

0answers

51 views

Data\Feature Leakage - feature too close to target?

In General: The target itself built from very correlated features, because there is no ground truth - only rule based one. I have a problem in the following method: Output: binary. built from ...

machine-learning overfitting data-leakage

asked Jan 25 '21 at 8:46

orbgr

112 bronze badges

0

votes

1answer

238 views

K-Fold cross validation and data leakage

I want to do K-Fold cross validation and also I want to do normalization or feature scaling for each fold. So let's say we have k folds. At each step we take one fold as validation set and the ...

cross-validation feature-scaling data-imputation data-leakage

asked Dec 23 '20 at 23:30

user109341

2

votes

1answer

66 views

How to split up my dataset in a train and testset, in order to prevent data leakage?

I realize that this could be considered a duplicate of this question, Is using samples from the same person in both trainset and testset considers being a data leakage?, where it is stated that "...

machine-learning class-imbalance multiclass-classification data-leakage

asked Dec 23 '20 at 23:02

JonasL

211 bronze badge

1

vote

1answer

40 views

Is it right to maintain the train distribution in test set for unbalanced data?

If the training set was unbalanced the chances are the model will be biased. But if the data distribution in the test set is the same distribution as the train set, this kind of bias is not going to ...

machine-learning training sampling data-leakage validation

asked Dec 9 '20 at 6:42

Marzi Heidari

2171 silver badge8 bronze badges

6

votes

3answers

2k views

Does label encoding an entire dataset cause data leakage?

I have a dataset on which one of the features has a lot of different categorical values. Trying to use a LabelEncoder, OrdinalEncoder or a OneHotEncoder results in an error, since when splitting the ...

machine-learning data-cleaning data-leakage

asked Jul 22 '20 at 18:50

kaylani2

657 bronze badges

2

votes

1answer

31 views

Is using samples from the same person in both trainset and testset considers being a data leakage?

Suppose a neural network is built for a binary classification problem such as recognize the face as a smiley face or not, by using a dataset of 1000 persons and each person has ten images of his face. ...

neural-network data-leakage

asked Jul 19 '20 at 22:06

AI_new2

754 bronze badges

1

vote

0answers

152 views

Will setting up time series data in this way cause data leakage?

I am trying to predict future stock market values using a gradient boosted tree model. As far as I know, gradient boosted trees use the data in one row, and only that row, to predict the target ...

time-series dataset training data-leakage

asked Jul 14 '20 at 12:49

Darcey BM

876 bronze badges

2

votes

1answer

57 views

Can I apply feature selection before splitting by requiring selection occurs > 90% of time

I want to move the feature selection step to before splitting to save time and allow bigger input dataset. If, in repeated subsamples, a feature is selected in over X percentage of cases I will keep ...

feature-selection data-leakage

asked Jun 20 '20 at 18:50

ran8

3433 silver badges8 bronze badges

1

vote

1answer

198 views

Mean encoding in times series

Considering a TS from 1-5 blocks and using 1-4 block as train data. Is it invalid to build mean encode on whole train data / or I should mean encode block 1 / block 1-2 / ... / block 1-2-3-4 ? Edit 1 :...

data-leakage

asked Jun 17 '20 at 18:16

alexandre_d

3882 silver badges12 bronze badges

1

vote

2answers

330 views

Need help understanding data leakage

I am a newbie to this stuff so I am sorry if my question is stupid~ I need help understanding what data leakage between X_train and X_test is and when exactly it happens. I am currently working on a ...

data-mining feature-scaling k-nn data-leakage

asked Jun 3 '20 at 4:28

moii789

633 bronze badges

1

vote

1answer

33 views

Normalizing dependent feature by one of the independent ones

I have a data set with three different features (x1, x2, x3) and I am going to use a regression model to predict y based on the features. x3 is the total amount of money that a customer invest and y ...

machine-learning regression feature-engineering data-leakage

asked May 26 '20 at 20:41

nimar

6201 silver badge7 bronze badges

1

vote

0answers

35 views

Identifying possible data leakage

I am building a binary classification model for imbalanced dataset using XGBoost. I tuned the hyperparameters for four different models based on 2 training datasets and 2 optimization metrics. Class ...

xgboost class-imbalance data-leakage

asked Apr 29 '20 at 19:03

thereandhere1

5532 silver badges13 bronze badges

2

votes

0answers

220 views

Data leakage in bidirectional LSTM timeseries data

Does it cause data leakage to train a bidirectional LSTM on data where a user can be a sample in the training data multiple times? Each row is a snapshot at a different point in time for a given ...

time-series lstm data-leakage

asked Mar 30 '20 at 6:40

David Feldman

1834 bronze badges

1

vote

0answers

27 views

Is data leakage in time series due to both I's of the IID principe or only one?

I am sure that the Independent part of the IID principle gives you data leakage because of the correlation. But the identical part I am not so sure. Identical in time series means that your data is ...

machine-learning deep-learning time-series data-leakage

asked Mar 26 '20 at 13:05

Tibo Geysen

633 bronze badges

4

votes

2answers

26 views

Does using user-specific accumulative variables causes data leakage?

Let's say I have a scenario in which my observational unit is a bill that was issued after a certain service was given and my goal is to predict if this bill is going to be paid or not. I have users ...

data-leakage

asked Jan 31 '20 at 11:05

Corel

1594 bronze badges

1

vote

1answer

258 views

How to keep the test data from leaking into the training process of a machine learning algorithm?

I read in many different sources that I need to split my data into a training set and a test set. Then I have to make sure that the algorithm is trained only on the training data, and do my best to ...

machine-learning training evaluation data-leakage

asked Jan 23 '20 at 13:18

Vladislav Gladkikh

9086 silver badges15 bronze badges

0

votes

2answers

1k views

Frequency/Count encoding

How do I perform frequency/count encoding for a train and test set? The implementations of this encoding I've seen simply frequency encode the categorical variables on a particular dataset (no ...

machine-learning categorical-data encoding data-leakage

asked Nov 7 '19 at 13:45

user9269433

133 bronze badges

1

vote

1answer

102 views

Will historical data lead to target leakage?

I'm bulding a employee churn model. I've employee data from 2016 to 2019 (of people who stayed/left the company), my goal is to train using data from 2016 to 2018 and predict on 2019. Since there's ...

machine-learning python predictive-modeling churn data-leakage

asked Sep 23 '19 at 8:58

lsfischer

2221 gold badge2 silver badges7 bronze badges

1

vote

2answers

98 views

Is it safe to use labels created from unsupervised model to train a supervised model using the same data?

I have a dataset where I have to detect anomalies. Now, I use a subset of the data(let's call that subset A) and apply the DBSCAN algorithm to detect anomalies on set A.Once the anomalies are detected,...

anomaly-detection dbscan data-leakage

asked Sep 17 '19 at 15:21

Indranil Bhattacharya

111 bronze badge

3

votes

2answers

179 views

Manual feature engineering based on the output

So, I'm working on a ML model that would have as potential predictors : age , a code for his city , his social status ( married / single and so on ) , number of his children and the output signed ...

machine-learning feature-selection feature-engineering correlation data-leakage

asked Mar 19 '19 at 14:08

Blenz

1,8947 silver badges27 bronze badges

3

votes

1answer

502 views

Is normalizing the validation set of time series a kind of look ahead bias?

Here's the data normalization process of a time series in a paper about stock prediction using LSTM: Split train and test set based on time (e.g. training set: 2001-2010, test set:2011-2012). This ...

time-series lstm bias data-leakage

asked Mar 9 '19 at 21:31

TQA

5062 silver badges14 bronze badges

6

votes

1answer

1k views

How to deal with possible data leakage in time series data?

I have historical consumer data who have taken out a loan at some point in time. The task is to predict if a consumer will default when requesting a loan. My issue is that for some customer in the ...

machine-learning data-leakage

asked Feb 14 '19 at 12:14

irkinosor

1936 bronze badges

1

vote

1answer

195 views

Data leakage and predictive models: should we use past predictions as a feature?

I want to develop a Random Forest Classifier model to predict whether or not a customer will convert 7 days from today. The model is re-trained once a week and makes predictions for the following week....

machine-learning time-series feature-engineering data-leakage

asked Jan 4 '19 at 0:42

Korean_Of_the_Mountain

1112 bronze badges

3

votes

2answers

195 views

Can preprocessing the whole population cause data leakage?

Introduction I understand the problem of data leakage that could be caused by the preprocessing step when our training and test sets are just samples of an unknown population. The preprocessing ...

supervised-learning preprocessing data-leakage

asked Oct 6 '18 at 12:50

boechat107

1335 bronze badges

1

vote

1answer

306 views

Dropping less frequently used categorical data?

I'm new to the datascience field and working on an assignment. I have a dataset with 150K rows with a categorical and numerical data, the target is a boolean. A categorical column consist of quite ...

pandas preprocessing categorical-data data-leakage

asked Jun 8 '18 at 18:59

dr jerry

1491 silver badge6 bronze badges

3

votes

2answers

130 views

What is the difference between data leakage and endogeneity?

I have the impression the former is used in ML whereas the latter is used in econometrics. They both carry the idea that information from the target is "leaking" in explanatory variables. Is there ...

data-leakage

asked Nov 15 '17 at 18:01

Tanguy

2302 silver badges7 bronze badges

2

votes

0answers

57 views

information leakage when using empirical Bayesian to generate a predictor

Consider the following problem: I want to predict the next bat of a set of baseball player. I have a training data set, where it contains the historical bat records (0-1 encoded, which is our target ...

classification overfitting bayesian data-leakage

asked Apr 23 '17 at 21:50

KevinKim

4951 gold badge5 silver badges13 bronze badges

2

votes

1answer

105 views

classification feature selection

I have a system which sends invitations to users to participate in online questionnaires and want to use machine learning in order to predict the likelihood of fulfilling the questionnaires in a ...

machine-learning classification data-leakage

asked Mar 6 '17 at 22:14

Shimon Golan

312 bronze badges

Questions tagged [data-leakage]

Related Tags