Questions tagged [data-leakage]
The data-leakage tag has no usage guidance.
0
votes
0answers
13 views
Data leakage and predictive models: should we use past predictions as a feature?
I want to develop a Random Forest Classifier model to predict whether or not a customer will convert 7 days from today. The model is re-trained once a week and makes predictions for the following week....
1
vote
2answers
53 views
Can preprocessing the whole population cause data leakage?
Introduction
I understand the problem of data leakage that could be caused by the preprocessing step when our training and test sets are just samples of an unknown population. The preprocessing ...
1
vote
1answer
47 views
Dropping less frequently used categorical data?
I'm new to the datascience field and working on an assignment. I have a dataset with 150K rows with a categorical and numerical data, the target is a boolean. A categorical column consist of quite ...
1
vote
0answers
30 views
What is the difference between data leakage and endogeneity?
I have the impression the former is used in ML whereas the latter is used in econometrics. They both carry the idea that information from the target is "leaking" in explanatory variables.
Is there ...
2
votes
0answers
48 views
information leakage when using empirical Bayesian to generate a predictor
Consider the following problem: I want to predict the next bat of a set of baseball player. I have a training data set, where it contains the historical bat records (0-1 encoded, which is our target ...
1
vote
1answer
84 views
classification feature selection
I have a system which sends invitations to users to participate in online questionnaires and want to use machine learning in order to predict the likelihood of fulfilling the questionnaires in a ...
