Questions tagged [data-leakage]
The data-leakage tag has no usage guidance.
1
vote
1answer
35 views
Can preprocessing the whole population cause data leakage?
Introduction
I understand the problem of data leakage that could be caused by the preprocessing step when our training and test sets are just samples of an unknown population. The preprocessing ...
1
vote
1answer
37 views
Dropping less frequently used categorical data?
I'm new to the datascience field and working on an assignment. I have a dataset with 150K rows with a categorical and numerical data, the target is a boolean. A categorical column consist of quite ...
1
vote
0answers
28 views
What is the difference between data leakage and endogeneity?
I have the impression the former is used in ML whereas the latter is used in econometrics. They both carry the idea that information from the target is "leaking" in explanatory variables.
Is there ...
2
votes
0answers
44 views
information leakage when using empirical Bayesian to generate a predictor
Consider the following problem: I want to predict the next bat of a set of baseball player. I have a training data set, where it contains the historical bat records (0-1 encoded, which is our target ...
1
vote
1answer
79 views
classification feature selection
I have a system which sends invitations to users to participate in online questionnaires and want to use machine learning in order to predict the likelihood of fulfilling the questionnaires in a ...
