6
votes
How to handle missing value if imputation doesnt make sense
You could consider setting years_married to -1, then it is different from columns for the ones that are just married and could thus be understood by a decision tree....
- 126
6
votes
How to handle missing value if imputation doesnt make sense
I think this is a good solution. You could also try to set a unique negative value for non-married people, especially if you are using a tree-based model.
- 449
3
votes
How to handle missing value if imputation doesnt make sense
Your approach of a binary categorical feature, is_married definitely sounds good.
In some of my projects, I have checked for the percentage of missing values in a column. For instance, if a certain ...
- 131
3
votes
What to do if your model's prediciton result wrong because of unlucky?
All models are wrong, some are useful. The most useful ones are the ones constructed by people who understand the probabilities of things happening, even "black swan" events (things everyone ...
- 1,972
2
votes
What techniques are used to analyze data drift?
It depends about what type of data are we talking: tabular, image, text...
This is part of my PhD, so I am completely biased, I will suggest Explanation Shift. (I would love some feedback). It works ...
- 5,776
1
vote
Accepted
1
vote
What techniques are used to analyze data drift?
One way to start is fundamental exploratory data analysis.
Compare univariate, bivariate, and multivariate distributions between training data and new data. Those comparisons can be done visually, ...
- 19.4k
1
vote
How to forecast a timeseries with geolocation data?
You are correct there are many ways to model that data, in particular predicting future latitude and longitude coordinates. It sounds like you want to model the geospatial data probabilistically.
One ...
- 19.4k
1
vote
Accepted
How to forecast a timeseries with geolocation data?
I see multiple possibilities, here:
In General
Some general remarks first:
When designing you model, you should take reoccurring patterns into account: There will probably be a 24h pattern (for ...
- 523
1
vote
How to handle missing value if imputation doesnt make sense
If the variable is categorical and not ordered, it may make sense to create a new category 'not_married' to represent the missing values. This would allow you to keep the information about marital ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
data-science-model × 650machine-learning × 322
python × 138
deep-learning × 75
machine-learning-model × 59
predictive-modeling × 45
statistics × 45
data × 45
scikit-learn × 39
regression × 39
data-mining × 38
classification × 37
neural-network × 35
dataset × 35
time-series × 32
tensorflow × 29
nlp × 28
data-analysis × 22
keras × 21
pandas × 20
model-selection × 19
logistic-regression × 18
feature-engineering × 18
feature-selection × 17
decision-trees × 17