which of these orders is correct?
First (Feature Selection) Second (Outlier Detection)
First (Outlier Detection) Second (Feature Selection)
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.Sign up to join this community
In majority of the cases feature selection should be done after outlier detection. Outlier detection should be done at the initial stage of data pre-processing while feature extraction / selection can be don in the last part of data pre-processing.
Outlier must be detected beforehand so that actual behavior o that particular predictor is known. Then depending upon the behavior after removal of outlier it can be decided whether to keep that as feature or not.
Many feature selection algorithms like PCA, regression, etc are sensitive to outliers and so if such algorithms are used to extract the features then it would be better to remove the outliers beforehand.