I have a dataset of about 200k rows and I'm working on a classification problem.
Grouping the dataset by a key variable, I noticed that some rows, with the same key value, have similar values in other columns (not equal). It may be useful to calculate the distance between observations and then deleting the closest ones prior to modelling?
I tried to split the dataset by key and then I calculated the euclidean distance between observations, but now I have a list of distance matrices and I don't know what to do next.
What do you think? I'm on the right way? Do you know some literature about it?