I am working on a classification problem and I found my data having a lot of outliers which has resulted in reduction in my recognition rate. I have tried rescaling, normalization techniques like min max, box cox and even log transformation. I am considering of eliminating outliers from box plots but I am afraid I might be eliminating useful features/data required to define the model.
Are there any suggestion on how to deal with such cases. Also further analysis of data revealed that my data constitutes of features belong to dfferent process like web application, apps. I segregated the data based on the processes and I do see that large variation of process resulted in different accuracy ranging from 60-95%
Any tips on how to deal with such cases? In the end I want my classifier to classify irrespective of the process type. So with my current issue, does this imply that my features defined are not good enough or is there something else I can do?