I have binary columns in my dataset (20) e.g. hot_weather, discount (y or no), where in each case 1 = yes no = 0. I am using this data on tree based methods.
It is a regression problem and my RMSE is around 1500! Running feature importance reports I get 0 for all but 2 of these binary columns which makes me think they cannot be good for my tree based model.
How else can I transform these binary columns in my data?