# How to use embedding to reduce features for a regression problem

I’m working on a regression problem in which I’d like to predict demand of different items. I have used holidays as a feature in my model, in a hot encoded format, i.e. I have 11 binary features each representing one holiday.

I’d like to reduce the size of my features and thinking to used embedding on the holiday features to represent them in lower dimensions.

I’m new to embedding. My question whether it make sense or not and if it does any hints on how to do it?

Now, embeddings only make sense if they represent a feature of dimensionality $$D$$ with embeddings of dimensionality between 1 and $$D-1$$. So in your case, I don't know how much you will benefit from the dimensionality reduction itself. You may experience benefits of replacing sparse with dense features, but this needs to be empirically tested.