One of the managers at my company asked if there is a I could include a metric demonstrates that the my model is not using too many Features/Variables. Is there a metric or best practice that does this? Do you have a good way of communicating this to the business?
Specifically, she asked if I could include AIC about my models. After I asked some questions though, this is not quite what management is looking for because, unless I'm mistaken, AIC is only useful for comparing models with the same features.
In any case, I was able to use train-test validation for the model I was presenting, so AIC would have been overkill. To deal with this problem in practice I create a baseline model which uses all the variables, and then pair down as many variables as I can without sacrificing too much performance (on the train and test sets).