From what I've read you should you use group lasso to either discard the dummy encoded variables (of the category) or use all of them. If you use normal lasso then some of the variables in the group can be discarded (set to zero) and some might not, but why is this an issue?
Let's say we have a categorical variable with 3 levels (A, B, C) and we dummy encode it to get columns A, B (C when A=B=0). Now if we, with normal lasso, only keep A, shouldn't the interpretation then be that when A=1 we get A and when it is 0 we get either B or C, where it doesn't matter that much which one (B or c) it is. What am I missing?