I am trying find commonly used techniques when dealing with high cardinality multi-valued categorical variables.
I am currently using a dataset with a feature CATEGORY which has a cardinality of ~20,000. One-hot encoding does not make sense has it would increase the feature space by too much.
Each observation in my dataset can take multiple values for the CATEGORY feature, for instance, row 1 could have the value a but row 2 could have the values a, b, c, d
I have managed to encode each individual value in the feature but am unsure how to aggregate these values for each row.
How should these encoded values be combined?