Timeline for How would I approach training a model and encoding this categorical data
Current License: CC BY-SA 4.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Nov 19, 2020 at 12:03 | vote | accept | SirAchesis | ||
| Nov 18, 2020 at 17:58 | comment | added | Taylrl | I don't know of any other way but make sure you are using sparse matrices. Also, take a look at tfidf which weights things based on how often they occur. | |
| Nov 18, 2020 at 6:18 | comment | added | SirAchesis |
Yeah, I was hoping there would be a way to avoid this. Since I've got more than 50k unique words that I've assigned the value to, creating a new feature for each word makes the DataFrame really big and slow to run through. Also side question; is there a way (or even a benefit) to keep count of how many times a certain word shows up in the review. One could assume that a review that has the word bad five times is lower than one that mentions it once.
|
|
| Nov 17, 2020 at 16:35 | history | answered | Taylrl | CC BY-SA 4.0 |