What are your experiences for appropriate dataset sizes for usual text classification tasks using a finetuned BERT such as sentiment analysis?
What are your experiences?
Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field. It only takes a minute to sign up.Sign up to join this community
Sorry, but there’s no rule and amount we are able to quantify.
I’ve used it (multilingual) for 700 texts with a 20 multilabel classification and I had worse results than with a custom deep net (but with pretrained word embeddings).
But you know, in fact these questions are hard to answer. Why? Because with very low quantities of data, you can’t accurately assess the performance of a model - it is statistically insignificant.