Most problems have a curve whereby the results improve as data are added but level off at some point.

Are there research papers or industry results that discuss the correlation between data set size and prediction accuracy for natural language identification?


1 Answer 1


LIDE: Language Identification from Text Documents benchmarked the difference between using character and word n-gram information for natural language identification.

Word-length algorithm for language identification of under-resourced languages proposed new algorithms for languages with limited available data.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.