1
$\begingroup$

For English language there are libraries like NLTK, CoreNLP which are used for Text Normalization, Word Tokenization and Detokenization, Sentence Splitting etc. Like English, is there any library to do above operation using Hindi Script ?

$\endgroup$
1
$\begingroup$

There is an Indic NLP library developed by iitB for Hindi texts. you can check out the below links

https://www.cse.iitb.ac.in/~anoopk/pages/softwares.html

https://github.com/anoopkunchukuttan/indic_nlp_library

| improve this answer | |
$\endgroup$
0
$\begingroup$

There're few pretrained embedders i.e. LASER, which covers Hindi as well.

If you want to achieve seminal-like scores, I wouldn't bother doing this all by hand, and take on full data-driven approach.

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.