2
$\begingroup$

Most word embeddings do not "see" antonyms. For instance, among many words they will place vectors for "dependent" and "independent" (as an example) quite close, - actually as close as with synonyms such as "independent" and "autonomous". So it is easy to identify synonyms as close vectors, but how to identify antonyms, or generally work with antonyms? There are some few rare papers that try to develop embedding algorithms "aware" of antonyms (just web-search word-embedding antonyms). But I am working with standard very powerful and already trained on massive data embedding libraries. Is there a workaround to somehow work with STANDARD embeddings but to make them not "blind" to antonyms? Thanks!

$\endgroup$
0
$\begingroup$

You could probably use the technique to combine vectors with antonyms with some kind of weights. Below thread suggests adding POS tagger with word2vec vectors, instead of POS you can concatenate antonyms:

https://stats.stackexchange.com/questions/238016/deep-learning-word-embedding-with-parts-of-speech

https://stackoverflow.com/questions/51537441/how-to-combine-both-word-embeddings-and-pos-embedding-together-to-build-the-clas

You can identify Antonyms using below:

https://www.geeksforgeeks.org/get-synonymsantonyms-nltk-wordnet-python/

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.