2

Note that I don't know nmslib and I'm not familiar with search optimization in general. However I know Okapi BM25 weighting. How do they both (bm25, nmslib) differ? These are two completely different things: Okapi BM25 is a weighting scheme which has a better theoretical basis than the well known TFIDF weighting scheme. Both methods are intended to score ...


1

Try using the spacy-transformers for NER. You can even Fine-Tune it as per the project requirements. Refer to this link: https://towardsdatascience.com/how-to-fine-tune-bert-transformer-with-spacy-3-6a90bfe57647


1

There's some confusion about different kinds of output and their corresponding evaluation: One can consider the top N results as predicted positive, any result lower than N as predicted negative. In this option one can use binary classification evaluation measure: precision, recall, f1-score would be the standard measures in this case. One can consider the ...


1

I want to know how to come up with ground truth(relevancy label) if it's not available? There's simply no way to properly evaluate a system if nobody knows what the output is supposed to be. However there are ways to work around a lack of annotated data: Ask a panel of annotators to grade the quality of the output on a sample. Disadvantage: if a relevant ...


Only top voted, non community-wiki answers of a minimum length are eligible