I have 1-4 gram text data from wikipedia for 14 categories, which I am using for NE classification.
I feed named entity from sentence to lucene indexer which searches named entity from these 14 categories.
Issue I am facing is, for single entity I get multiple classes as a result with same score.
like while search
titanic, indexer gives this result
Score - 11.23 Title - titanic Category - Book
Score - 11.23 Title - titanic Category - Movie
Score - 11.23 Title - titanic Category - Product
now problem is which class to be considered?
I already tried with classifiers (NB,ME in nltk,scikit learn), but as it consider each entity from dataset as feature, it works as indexer only.