Questions tagged [spacy]

Industrial strength Natural Language Processing (NLP) with Python and Cython

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

SpaCy machine learning model is capturing longer entities partially. How to resolve it?

I have trained a spaCy model on my data using pre-existing en_core_web_sm-2.2.0 model. There are entities in my data which the trained model captures partially. ...
0
votes
0answers
21 views

Few questions related to data annotation in order to train Spacy NER model

I want to train Spacy NER model on custom dataset. I have some specific questions related to data annotation. I am using dataturks website to annotate pdf and word doc. If I want to label company "...
0
votes
1answer
24 views

Where does spacy, nltk, prodigy, sklearn fit in the AI project?

Where does tools like spacy, sklearn, prodigy, nltk fit in the below AI project architecture and what are some common alternatives to these:
1
vote
1answer
107 views

Spacy v2.0.1 custom NER: How to improve training of existing model

I implemented custom NER with bellow trained data first time and it gives me good prediction with Name and PrdName. I mentioned code bellow. ...
2
votes
0answers
25 views

Change the way spacy works - Custom properties for training and prediction

Spacy detects the entities using its predefined algorithm. It parses tokens in text considering position of tokens with respect to tokens surrounding it. It also takes into consideration the POS ...
0
votes
0answers
101 views

Can not install spacy package on windows 10 via pip

I have below environment. OS: Windows 10 Python: Python 3.7.4 PIP: pip 19.3.1 I am trying to install spacy in my windows 10 OS. It gives me below error. ERROR: Command errored out with exit ...
2
votes
1answer
42 views

Difficulty interpreting word embedding vector similarity (spaCy)

I calculate vector similarities like this: ...
5
votes
1answer
35 views

Chunking Sentences with Spacy

I have a lot of sentences (500k) which looks like this: ...
0
votes
2answers
45 views

How to obtain the word vectors optimally

I have a list of strings as shown sent_list = ["Carrefour is in France", "Apple pie is delicious", "Amazon has just delivered", ...] My code to get word ...
0
votes
1answer
57 views

NLP techniques to label unlabeled data in a dataset [closed]

So I have a .xls file with negative and neutral reviews of a medicine. However, this dataset does not have labels. I converted this .xls into a dataframe and I am using the Spacy Lib. I have to use ...
0
votes
1answer
132 views

Custom POS tags with SpaCy for NER

Quite new to NLP and especially NER. I'm trying to train a NER model on a custom dataset. This is a dataset of houses for sale. As part of the entities I'm training the model to extract are reference ...
0
votes
0answers
21 views

What's the actual model inside the blackbox of spacy predefined models

I currently use Spacy to do my nlp tasks and really like their pre-trained models (the one that can be loaded with nlp = spacy.load('en_core_web_sm') which enable ...
0
votes
0answers
15 views

How to identify occupations in the OSHA data file?

My dataset is from the injury and illness recording, osha, dataset which looks something like this: So the second column contains the title for ...
0
votes
1answer
94 views

Will the performance of my NER model improve?

I am training a spacy model from scratch by creating a dataset of my own with format spacy needs it to be in, the model is an NER model and the entity i am trying to recognize is Food items. I have ...
2
votes
1answer
110 views

Spacy word embeddings for sentence

Spacy offers pre-trained vectors for words. However I have notices that you can get vectors for sentences too: spacy_nlp('hello I').has_vector == True However I ...
0
votes
0answers
27 views

Load pretrained embedding model on TF-Hub to calculate Word Mover's Distance (WMD) on Gensim or spaCy

I'd like to calculate Word Mover's Distance with Universal Sentence Encoder on TensorFlow Hub embedding. I have tried the example on spaCy for WMD-relax, which loads 'en' model from spaCy, but I ...
2
votes
1answer
814 views

Is there any way to define custom entities in Spacy

1) I have just started working on NLP the basic Idea is to extract meaningful information from text. For this I am using "Spacy". As far as I have studied Spacy has following entities. ORG PERSON ...
0
votes
0answers
256 views

Sentiment Analysis of News Headlines

I'm trying to do sentiment analysis of News Headlines about a particular subject mentioned in it. Initially, I used TextBlob library for sentiment analysis to ...
0
votes
1answer
27 views

Getting Value Error while training a model for binary classification

While training a sequential model using Keras, Im getting this error The model summary is shown below ...
0
votes
1answer
210 views

Spacy Text classification (Binary Classification)

I have a dataset of two folders. One of them contains the documents(text, pdfs) related to personal information (like name,email,address etc), the other contains non-personal information. I have to ...
0
votes
0answers
546 views

Facing this issue while predicting “CountVectorizer - Vocabulary wasn't fitted”

#these are classifier and vectorizer vectorizer = CountVectorizer(tokenizer = spacy_tokenizer, ngram_range=(1,1)) classifier = LinearSVC() I have created a ...
3
votes
1answer
2k views

How to train a spacy model for text classification?

Can i know the way or steps to train a spacy model for text classification. (binary classification in my case) Please help me with the process and way to approach.
2
votes
1answer
212 views

SpaCy vs AllenNLP?

I have used a little of both spaCy and allenNLP in my NLP projects. I like them both as they work very well with PyTorch (my DL framework choice!). But, I still cannot decide which one to master in a ...
1
vote
1answer
393 views

How to replace words in a sentence with their POS tag generated with SpaCy efficiently?

How is it possible to replace words in a sentence with their respective PoS tags generated with SpaCy in an efficient way?