Questions tagged [spacy]
Industrial strength Natural Language Processing (NLP) with Python and Cython
39
questions
0
votes
1answer
16 views
How to serialize/pickle a spacy ner model?
I have trained a custom spacy ner model. I saved the model to disk using
nlp.to_disk()
which results in keeping the model in a folder. Is it possible to make the ...
0
votes
0answers
12 views
how to extract specific phrases using negspacy
When I apply negspacy to my sentence, I want negspacy to consider specific phrase as a single entity and give me the output for it.
...
2
votes
1answer
152 views
Twitter POS and NER: What is state-of-the-art?
What is the current state-of-the-art for pos tagging and named entity recognition for twitter data? Are industrial-strength programs like Spacy and ...
0
votes
0answers
10 views
spacy train cli compare iterations
So I am running:
spacy train da [several] [options] [here]
And I am getting a nice overview in the console about the performance of each iteration, in terms of P, ...
2
votes
1answer
31 views
Detect passive voice in headlines
To detect passive voice in sentences, we can use the spacy module to tag each token in the sentence, then build a classifier to classify it as passive or active based on conventional grammatical rules,...
0
votes
1answer
16 views
Text Classification on a very small data set with a lot of classes
I have a data set consisting of 455 rows spread over 21 different classes. The data set is imbalanced as well as you can see below.
...
0
votes
1answer
16 views
How do you distinguish between conversational text and possible news article?
Context
When you receive messages in group chats, how do you detect if that message belongs to conversational dialogue or if it is a 'news' article (could be fake or real) that they are sharing?
...
0
votes
1answer
19 views
spaCy - Text Preprocessing - Keeping “Pronouns” in text
I am fairly new to machine learning and NLP in general. I am trying to wrap my head around how to do proper text pre-processing (cleaning the text).
I have built a custom text classification model. I ...
1
vote
1answer
29 views
organization finder in SpaCy
I am trying to find the parties between which the agreement is executed from the statement below.
AGREEMENT, dated as of January 10, 2000, is entered into by and between ABC-EFG GROUP Inc. having ...
1
vote
1answer
79 views
Address parsing using SpaCy
I am trying to parse addresses from various documents using SpaCy using NER but the results are not so accurate.
I know this is bit generic question but it would be great help if i could get ...
0
votes
1answer
24 views
SpaCy string store
I am trying to get the hash values for some English words from the string store of SpaCy.
...
0
votes
1answer
56 views
What should return doc.ents if the doc have no entities, in spacy?
I want to answer this question: "How many sentences contain named entities given a doc?"
and I have this piece of code as solution
...
0
votes
0answers
70 views
Flair Custom NER
I'm working on a problem in the domain of NER. I have a dataset wherein I need to have custom tags for different entities. I don't know how to start or even where to start. I know that there are ...
1
vote
0answers
66 views
Character-level embeddings in python
I'm working on an NLP task that requires the use of character level embeddings, and I've been trying to use Spacy. However, it seems that spacy uses word-level embeddings for the word vectors, and I ...
0
votes
0answers
9 views
SpaCy machine learning model is capturing longer entities partially. How to resolve it?
I have trained a spaCy model on my data using pre-existing en_core_web_sm-2.2.0 model. There are entities in my data which the trained model captures partially.
...
0
votes
0answers
32 views
Few questions related to data annotation in order to train Spacy NER model
I want to train a spaCy NER model on a custom dataset. I have some specific questions related to data annotation. I am using dataturks website to annotate pdfs and word documents.
If I want to label ...
0
votes
1answer
48 views
Where does spacy, nltk, prodigy, sklearn fit in the AI project?
Where does tools like spacy, sklearn, prodigy, nltk fit in the below AI project architecture and what are some common alternatives to these:
1
vote
1answer
451 views
Spacy v2.0.1 custom NER: How to improve training of existing model
I implemented custom NER with bellow trained data first time and it gives me good prediction with Name and PrdName. I mentioned code bellow.
...
2
votes
0answers
31 views
Change the way spacy works - Custom properties for training and prediction
Spacy detects the entities using its predefined algorithm. It parses tokens in text considering position of tokens with respect to tokens surrounding it. It also takes into consideration the POS ...
1
vote
1answer
416 views
Can not install spacy package on windows 10 via pip
I have below environment.
OS: Windows 10
Python: Python 3.7.4
PIP: pip 19.3.1
I am trying to install spacy in my windows 10 OS. It gives me below error.
ERROR: Command errored out with exit ...
2
votes
1answer
132 views
Difficulty interpreting word embedding vector similarity (spaCy)
I calculate vector similarities like this:
...
5
votes
2answers
46 views
0
votes
2answers
86 views
How to obtain the word vectors optimally
I have a list of strings as shown
sent_list = ["Carrefour is in France", "Apple pie is delicious", "Amazon has just delivered", ...]
My code to get word ...
0
votes
1answer
106 views
NLP techniques to label unlabeled data in a dataset [closed]
So I have a .xls file with negative and neutral reviews of a medicine. However, this dataset does not have labels. I converted this .xls into a dataframe and I am using the Spacy Lib.
I have to use ...
0
votes
1answer
248 views
Custom POS tags with SpaCy for NER
Quite new to NLP and especially NER. I'm trying to train a NER model on a custom dataset. This is a dataset of houses for sale. As part of the entities I'm training the model to extract are reference ...
0
votes
0answers
32 views
What's the actual model inside the blackbox of spacy predefined models
I currently use Spacy to do my nlp tasks and really like their pre-trained models (the one that can be loaded with nlp = spacy.load('en_core_web_sm') which enable ...
0
votes
0answers
18 views
How to identify occupations in the OSHA data file?
My dataset is from the injury and illness recording, osha, dataset which looks something like this:
So the second column contains the title for ...
0
votes
1answer
171 views
Will the performance of my NER model improve?
I am training a spacy model from scratch by creating a dataset of my own with format spacy needs it to be in, the model is an NER model and the entity i am trying to recognize is Food items. I have ...
3
votes
1answer
320 views
Spacy word embeddings for sentence
Spacy offers pre-trained vectors for words. However I have notices that you can get vectors for sentences too:
spacy_nlp('hello I').has_vector == True
However I ...
0
votes
0answers
45 views
Load pretrained embedding model on TF-Hub to calculate Word Mover's Distance (WMD) on Gensim or spaCy
I'd like to calculate Word Mover's Distance with Universal Sentence Encoder on TensorFlow Hub embedding.
I have tried the example on spaCy for WMD-relax, which loads 'en' model from spaCy, but I ...
3
votes
1answer
2k views
Is there any way to define custom entities in Spacy
1) I have just started working on NLP the basic Idea is to extract meaningful information from text. For this I am using "Spacy".
As far as I have studied Spacy has following entities.
ORG
PERSON
...
0
votes
0answers
437 views
Sentiment Analysis of News Headlines
I'm trying to do sentiment analysis of News Headlines about a particular subject mentioned in it.
Initially, I used TextBlob library for sentiment analysis to ...
0
votes
1answer
30 views
Getting Value Error while training a model for binary classification
While training a sequential model using Keras, Im getting this error
The model summary is shown below
...
0
votes
1answer
304 views
Spacy Text classification (Binary Classification)
I have a dataset of two folders. One of them contains the documents(text, pdfs) related to personal information (like name,email,address etc), the other contains non-personal information.
I have to ...
0
votes
1answer
972 views
Facing this issue while predicting “CountVectorizer - Vocabulary wasn't fitted”
#these are classifier and vectorizer
vectorizer = CountVectorizer(tokenizer = spacy_tokenizer, ngram_range=(1,1))
classifier = LinearSVC()
I have created a ...
5
votes
1answer
3k views
How to train a spacy model for text classification?
Can i know the way or steps to train a spacy model for text classification. (binary classification in my case)
Please help me with the process and way to approach.
2
votes
1answer
400 views
SpaCy vs AllenNLP?
I have used a little of both spaCy and allenNLP in my NLP projects. I like them both as they work very well with PyTorch (my DL framework choice!). But, I still cannot decide which one to master in a ...
1
vote
1answer
682 views
How to replace words in a sentence with their POS tag generated with SpaCy efficiently?
How is it possible to replace words in a sentence with their respective PoS tags generated with SpaCy in an efficient way?
2
votes
1answer
125 views
How can I extract numerical information conditional on other information?
Given text data, I'd like to extract numerical information based on the presence of other information.
For instance, "There are 119 people in the gym right now. 100 people in the weight room, 19 on ...
