Questions tagged [spacy]
Industrial strength Natural Language Processing (NLP) with Python and Cython
78
questions
0
votes
0
answers
15
views
0
votes
0
answers
14
views
How to train a spaCy language model from scratch?
I am still quite a beginner with spaCy (although I already do enjoy it). I would like to create a language model for a language still unsupported, that is from scratch. I do have comprehensive text ...
0
votes
0
answers
14
views
AttributeError: 'English' object has no attribute 'predict
I have trained NER model from spacy version 3.2 and trying to predict with my text and below error i am facing "AttributeError: 'English' object has no attribute 'predict".
python 3.7
spacy ...
-1
votes
0
answers
15
views
Error using Spacy in NLP
I am getting this error, please can i resolve this error using the spacy library?
- 9
1
vote
0
answers
29
views
What approach I should take to extract number entity from dataset
I have the training, validation, and test dataset. The first column has store data and the second column has store numbers. I need to develop an entity extractor model which can extract store numbers ...
- 11
0
votes
0
answers
14
views
How do I upload SpaCy models to GitHub?
I am about to put my project on GitHub but the SpaCy models are too big (6GB). What is best practice for handling SpaCy models when pushing to your git?
I am very new to this and this is my first ...
- 41
1
vote
1
answer
37
views
spacy multi label classification help
I would like to create a multilabel text classification algorithm using SpaCy text multi label. I am unable to understand the following questions:
How to convert the training data to SpaCy format i....
3
votes
1
answer
59
views
Compare Books using book categories list NLP
I have a database of books. Each book has a list of categories that describe the genre/topics of the book (I use Python models).
The categories in the list most of the time are composed of 1 to 3 ...
- 131
0
votes
0
answers
13
views
Any way to make NER tagging with float(2.0) and inferencing with str(2)
One of the NER attribute is tagged with float (3.0, 2.0, ...) while the text file I am trying to inference from are in string format of (3, 2, ...).
The Spacy model I used can't pick up the numbers ...
- 1
0
votes
0
answers
17
views
In a CWI task, does POS number order matter?
In a task where we need to identify which words are considered difficult for a given sentence, one important feature is part of speech tagging. This can be done by ...
- 196
1
vote
2
answers
211
views
Train a spaCy model for semantic similarity
I'm attempting to train a spaCy model for the purposes of computing semantic similarity but I'm not getting the results I would anticipate.
I have created two text files that contain many sentences ...
- 11
0
votes
0
answers
29
views
spaCy text classification based on NER
I'm pretty new to spaCy and NLP in general, and I'm trying to figure out how to classify text. I've already gone through quite a few tutorials, and have figured out how to train my model, based on ...
- 1
0
votes
1
answer
580
views
How to extract details (educational details, exp details etc.) from a resume?
I am trying to build a resume parser which can extract details such as Name, Address, Education details (degree name, college name, university name, course duration), Experience details (designation, ...
- 177
0
votes
0
answers
87
views
Open Source Annotation Tools for spaCy's Entity Linker?
According to the Tutorial "Training a custom ENTITY LINKING model with spaCy" (20:33) this is the training data format for spaCy's Entity Linker:
...
- 11
1
vote
1
answer
137
views
How to identify/recognize that a sentence about talks about future?
Brief Introduction:
I have a report/paragraph in which there are sentences with reference to future plans/outlooks/expectations for a particular entity. I want to extract all such sentences for now.
...
- 11
1
vote
1
answer
89
views
Converting to lowercase while creating dataset for NER using spacy
I am trying to make a custom entity model for an NER application using spacy. In several NLP projects, I have converted all the data to lowercase and applied several ML techniques. For NER also should ...
- 143
3
votes
1
answer
387
views
Meaning of NER Training values using Spacy
I am trying to train custom entities using Spacy. During the training process I am getting number of values of LOSS, score etc. What is the meaning of these values
...
- 143
1
vote
1
answer
49
views
Why do we calculate the vector of a document by averaging the vectors of all the words?
I am trying to build a search engine to query a folder of documents. Tutorials online suggest that we should obtain the vector of a document by averaging the vectors of all the words, then compare ...
- 51
0
votes
0
answers
15
views
Training Spacy for NER recognition using scraped data
I am working on scraped data from different urls but all related to a musical related urls. I am trying to achieve recognition of items from scraped data. One cleaned scraped data and its entities is ...
- 143
0
votes
0
answers
18
views
Building a tagger model for a specific domain
I am trying to build a tagger model in spaCy v3.1 with .pos_ attributes for a specific domain. The code below manages to compile, however, it is not returning the <...
- 101
0
votes
1
answer
54
views
Traning New Entities in Spacy NER Model
I want to add new entities to python spacy NER module. I have few doubts regarding this.
Is it possible to remove some of the presently existing entities and add new entities to the remaining ones.
...
- 143
0
votes
0
answers
45
views
spaCy NER models (v2x) - how to deal with inflections?
I am training custom Spacy NER models (v2x). I have come across an interesting problem. There are languages that are morphologically rich. For example, in German: Nominative: der Name, Accusative: den ...
- 11
0
votes
0
answers
17
views
Adding additional classes in stanford NLP NER or Spacy
For stanford NER 3 class model, Location, Person, Organization recognizers are available. Is it possible to add additional classes to this model. For example : Sports as one class to tag sports names.
...
- 143
1
vote
0
answers
21
views
Personal Project Classifying Bank Account Data - NLP Noob [closed]
Background:
I'm looking to get up to speed with some of the newer ML classification techniques and keep my ML python fresh in my spare time/learn some new skills, so as a challenge I'm trying to see ...
- 11
1
vote
1
answer
500
views
Phone number tagging with spaCy
I have to do a BIO tagging for a given set of sentences.
For example:
...
- 48
0
votes
0
answers
149
views
Cross validation in SpaCy NER
I'm working on a custom NER model that I created with SpaCy, and for training/testing purposes I would like to use cross validation. Does SpaCy have the option to somehow perform this? If not, what ...
- 51
4
votes
1
answer
423
views
Does spaCy support multiple GPUs?
I was wondering if spaCy supports multi-GPU via mpi4py?
I am currently using spaCy's nlp.pipe for Named Entity Recognition on a high-performance-computing cluster ...
- 163
0
votes
0
answers
834
views
ValueError: GPU is not accessible. Was the library installed correctly?
I installed spacy 3 in a venv and tried to execute:
spacy.require_gpu()
Then I got this as output:
...
- 177
1
vote
0
answers
141
views
How can I retrain existing spacy v3 NER model with additional data?
I have trained Spacy v3 model on 1 million rows and want to train for additional 1 million.
...
- 231
2
votes
1
answer
28
views
Heauristics for a NER model prediction
I am trying to build and NER model that can name entities in a "Job description."
The entities are:
Mandatory skills (Must have skills like java, python, c++ etc.)
Nicetohave skills (the ...
1
vote
1
answer
48
views
How can i extract words from a single concatenated word?
I'm stuck on this problem and would love some input.
I have mulitple words such as getExtention, getPath, someWord or someword and i want to separate each concatinated words into its own words such as:...
1
vote
1
answer
83
views
NLP approaches to infer Processes from Text
I would like to use NLP techniques to infer a process out of raw text. For example, if I have a sentence like:
Recruitment is about attracting and selecting the right person for the job.
To get the ...
- 113
0
votes
0
answers
42
views
Generate UML diagrams after analyzing given text requirement using NLP
I want to generate UML diagrams (use-case,activity,sequence,class) from a given text requirement that look like this.
And I want to use python NLP library such as Spacy to identify actors, actions, ...
- 107
3
votes
2
answers
464
views
How to make the spacy 3.0 custom NER model training to optimize on precision rather than recall?
My current custom NER model is good on recall but I want to focus on improving precision, is it possible to change the optimizer metric in config file?
- 33
2
votes
0
answers
36
views
Spacy dependencymatcher pattern not returning matches
I am trying to create, add and get results from a pattern using spacy DependencyMatcher.
I created a pattern for the sentence: "From Monday to Friday"
The full pattern:
...
- 121
0
votes
1
answer
69
views
How to predict the sentiment of the entities form the tweet?
I have a JSON file (tweets.json) that contains tweets (sentences) along with the name of
the author.
Objective 1: Get the most frequent entities from the tweets.
Objective 2: Find out the sentiment/...
- 129
2
votes
1
answer
430
views
Testing Spacy NER model
I've trained an NER model with the use of Spacy, and I would like to test the accuracy on a test dataset. What would be the best way to perform this?
- 51
1
vote
1
answer
289
views
Extracting Names using NER | Spacy
I'm new to NER and I've been trying to extract names using Spacy. Here's my code:
...
- 113
3
votes
0
answers
110
views
Medical NER for French language
I'm currently exploring the options to extract medical NER specifically for French language. I tried SpaCy's general French NER but it wasn't helpful to the cause (...
- 285
1
vote
1
answer
41
views
Spacy - Ignored (essential) entities during labeling - how important is this aspect?
I'm training a custom Spacy model. Does it affect the results whether I leave entities unlabeled? For example, Germany is LOC. In one example (1) I label this. In the other example (2) I ignore it and ...
- 11
5
votes
2
answers
914
views
Converting paragraphs into sentences
I'm looking for ways to extract sentences from paragraphs of text containing different types of punctuations and all. I used SpaCy's ...
- 285
3
votes
2
answers
365
views
Is NLP suitable for my legal contract parsing problem?
My company has a product that involves the extraction of a variety of fields from legal contract PDFs. The current approach is very time consuming and messy, and I am exploring if NLP is a suitable ...
- 31
2
votes
1
answer
129
views
How to go about training a NER model to extract book citations in free-form?
I'm doing a project where I wish to create a graph visualization of free-form citations (not academic style citations) across all my e-books. E.g. David Foster Wallace's essays cite a lot of other ...
- 21
2
votes
0
answers
546
views
improve NER model accuracy with spaCy dependency tree
I have search at lot, was not able to find a solution for my problem...
I am training a NER model, that should detect two types of words: Instructions and Conditions. This is not the standard use-case ...
- 21
0
votes
1
answer
52
views
making conclusions after sentiment analysis
After performing some sentiment analysis, I have a dataset that looks like this:
For different products, using online reviews, I have obtained some values for positive/negative sentiments. However, ...
- 101
3
votes
1
answer
230
views
Smart sentence segmentation not splitting on abbreviations
Sentencer from SpaCy and NLTK does not catch the fact that typical abbreviations (e.g. Mio. for Million in German) and the ...
- 207
2
votes
1
answer
281
views
Spacy tokenizer that strips HTML/XML keeping the positions
I'm new to Spacy and infact new to Data Science. I would like to process some XML files for NER and then mark that in the original XML. I would like to know how to tokenize the XML for the NER. I ...
- 121
0
votes
1
answer
1k
views
How to serialize/pickle a spacy ner model?
I have trained a custom SpaCy named entity recognition model. I saved the model to disk using:
nlp.to_disk()
which results in keeping the model in a folder. Is it ...
- 177
2
votes
1
answer
774
views
Twitter POS and NER: What is state-of-the-art?
What is the current state-of-the-art for pos tagging and named entity recognition for twitter data? Are industrial-strength programs like Spacy and ...
- 129
2
votes
1
answer
523
views
Detect passive voice in headlines
To detect passive voice in sentences, we can use the spacy module to tag each token in the sentence, then build a classifier to classify it as passive or active based on conventional grammatical rules,...
- 121