chewpakabra
  • Member for 7 years, 6 months
  • Last seen more than a month ago
Extract information from sentence
5 votes

You should use Named Entity Recognition, for example from NLTK. You can find a usage example here. It would work for your described case quite well.

View answer
Better way to break out a date?
Accepted answer
3 votes

Obvious optimisation would be converting 'Date received' to pandas datetime once, for example (if you need to retain original column): geoset['pddate_received'] = pd.to_datetime(geoset['Date received'...

View answer
Why are Chunking and IOB tags necessary?
3 votes

BIO(L) tagging is important (but as you correctly noted, not necessary) part of a NER pipeline. Main idea behind such split is to facilitate learning in following manner. Take English as an example, ...

View answer
Data Mining - Intent matching and classification of text
1 votes

The questions you have listed are more or less independent from each other. To extract location, you should be looking into the class of solutions called Named Entity Recognition. It is widely ...

View answer
How to add a new category to a deep learning model?
2 votes

Your network topology might look different, but in the very end, your pre-trained network has a layer, which handles the recognition of 10 original classes. The easiest (and working) trick to ...

View answer
What recommendation engine for a situation where users can only see a fraction of all items?
0 votes

From your description, I would suggest that you look towards methods called collaborative filtering. Basically, you could treat any view/download of a document as a positive feedback for some item and ...

View answer
Sentiment Analysis of Movie Reviews using Python
2 votes

Given that exact case, I would assume that you are getting negative decision due to names, mentioned in the review (in your training dataset actors were more often met in negative reviews). You should,...

View answer
A new comer in this field - How to start?
1 votes

I would suggest you taking a Machine Learning and Statistics (Coursera, Udacity etc.) course straight away, since you have a profound experience in programming, so mastering any library wouldn't be of ...

View answer
How to predict tf-Idf vector with Neural Network?
1 votes

I hope you do understand, that trying to predict some abstract TF-IDF vector based on read article you are trying to teach a neural network to produce a new article for a given user. It would be a ...

View answer
How does deep learning helps in detecting multiple objects in single image?
3 votes

The question itself is not quite clear, since you don't state that you have a model that can detect one car per run for an image or you are just asking what tools, algorithms or frameworks to use to ...

View answer
Ensembling vs clustering in machine learning
2 votes

As far as I understand your question, the difference between those two approaches lies in the field of limits you apply to the model. During ensemble learning, say xgboost, you will be training ...

View answer
Would like to know some Machine Learning applications for Civil Engineering
-1 votes

Machine Learning is not an answer for the question of Life, the Universe, and Everything or silver bullet but a very powerful tool which you should apply to a problem (and corresponding data). So, the ...

View answer
Extracting words belonging to a key from the text
1 votes

You have two options: Use regular expressions to extract features of interest based on your dictionary. You may have mixed results, since, for example, dual sim cards will be micro or nano, so you ...

View answer
Gathering the number of Google results from a large amount of searches.
Accepted answer
2 votes

With any search engine you will be limited by number of requests and any way of outcoming those limits will be a gray zone of violation of end user agreement (and, eventually, you will get banned for ...

View answer
Sentiment Analysis: Creating dictionary from dataset
2 votes

It is not completely clear whether your dataset has any kind of mark up (like 'comment', 'neutral', 'positive'), and, from my point of view and experience, to get a quite precise dictionary of any ...

View answer
NLP - Is Gazetteer a cheat?
Accepted answer
16 votes

Gazetteer or any other option of intentionally fixed size feature seems a very popular approach in academic papers, when you have a problem of finite size, for example NER in a fixed corpora, or POS ...

View answer
Perform classification on market basket analysis
1 votes

You are looking into s classification task where text in the left (like Student etc.) is the target class, while list of shoppings is an almost ready-to-go list of features - variables on which you ...

View answer
applying word2vec on small text files
9 votes

Word2Vec isn't a good choice for a dataset of such size. From researches I have seen, it will unleash its power if you feed at least couple of million of words, 3k tweets wouldn't be enough for a ...

View answer
Python: validating the existence of NLTK data with database search
Accepted answer
2 votes

NLTK has a built-in NER model that would extract potential Organizations from text, you can read about it here (and see examples) NLTK book (look for section "5 Named Entity Recognition"). However, ...

View answer
How to give name to topics created using LDA?
2 votes

If you don't want to dig into much NLP in that task, I suggest you to generate a set of most frequent NGrams (of lengths 2-5) from your documents and find the most distinct ngrams for each category ...

View answer
Information Extraction from Free-form text to create Transactions
3 votes

My answer is based on couple of assumptions: user input is more or less standard, so there won't be "Ex 20000" you have at least majority of forms of input covered In every representative example of ...

View answer
Is it possible to identify different queries/questions in sentence?
2 votes

The basic thing, you can do in that situation, is to split your query into N simple sentences each of which should be processed in order to receive YES/NO answer considering if the sentence is a query....

View answer