Questions tagged [language-model]
Language models are used extensively in Natural Language Processing (NLP) and are probability distributions over a sequence of words or terms.
158 questions
2
votes
0
answers
154
views
In plain English, how to descibe i/o of the TensorFlow for language modelling?
I have followed the tutorial here about language modelling using Tensorflow to create LSTM and used PTB dataset. The code is here
I failed to understnad the exact specific input and the output of the ...
- 161
1
vote
0
answers
313
views
Stanford NER Training - Assign weight to each word
I am using the Stanford NER to recognize each entity in a search text. Once I identify entities, I need to pass that entities to an algorithm which calculates score for each entity type (e.g. country, ...
- 11
4
votes
2
answers
2k
views
How does Alexa utterance parsing work?
What are the basic principles/tools necessary to make something like Alexa utterance parsing?
For reference, Alexa allows a designer to define phrases with "placeholders" that will be filled in. For ...
- 41
3
votes
1
answer
802
views
Neural Networks for Predictive typing
I don't have a background in neural networks. But, various studies has been proved that neural networks (feed forward / Recurrent) outperformed n-gram language modeling for predicting words in a ...
- 33
2
votes
0
answers
37
views
Importance of Random initialisation VS number of hidden units
A question crossed my mind not so long ago: I am doing experiments on Language Model with RNN (always with the same network topology: 50 hidden units, and 10M "directs connections" that are ...
- 157
10
votes
5
answers
19k
views
How to create a good list of stopwords
I am looking for some hints on how to curate a list of stopwords. Does someone know / can someone recommend a good method to extract stopword lists from the dataset itself for preprocessing and ...
- 333
4
votes
1
answer
1k
views
Improve CoreNLP POS tagger and NER tagger?
The CoreNLP parts of speech tagger and name entity recognition tagger are pretty good out of the box, but I'd like to improve the accuracy further so that the overall program runs better. To explain ...
- 173
10
votes
1
answer
2k
views
What is generative and discriminative model? How are they used in Natural Language Processing?
This question asks about generative vs. discriminative algorithm, but can someone give an example of the difference between these forms when applied to Natural Language Processing? How are generative ...
- 2,460