Questions tagged [natural-language-process]

Natural language processing (NLP) is a field of computer science, artificial intelligence, and linguistics concerned with the interactions between computers and human (natural) languages. As such, NLP is related to the area of human–computer interaction. Many challenges in NLP involve natural language understanding, that is, enabling computers to derive meaning from human or natural language input, and others involve natural language generation. See NLP.

Filter by
Sorted by
Tagged with
3
votes
1answer
51 views

How do I visualize data for a natural language processing project?

I am using a question-and-answer dataset. My neural network takes a question and an article content, and outputs where an answer starts (as an integer). To visualize my data, how should I process it ...
1
vote
1answer
18 views

Automatically categorize parts of a piece of writing

Suppose I had a piece of writing. The document contains aspects like questions, assertions, examples, and explanations. Is it possible to use Natural Language Processing to categorize each sentence of ...
2
votes
2answers
39 views

What is the easiest way to identify a gender for a noun (in french)?

I am working on an app where in order to process some data, I need to be able to identify the gender for some selected words. My data is in French. The feature I am looking for should be able to tell ...
3
votes
2answers
55 views

What are the elements in a BERT word embedding?

As far as I understand, BERT is a word embedding that can be fine-tuned or used directly. With older word embeddings (word2vec, Glove), each word was only represented once in the embedding (one ...
1
vote
1answer
14 views

Creating pronunciation dictionary for ASR

I am working on ASR(automatic speech recoginition) on Somali data as master thesis and now I am stuck with how to create a phonetics or pronunciation dictionary for it. I searched over net and could ...
0
votes
1answer
17 views

Identifying if the sentence if it comprise information about education

Given a sentence I am trying to classify if the sentence contain information about education. For example: ...
1
vote
1answer
164 views

Building a search tool and classifying text using NLP and ML

Im a newbie in information Retrieval. Currently Im reading a book entitled "An Introduction to Information Retreival" by Christopher D. Manning and Prabhakar Raghavan. Im trying to implement an ai ...
0
votes
2answers
143 views

How do you measure performance for word prediction tasks?

Say I have to predict the next word in a sentence, given the initial few words. Suppose the prefix is "I went to _____". This prefix is common enough that it might appear 10 times in the training ...
1
vote
1answer
35 views

What are x variable and y variable in word2vec model if it is supervised learning

What are x variable and y variable in word2vec model if it is supervised learning. In both the flavours- CBOW and skip-gram model. Though some blogs have explained it as unsupervised learning. ...
1
vote
1answer
63 views

What is a 'hidden state' in BERT output?

I'm trying to understand the workings and output of BERT, and I'm wondering how/why each layer of BERT has a 'hidden state'. I understand what RNN's have a 'hidden state' that gets passed to each ...
0
votes
1answer
95 views

*Challenge* Making an algo that learns from a book, and can answer anything about it

I recently took this challenge where I am trying to make a set of algorithms to read any particular book, understand and store the context and subsequently answer any question asked about it. In ways ...
2
votes
1answer
22 views

Extracting name, date and total from a set of heterogeneous receipts

So, this is how the problem goes: I am trying to extract information from scanned receipts like this, What I have been told is that I would get the textual data from a OCR software, so in short I ...
1
vote
1answer
47 views

Guidelines to debug REINFORCE-type algorithms?

I implemented a self-critical policy gradient (as described here), for text summarization. However, after training, the results are not as high as expected (actually lower than without RL...). I'm ...
1
vote
2answers
40 views

where to start in natural language processing for a language

My native language is a regional language and few people speak it. I have some assignements in a machine learning course and i was thinking about doing some natural languge processing on my native ...
2
votes
0answers
22 views

What could be proper terms for a research direction in natural language processing to measure meaningfulness?

For some time, I did assessments to design metrics on how to recognize well-written and meaningful software requirements. Then I decided to work with Stack Overflow question posts because they are a ...
12
votes
3answers
20k views

Natural Language to SQL query

I have been working on developing a system "Converting Natural Language to SQL Query". I have read the answers from the similar questions, but was not able to get the information that I was looking ...
0
votes
1answer
189 views

What is the difference between TextGAN and LM for text generation?

I'm new to LeakGAN or SeqGAN or TextGAN. I know GAN is to generate text and let discriminator un-judge-able to real text and gen-text. LM(language model) is the task of predicting the next word and ...
2
votes
1answer
223 views

How does BERT deal with catastrophic forgetting?

In the ULMFit paper authors propose a strategy of gradual unfreezing in order to deal with catastrophic forgetting. That is, when the model starts be fine-tuned according to a downstream task, there ...
1
vote
1answer
86 views

Question classification [closed]

I have 10 classes and 10-15 questions in each class . Given a new question, I want to find the class to which the question is most similar?
0
votes
2answers
165 views

Why is the decoder not a part of BERT architecture?

I can't see how BERT makes predictions without using a decoder unit, which was a part of all models before it including transformers and standard RNNs. How are output predictions made in the BERT ...
1
vote
0answers
22 views

The differences between BNf and JSGF in NLP?

I wonder what the differences are between the BNF(Backus-Naur Form) and JSGF(Java Speech Grammar Format)? The former is a kind of context-free grammar taught in CS224, but I learned that the JSGF is ...
0
votes
1answer
128 views

How to calculate perplexity in PyTorch?

I am wondering the calculation of perplexity of a language model which is based on ...
0
votes
1answer
106 views

counter vector fit transform cosine similarity memory error

count_matrix = count.fit_transform(off_data3['bag_of_words']) I have count_matrix shape with count_matrix.shape (476147, 482824) ...
0
votes
1answer
42 views

What's wrong with RF/SVM with word embedding (GloVe)?

I searched many times in google for examples on word embedding (specifically GloVe) with Random forest and I couldn't find any single example. For GloVe, it was all either LSTM or CNN. Maybe there's ...
3
votes
2answers
377 views

Trying to implement a “smart compose” feature

I found this post on Gmail's smart compose feature, and it got me thinking about trying to implement it myself. https://ai.googleblog.com/2018/05/smart-compose-using-neural-networks-to.html The text ...
3
votes
2answers
28 views

Pre-trained models

I am starting off with machine learning so could someone tell if there is some site where one can find the current best performing trained models for any specific problem like sentiment analysis or ...
3
votes
1answer
139 views

How do we pass data to a RNN?

Let's say we have A1, A2, ... , Am different articles in the corpus and each of them has W1, W2, ....., Ww words. We are training a language model on them. Do we: Scheme 1 Take the first batch of ...
0
votes
1answer
56 views

Are there some research papers about text-to-set generation?

I have googled but find no results. Text-to-(word)set generation or sequence-to-(token)set generation. For example, input a text and then output the tags for this text: ...
1
vote
1answer
19 views

Looking for a causality to effect dataset

I am looking for a causality dataset that would look like this: ...
0
votes
0answers
70 views

what are the steps to train BertForMaskedLM model on custom corpus and load it again and test it on new sentences?

what are the steps to train BertForMaskedLM model on custom corpus and load it again and test it on new sentences? I followed the instructions shared in BER github page to train a language model "...
4
votes
3answers
703 views

What is the best question generation state of art with nlp?

I was trying out various projects available for question generation on GitHub namely NQG,question-generation and a lot of others but I don't see good results form them either they have very bad ...
0
votes
0answers
14 views

NL2SQL, for real industrial application, what strategy to locate the exact table?

The datasets like WikiSQL is that the table corresponding to question is given. But in real industrial application, we have 100+ tables for 1 new question. Thank you!
2
votes
3answers
72 views

NLP and one-class classifier building

I have a big dataset containing almost 0.5 billions of tweets. I'm doing some research about how firms are engaged in activism and so far, I have labelled tweets which can be clustered in an activism ...
0
votes
2answers
636 views

What is the use of [SEP] in paper BERT?

I know that [CLS] means the start of a sentence and [SEP] makes BERT know the second sentence has begun. However, I have a question. If I have 2 sentences, which are s1 and s2, and our fine-tuning ...
0
votes
1answer
31 views

Identify specify areas in the text

I'd be interested in identifying various areas in the text message. Let's say I have a text containing some introduction, then there is a poem and at the end there are some urls to some web pages. I'...
1
vote
0answers
17 views

Has this method of NLP processing with neural networks been done?

Take the sentence: If you see a green light then you may cross the road. I propose a neural network which produces as output from this sentence 3 masks and a ...
1
vote
1answer
41 views

Emotional tension score in sentences

I am beginner in natural language processing and my goal is to find a way to score sentences based on their emotional tension. More specifically, I would like to know to what degree a sentence ...
2
votes
0answers
9 views

Generate Intro-Text for Newsletter

I am trying to implement the following idea. For a daily newsletter I would like to generate an engaging and funny intro text, such as: Good morning. Sorry if there are beer stains and buffalo ...
1
vote
1answer
214 views

what is BIO Tags for creating custom NER Named entity recognization?

I want to create custom NER Named entity recognition but im confused with this part of what is BIO Tags .Can any please explain the steps for creating NER anda bout this B,I,O tag .
2
votes
3answers
129 views

Which neural network to choose for classification from text/speech?

I am considering two tasks: Dialog Act Classification from Text (e.g. classify to: question; opinion; ...) Emotion Recognition from Speech (e.g. happy; calm; sad; ...) Which DL model should perform ...
1
vote
1answer
35 views

BERT Model Evaluation Measure in terms of Syntax Correctness and Semantic Coherence

For example I have an original sentence. The word barking corresponds to the word that is missing. ...
0
votes
1answer
25 views

Is there any text similarity databse available for phrases?

I want to train my application for phrase similarity. I want my model to predict similarity score for phrases as shown in below examples. ex- ...
2
votes
1answer
25 views

How to group chat messages by topic?

I am a newbie in this field. Developer since 20 years and more but never done anything (except tutorials) with ML, DL, and NLP. Though I've already read a bunch of articles and tutorials about this ...
0
votes
0answers
25 views

NL2SQL task, if we have enough data, what will the model achieve for hard SQL?

We are afraid that the hard SQL like TABLE JOIN is the limit for industrial application. Addition info: https://yale-lily.github.io/spider Thank you very much.
0
votes
0answers
5 views

How to generate alignments for word-based translation models if number of words are different in both sentences

I am working on implementing IBM Model 1. I have a parallel corpus of some 20,00,000 sentences (English to Dutch). Also, the sentences of the two docs are already aligned. Aim is to translate a Dutch ...
1
vote
1answer
142 views

Framing Sentences based on keywords

Given a few specific words, which techniques of Natural Language Processing can I use to achieve creating a meaningful sentence from those words? eg. Words: jackets, highest sale, sweaters, lowest ...
0
votes
0answers
33 views

Why don't we use BCE(Binary Cross Entropy) for language modeling?

I've seen a lot of RNN/Transformer models use cross entropy loss with softmax. but isn't language modeling a multilabel classification task? what happens if we replace cross entropy loss with binary ...
0
votes
0answers
14 views

Combining two structurally similar datasets from different sources

I am working with a text summarization problem, and I am trying to use this architecture [Pointer Generator]. My data set is VERY small (225 samples) compared to the CNN/ Daily Mail dataset this paper ...
0
votes
0answers
53 views

What's the size of Google's complete Conceptual Captions image captioning dataset with all the images downloaded from the listed URLs?

The original dataset provided by Google, here, consists of 'Image URL - Caption' pairs in both the provided training and validation sets. I have to work on an image captioning project and wanted to ...