Questions tagged [natural-language-process]

Natural language processing (NLP) is a field of computer science, artificial intelligence, and linguistics concerned with the interactions between computers and human (natural) languages. As such, NLP is related to the area of human–computer interaction. Many challenges in NLP involve natural language understanding, that is, enabling computers to derive meaning from human or natural language input, and others involve natural language generation. See NLP.

Filter by
Sorted by
Tagged with
2
votes
2answers
20 views

Creating pronunciation dictionary for ASR

I am working on ASR(automatic speech recoginition) on Somali data as master thesis and now I am stuck with how to create a phonetics or pronunciation dictionary for it. I searched over net and could ...
3
votes
2answers
57 views

What are the elements in a BERT word embedding?

As far as I understand, BERT is a word embedding that can be fine-tuned or used directly. With older word embeddings (word2vec, Glove), each word was only represented once in the embedding (one ...
1
vote
1answer
166 views

Building a search tool and classifying text using NLP and ML

Im a newbie in information Retrieval. Currently Im reading a book entitled "An Introduction to Information Retreival" by Christopher D. Manning and Prabhakar Raghavan. Im trying to implement an ai ...
1
vote
1answer
66 views

What is a 'hidden state' in BERT output?

I'm trying to understand the workings and output of BERT, and I'm wondering how/why each layer of BERT has a 'hidden state'. I understand what RNN's have a 'hidden state' that gets passed to each ...
2
votes
1answer
23 views

Extracting name, date and total from a set of heterogeneous receipts

So, this is how the problem goes: I am trying to extract information from scanned receipts like this, What I have been told is that I would get the textual data from a OCR software, so in short I ...
2
votes
0answers
22 views

What could be proper terms for a research direction in natural language processing to measure meaningfulness?

For some time, I did assessments to design metrics on how to recognize well-written and meaningful software requirements. Then I decided to work with Stack Overflow question posts because they are a ...
0
votes
1answer
31 views
1
vote
0answers
23 views

The differences between BNf and JSGF in NLP?

I wonder what the differences are between the BNF(Backus-Naur Form) and JSGF(Java Speech Grammar Format)? The former is a kind of context-free grammar taught in CS224, but I learned that the JSGF is ...
0
votes
1answer
133 views

How to calculate perplexity in PyTorch?

I am wondering the calculation of perplexity of a language model which is based on ...
0
votes
2answers
173 views

Why is the decoder not a part of BERT architecture?

I can't see how BERT makes predictions without using a decoder unit, which was a part of all models before it including transformers and standard RNNs. How are output predictions made in the BERT ...
1
vote
1answer
35 views

What are x variable and y variable in word2vec model if it is supervised learning

What are x variable and y variable in word2vec model if it is supervised learning. In both the flavours- CBOW and skip-gram model. Though some blogs have explained it as unsupervised learning. ...
0
votes
1answer
42 views

What's wrong with RF/SVM with word embedding (GloVe)?

I searched many times in google for examples on word embedding (specifically GloVe) with Random forest and I couldn't find any single example. For GloVe, it was all either LSTM or CNN. Maybe there's ...
0
votes
0answers
73 views

what are the steps to train BertForMaskedLM model on custom corpus and load it again and test it on new sentences?

what are the steps to train BertForMaskedLM model on custom corpus and load it again and test it on new sentences? I followed the instructions shared in BER github page to train a language model "...
0
votes
0answers
14 views

NL2SQL, for real industrial application, what strategy to locate the exact table?

The datasets like WikiSQL is that the table corresponding to question is given. But in real industrial application, we have 100+ tables for 1 new question. Thank you!
0
votes
1answer
56 views

Are there some research papers about text-to-set generation?

I have googled but find no results. Text-to-(word)set generation or sequence-to-(token)set generation. For example, input a text and then output the tags for this text: ...
2
votes
3answers
74 views

NLP and one-class classifier building

I have a big dataset containing almost 0.5 billions of tweets. I'm doing some research about how firms are engaged in activism and so far, I have labelled tweets which can be clustered in an activism ...
1
vote
2answers
40 views

where to start in natural language processing for a language

My native language is a regional language and few people speak it. I have some assignements in a machine learning course and i was thinking about doing some natural languge processing on my native ...
1
vote
0answers
17 views

Has this method of NLP processing with neural networks been done?

Take the sentence: If you see a green light then you may cross the road. I propose a neural network which produces as output from this sentence 3 masks and a ...
2
votes
0answers
9 views

Generate Intro-Text for Newsletter

I am trying to implement the following idea. For a daily newsletter I would like to generate an engaging and funny intro text, such as: Good morning. Sorry if there are beer stains and buffalo ...
1
vote
1answer
219 views

what is BIO Tags for creating custom NER Named entity recognization?

I want to create custom NER Named entity recognition but im confused with this part of what is BIO Tags .Can any please explain the steps for creating NER anda bout this B,I,O tag .
1
vote
1answer
36 views

BERT Model Evaluation Measure in terms of Syntax Correctness and Semantic Coherence

For example I have an original sentence. The word barking corresponds to the word that is missing. ...
1
vote
1answer
19 views

Looking for a causality to effect dataset

I am looking for a causality dataset that would look like this: ...
0
votes
0answers
25 views

NL2SQL task, if we have enough data, what will the model achieve for hard SQL?

We are afraid that the hard SQL like TABLE JOIN is the limit for industrial application. Addition info: https://yale-lily.github.io/spider Thank you very much.
0
votes
0answers
5 views

How to generate alignments for word-based translation models if number of words are different in both sentences

I am working on implementing IBM Model 1. I have a parallel corpus of some 20,00,000 sentences (English to Dutch). Also, the sentences of the two docs are already aligned. Aim is to translate a Dutch ...
0
votes
0answers
33 views

Why don't we use BCE(Binary Cross Entropy) for language modeling?

I've seen a lot of RNN/Transformer models use cross entropy loss with softmax. but isn't language modeling a multilabel classification task? what happens if we replace cross entropy loss with binary ...
2
votes
1answer
25 views

How to group chat messages by topic?

I am a newbie in this field. Developer since 20 years and more but never done anything (except tutorials) with ML, DL, and NLP. Though I've already read a bunch of articles and tutorials about this ...
0
votes
0answers
14 views

Combining two structurally similar datasets from different sources

I am working with a text summarization problem, and I am trying to use this architecture [Pointer Generator]. My data set is VERY small (225 samples) compared to the CNN/ Daily Mail dataset this paper ...
0
votes
0answers
55 views

What's the size of Google's complete Conceptual Captions image captioning dataset with all the images downloaded from the listed URLs?

The original dataset provided by Google, here, consists of 'Image URL - Caption' pairs in both the provided training and validation sets. I have to work on an image captioning project and wanted to ...
8
votes
2answers
248 views

How prevalent is `C/C++` in machine learning development?

I am currently a data scientist mostly doing NLP, and I do most of my work inPython. Since I didn't get a CS degree in undergrad, I've been limited to very high ...
0
votes
2answers
46 views

Finding Criminal Name in news?

We have news URLS, which we want to classify into crimes or non-crimes and further identify criminals by using NERs. For creating a model that identifies criminals, we tried SPacy which gave all the ...
0
votes
0answers
13 views

What's the best way to store BERT training data (input IDs)

The tricky thing about the input IDs is what they're varying in length for each data sample, so regular hdf5 may not be ideal. Since Bert is so popular I am wondering if there's an established way to ...
7
votes
1answer
210 views

Why is word prediction an obsession in Natural Language Processing?

I have heard how great BERT is at masked word prediction, i.e. predicting a missing word from a sentence. In a Medium post about BERT, it says: The basic task of a language model is to predict ...
0
votes
1answer
34 views

can we learn a model to pre-process text? [closed]

I'm in a very dire situation where I have to preprocess the text but the text in the documents is very random. It is in the form of numerical points. I want to remove a certain class of points (...
0
votes
1answer
102 views

What does the dimension represent in the GloVe pre-trained word vectors?

I'm using GloVe pre-trained word vectors (glove.6b.50d.txt, glove.6b.300d.txt) to word embedding. I have a conceptual question: What is the difference between these files? On the other hand, what ...
3
votes
1answer
74 views

How to cluster n-grams?

I just wanted to know how to cluster n-grams based on their semantics. Like clustering together n-grams that are semantically similar by leveraging the distributional hypothesis suggesting that ...
0
votes
0answers
14 views

Combining decision trees and neural networks for classifying text with metadata . How to combine and train?

I have a multi-label classification problem where the input consist of free text, with metadata such as categories (from a fixed, limited set) associated with each text. The output consist of a set of ...
0
votes
0answers
17 views

Assign Topic to a document after LDA

I executed my LDA and now I have several topics with their word distributions. How do I assign each document to a topic? Is Euclidean distance a good choice? Or there are other methods? Thanks
0
votes
0answers
14 views

POS extraction using CoreNLP

I have a corpus of windows related documents, for which I need to extract nouns and verbs. However, it is required that I keep certain windows specific words such as "inline hooking", "instruction ...
2
votes
1answer
103 views

Document embedding vs locality sensitive hashing for document clustering

I would like to compare two methods: locality sensitivity hashing and document embedding to get the similarity between two documents. Both of those methods encode information of a document in a ...
1
vote
3answers
379 views

Using Google Translate API to create a Translation Dataset

Is it a good idea? ;-) Is it legal to do so? Is it legal to release such a dataset to public? Say I have a language X for which I want to create a dataset for translation to/from English, for which I ...
1
vote
1answer
18 views

Automatically categorize parts of a piece of writing

Suppose I had a piece of writing. The document contains aspects like questions, assertions, examples, and explanations. Is it possible to use Natural Language Processing to categorize each sentence of ...
0
votes
0answers
16 views

How to extract electroglottograph/laryngograph using python(specially in “librosa”)?

in a certain project of mine which is related to feature extraction from speech data, I want to extract some electroglottograph/laryngograph from speech data, I have read some research papers but ...
0
votes
0answers
65 views

Where can I get an untokenized version of GLUE's SST-2 dataset?

On the GLUE faq, they say: Similarly, for SST, the data provided is already tokenized. We're working on obtaining a version that is not tokenized. Feel free to train on other distributions of ...
0
votes
0answers
150 views

What is the State-of-the-Art open source Voice Cloning tool right now?

I would like to clone a voice as precisely as possible. Lately, impressive models have been released that only need about 10 s of voice input (cf. https://github.com/CorentinJ/Real-Time-Voice-Cloning),...
0
votes
1answer
29 views

Is it possible to create a rule-based algorithm to compute the relevance score of question-answer pair?

In information retrieval or question answering system, we use TD-IDF or BM25 to compute the similarity score of question-question pair as the baseline or coarse ranking for deep learning. In ...
2
votes
2answers
39 views

What is the easiest way to identify a gender for a noun (in french)?

I am working on an app where in order to process some data, I need to be able to identify the gender for some selected words. My data is in French. The feature I am looking for should be able to tell ...
0
votes
1answer
75 views

NMT, What if we do not pass input for decoder?

For transformer-based neural machine translation (NMT), take English-Chinese for example, we pass English for encoder and use decoder input(Chinese) attend to encoder output, then final output. What ...
2
votes
0answers
18 views

Step extraction from a paragraph

Came across an interesting problem: Given a paragraph describing how to do a process, need to break it down to various steps. Basically, need to determine for each sentence in the paragraph, if this ...
0
votes
1answer
17 views

Identifying if the sentence if it comprise information about education

Given a sentence I am trying to classify if the sentence contain information about education. For example: ...
1
vote
1answer
333 views

How to extract location related terms from raw text in python

I want to extract location related keywords from raw text in python. I have already tried spacy but the results were not good and I just got names of countries while I want fine-grained location ...