Questions tagged [natural-language-process]

Natural language processing (NLP) is a field of computer science, artificial intelligence, and linguistics concerned with the interactions between computers and human (natural) languages. As such, NLP is related to the area of human–computer interaction. Many challenges in NLP involve natural language understanding, that is, enabling computers to derive meaning from human or natural language input, and others involve natural language generation. See NLP.

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Question about Relative-Position-Representation code

In https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/layers/common_attention.py In _relative_attention_inner method, which I think is one of the ...
2
votes
2answers
44 views

Evaluating Language Model on specific topic

I have finetuned a pretrained Language Model(GPT-2) on a custom dataset of mine. I would like a way of evaluating the ability of my model to generate sentences of a specific predefined topic, given in ...
0
votes
1answer
30 views

Ordering of standardization, pca, and/or tfidf for neural network

I have 60k rows of text data. I have tokenized it into 55k columns. I am using a neural network to classify the data but have some questions about how to order my preprocessing steps. I have too much ...
1
vote
0answers
16 views

How to process list type questions in Question Answering task [closed]

How to generate question-answer-context triplets for questions with multiple answer strings? How to measure performance for it? For a question with one single answer, we generate one question-answer-...
2
votes
1answer
35 views

What's the best way to detect bible verse mentions in a text?

I have a set of 10 verses from the Bible in English. I want to detect the occurrence of any of these verses in a text. What would be the best way to go about doing this? Note that verses of the Bible ...
1
vote
0answers
27 views

Question about BERT embeddings with high cosine similarity

Under what circumstances would BERT assign two occurrences of the same word similar embeddings? If those occurrences are contained within similar syntactic relations with their co-occurrents?
0
votes
0answers
12 views

Trying to use CBOW for tweet classification

I'm trying to use the Continuous Bag Of Words method for word embedding on a corpus of 7503 tweets. In particular, I'm trying to use CBOW on this Kaggle competition, which involves classifying tweets ...
-2
votes
1answer
26 views

I want to start studying the field of machine translation [closed]

I've studied Japanese language and literature and passed some linguistic courses and now as for my masters, I want to study natural language processing and especially machine translation. so I tried ...
0
votes
1answer
28 views

How to handle Tokenized text content which is given in number?

i have one data set of customer review, but the text data is given is tokenized text number. I am unable to proceed thinking about how to proceed? As I am encountering such data set the first time, so ...
0
votes
1answer
21 views

Is it possible to classify documents of corpus using labels?

I have a corpus of 23000 documents that need to be classified into 5 different categories. I do not have any labeled data available to me, just freeform text documents and labels(yes, one-word labels, ...
3
votes
2answers
92 views

How is the Gaussian noise given to this BLSTM based GAN?

In a conditional GAN, we give a random noise along with a label to the generator as input. In this paper, I don't understand why in one section of the paper, they say they are giving the random noise ...
2
votes
1answer
21 views

Word representation that gives more weight to terms frequent in corpus?

The tf-idf discounts the words that appear in a lot of documents in the corpus. I am constructing an anomaly detection text classification algorithm that is trained only on valid documents. Later I ...
1
vote
1answer
19 views

State-of-the-art Python packages that can evaluate language similarity

I am trying to evaluate the likelihood of generating a specific sentence out of a large set of sentences. To do this, I start from a simple approach: training a custom n-gram language model and ...
2
votes
3answers
70 views

NLP SBert (Bert) for answer comparison STS

I've been researching a good way to automate short answer evaluation. Essentially a teacher gives a test with some questions like: Question: why did columbus sail westward to find asia? Answer: so he ...
0
votes
0answers
17 views

dump particular function in keras

I'm Unable to dump particular function in keras. (encoder_model, inf_model, translate). Attached code below. ...
0
votes
1answer
28 views

Is adding the embedded words of a sentence to represent the sentence a good approach?

I have a dataset of sentences in a non english language like : word1 word2 word3 word62 word5 word1 word2 Now i want to turn each variable length sentence to a fixed size vector to give it to my ...
1
vote
1answer
33 views

Based on transformer, how to improve the text generation results?

If I do not pretrain the text generation model like BART, how to improve the result based on transformer like tensor2tensor? What are the improvement ideas for transformer in text generation task?
0
votes
0answers
20 views

Are there any deep models that are better than BERT-CRF in NER task?

Named entity recognition (NER) is task that mark tags of the input text sequence. BERT-CRF is a good NER model. I want to find a better NER model. Or I want to improve the BERT-CRF model. What can I ...
0
votes
1answer
27 views

best approach to embed random length sequences of words as a fixed size vector without having a maximum length? [closed]

I have a dataset of sentences in a non-English language like: word1 word2 word3 word62 word5 word1 word2 and the length of each sentence is not fixed. Now, I want to represent each sentence as a ...
0
votes
1answer
26 views

Using BERT for co-reference resolving, what's the loss function?

I'm working my way around using BERT for co-reference resolving. I'm following this highly-cited paper BERT for Coreference Resolution: Baselines and Analysis (https://arxiv.org/pdf/1908.09091.pdf). I ...
2
votes
2answers
36 views

Should I keep common stop-words when preprocessing for word embedding?

If I want to construct a word embedding by predicting a target word given context words, is it better to remove stop words or keep them? the quick brown fox jumped over the lazy dog or quick brown ...
0
votes
0answers
28 views

How to insert sentences into training data which has 2 words, 3 words 4 and 5 etc into training data?

I have a set of sentences which each contain 2 words, 3 words, 4 words, 5 words etc. When I am trying to give the training data only the first two words in a sentence it is not accepting it. It is ...
0
votes
1answer
42 views

Prediction using words which were not in training in a CNN with pre-trained word embeddings

In sentence classification using pre-trained embeddings(fasttext) in a CNN, how does the CNN predict the category of a sentence when the words were not in the training set? I think the trained model ...
0
votes
1answer
24 views

I tried loading my saved .h5 model and predicting with that model, i'm getting error list index out of range

I saved my keras model into .h5 format. Again I've loaded that .h5 file into my colab and tried to predict with that model. ...
0
votes
1answer
27 views

how to train custom word2vec embeddings to find related articles?

I am beginner in machine learning. My project is to make search engine based on AI which shows related articles when we search on website. For this i decided to train my own embedding. I found two ...
1
vote
0answers
21 views

Semantic networks and conceptual graphs

I would like to use semantic networks to understand changes in texts. For example when I add/remove some words within a text. ...
1
vote
1answer
32 views

How can I compare the grammatical complexity between two texts using their sentences dependency length?

This is a continuation to the following thread. I have two texts, common English texts such as news articles and informative texts versus a technical textbook. I want to compare the grammatical ...
0
votes
0answers
55 views

Does GPT-2 has pre trained for sentiment analysis?

I tried sentiment analysis with 345M model of GPT-2. But it took a long time to train. So is there any other GPT-2 model available for sentiment analysis?
1
vote
1answer
39 views

Creating a valid dataset for obtaining results

I have created a domain-specific dataset, lets say it is relating to python programming topic posts. I have taken data from various places specific to this topic to create positive examples in my ...
2
votes
1answer
207 views

Twitter POS and NER: What is state-of-the-art?

What is the current state-of-the-art for pos tagging and named entity recognition for twitter data? Are industrial-strength programs like Spacy and ...
0
votes
0answers
7 views

Is there any inductive Graph Variational Auto Encoder?

I have been reading about how we can model a Variational AutoEncoder (VAE) into a Graph Variational AutoEncoder (GVAE) where the decoder reconstructs the adjacency matrix. I presume that this approach ...
0
votes
1answer
45 views

Semantic network using word2vec

I have thousands of headlines and I would like to build a semantic network using word2vec, specifically google news file. My sentences look like ...
0
votes
0answers
8 views

Multi class product classification according to description of product

I have some products, along with their description. I wish to assign USPSC code to each product. This would require classification on 4 levels. All the examples I could find online were that of ...
0
votes
1answer
12 views

Product classification according to description

I have some products, along with their description. I wish to assign USPSC code to each product. I have a really basic doubt here. What exactly is my test file and training file? Eg. Should the ...
1
vote
0answers
16 views

How to do embedding for nested dictionary with varying size?

I'm working on an RL task in which the agent needs have some observation. Instead using images, I want to use available information of the environment as the observation. The information regarding the ...
2
votes
1answer
57 views

KeyError: Selecting text from a dataframe based on values of another dataframe

I have the following two dataframes badges and comments. I have created a list of 'gold users' from ...
0
votes
0answers
9 views

Retrieving information from 2 or more approaches

I'm trying to extract information from documents. There are two approaches currently which produces the following cases where both approaches ...
0
votes
1answer
59 views
1
vote
1answer
20 views

HMM and its competitive alternatives

In Natural language processing, what are the major applications of Hidden Markov Chain (HMM), and what are the alternatives that usually can outperform HMM, is RNN and LSTM always the choice right now?...
0
votes
1answer
29 views

How to identify similar words as input from a dictionary

Let's say I have a CSV file (single column) with a list of words as input. Meaning the file looks like below Input Terms ...
3
votes
0answers
28 views

Dataset availability for automatic text summarization

I'm working on an automatic text summarization NLP problem and looking for a dataset with USA legal case reports similar to the Australian legal case reports dataset in UCI repository. Can you please ...
0
votes
0answers
16 views

Is there a way to find difference between topics in two languages using nlp

I want to analyse queries and their differences between two different languages English and Spanish in this case. I'm aware about topic modelling. I'm in search of any corpus available or any ...
0
votes
0answers
17 views

Looking for a web based tool for natural language to PostgreSQL query for custom database

I need to build a web-based solution that will take a natural language query in English, convert it into an SQL query that I need to execute on a PostgreSQL database. I tried ln2sql/nl2sql but it only ...
1
vote
2answers
51 views

NLP: Compare tags semantically with machine learning? (finding synonyms)

Let's say I have multiple tags that I need to compare semantically. For example: ...
1
vote
2answers
69 views

Where can I get Insurance claim data for practicing NLP(Natural Language) processing?

I am looking for specifically Insurance dataset for practicing Machine Learning & NLP, but unable to find much in kaggle, udemy or other websites. Is there a way to get that dataset or any website ...
0
votes
1answer
21 views

What is syntax V and S standing for nominal subject?

I was reading the recent paper https://www.aclweb.org/anthology/P19-1580.pdf and noticed that in section 5.2, the syntactic relation is studied in terms of the "direction between two tokens". In table ...
1
vote
1answer
38 views

How to figure out if two sentences have the same meaning with AI?

I have two sentences which might be similar in meaning. Are there a useful and successful (machine learning) algorithms, which is able to determine the semantic similarity? Are there any approaches ...
2
votes
1answer
75 views

German Chatbot or conversational AI

I want to build a chatbot mostly BERT(Transformer) based in the German Language. But I do not find any German chatbot data set! So does it make sense to use google translator API to translate the ...
1
vote
2answers
60 views

Extract information using NLP and store it in csv file

I have a text file that stores the pickup, drops, and time. SMS text is a dummy file that is used to train a cab service model. The text is like in this format: ...

1
2 3 4 5