6 votes
Accepted

Bert for QuestionAnswering input exceeds 512

The maximum input length is a limitation of the model by construction. That number defines the length of the positional embedding table, so you cannot provide a longer input, because it is not ...
noe's user avatar
  • 26.6k
4 votes

Question answering (QA) vs Chatbots

Chatbots and Q&A systems differ in their complexity as well as use cases. Let's discuss each of them separately. Chatbots: They can answer various questions asked during an interactive ...
Shubham Panchal's user avatar
3 votes
Accepted

learn information from text and resolve problem using transformers

Look at https://ai.facebook.com/blog/using-neural-networks-to-solve-advanced-mathematics-equations/ Treat to your problem like to MT task. Use transformer.
alex-uarent-alex's user avatar
3 votes

Question answering (QA) vs Chatbots

Question-answering (QA) is sometimes used to refer to the task where the input to the system is a question and a list of possible answers (normally only a handful) or a paragraph where the answer is ...
noe's user avatar
  • 26.6k
2 votes
Accepted

Select best answer from several existing ones for a question

This problem is multiple choice answering question. I can see you have already tried gensim, doc2vec etc. You can try pytorch based transformer solution. Here is the link: multiple-choice . You can ...
Sonu's user avatar
  • 106
2 votes

BERT - How Question answering is different than classification

For Question Answering, you need 2 logits : one for the start position, one for the end position. Based on these 2 logits, you have an answer span (denoted by the start/end position). In the source ...
Astariul's user avatar
  • 1,004
2 votes
Accepted

Models that are good for long answer generation given context and question and what datasets would be the best for training?

After the comment from Nicolas Martin, I found gpt2 for qa pair generation which gave reasonable steps on how to utilize Question and Answering for GPT models and then I can specify min_length and ...
Thamognya Kodi's user avatar
2 votes

Model to implement Question Answering System over structured data

One efficient way is to use the roberta base squad 2 model, using your text as context and then ask questions. It should work well and the model can be downloaded directly. ...
Nicolas Martin's user avatar
1 vote
Accepted

Which script can be used to finetune BERT for SQuAD question answering in Hugging Face library?

A recent PR changed the location of the scripts you are looking for to examples/legacy/question-answering
noe's user avatar
  • 26.6k
1 vote

Easier way to use Haystack Annotation Tool or alternative to generate SQuAD data

You can use Prodigy, an online annotation tool by the same people that created and maintains Spacy. Here you have a QA recipe and here a related support question. If you prefer open source solutions, ...
noe's user avatar
  • 26.6k
1 vote

Group unstructured chat logs into conversations

"The end goal would be to take the discussion from the beginning of time to the start of time and be able to isolate different chunks of text into a logical conversation group." I would ...
Just trying's user avatar
1 vote
Accepted

Train question answering model with custom dataset

Question-answering models require training data where you explicitly have a question and the answer to it. If you don't have such data, then you should be looking into different types of models, ...
noe's user avatar
  • 26.6k
1 vote
Accepted

How to Train Q&A model using Bert for multiple comma seperated values in a given data

If the paragraphs containing plenty comma separated values are easy to detect, I wouldn't search for a very complex algorithm: After separating each paragraph from each chapter, look for the ones ...
Nicolas Martin's user avatar
1 vote

Question answering bot: EM>F1, does it make sense?

Metrics for Q&A F1 score: Captures the precision and recall that words chosen as being part of the answer are actually part of the answer EM Score(exact match): which is the number of answers ...
Archana David's user avatar
1 vote

Question answering bot: EM>F1, does it make sense?

EM (exact match) and F1 scores are typically calculated on different levels. EM is calculated on the character level. F1 is calculated on individual word level. Almost always, EM will be lower than F1....
Brian Spiering's user avatar
1 vote

Addressing polysemy in NLP tasks

Maybe this article will help you How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings. Talks about contextual word embeddings like BERT ...
20-roso's user avatar
  • 680
1 vote

Closed Domain Question Answering which doesn't answer Questions

Question Answering model of simpletransformers takes data with is_impossible option in the training phase. Also during ...
Ilker Kurtulus's user avatar
1 vote

Answer to Question

Question answering (QA) is a complex problem and an active field of research. There are probably some academic prototypes around, but I doubt there's any general-purpose ready-to-use QA library. ...
Erwan's user avatar
  • 25.3k
1 vote

Measuring quality of answers from QnA systems

The ranking of the answers is part of the ML process, i.e. a system should be trained to rank the answers according to their relevance. Heuristic measures such as the ones mentioned in your question ...
Erwan's user avatar
  • 25.3k

Only top scored, non community-wiki answers of a minimum length are eligible