Questions tagged [question-answering]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
51 views

Easier way to use Haystack Annotation Tool or alternative to generate SQuAD data

I want to annotate some passages in the SQuAD format. After some research, I found that the Haystack Annotation Tool by deepset.ai is the best option for this purpose. Most of the old tutorials ...
Israt Afrin's user avatar
0 votes
1 answer
48 views

Getting a free and unknown answer to a question against a fine-tuned text generation model trained on many essays and their few questions and answers

Aim I want to fine-tune a text generation model with essays of changing size and then ask each of these input texts a few questions. I already have a wider range of question-answer pairs at hand for ...
questionto42's user avatar
0 votes
0 answers
55 views

How to find proper context in open book question answering?

I want to make an Open Book Question Answering / Retrieval Augmented Generation system. The major concern here is the proper context selection. There are some fundamental issues related to this. For ...
hafiz031's user avatar
  • 121
0 votes
0 answers
27 views

F1 and Exact-Match (EM) Score in Extractive QA NLP

I have a question as to how the F1 should be calculated in NLP and whether the text normalization is optional or not. So I have been working on a project where we created a closed-domain extractive QA ...
tt40kiwi's user avatar
  • 101
2 votes
0 answers
149 views

How does fine-tuning work in question answering for custom documents

I am trying to build a Q&A bot for which I have a bunch of documents like articles (specific domain). I understand I can create a Retrieval-Augmented Generation (RAG) system for this, but I want to ...
Glinty's user avatar
  • 33
0 votes
0 answers
13 views

Approach for Question Answer from thousand of text documents

Recently I was working on natural language processing project, where task was to fetch the top-K paragraphs from thousands of text pages against user Queries. I decided to go with following approach: ...
Vinay Sharma's user avatar
1 vote
0 answers
18 views

Is it possible to access "Data Science" on Stack Exchange using an API?

I am a programmer with C and Python knowledge. I am trying to "educate" or train my Chatbot with name "Stella" in "Science and Technology History" and related areas, ...
user545577's user avatar
2 votes
2 answers
509 views

Group unstructured chat logs into conversations

I am new to ML/AI/NLP and am interested in tackling the following problem. I have a database of chat logs from a Discord server. The database contains the following labeled data: ...
imaginative's user avatar
0 votes
1 answer
1k views

Train question answering model with custom dataset

How can I train a question-answering ML model with a custom dataset? I have gathered nearly 110GB of text data, containing documentation manuals for software products and I am looking into different ...
lynx's user avatar
  • 113
0 votes
1 answer
87 views

How to Train Q&A model using Bert for multiple comma seperated values in a given data

I'm using the entire text book data by scraping the information of each chapter. How do I highlight the spacy spancat NER or Bert Q&A based models to train multiple comma separated values in the ...
jason's user avatar
  • 53
0 votes
1 answer
94 views

Models that are good for long answer generation given context and question and what datasets would be the best for training?

Basically I am trying to create a context-needing question and long answer model and I was wondering what model would be best for such tasks, currently I am leaning towards T5, or GPT-NeoX-20B. ...
Thamognya Kodi's user avatar
0 votes
0 answers
36 views

Is it possible for computers to tell how many people are speaking in a audio recording

Suppose I had a audio recording of 15 students saying "Here" all at the same. Can I tell how many students were speaking and who they were using machine learning? I want to create a school ...
Mustafa's user avatar
  • 101
1 vote
1 answer
349 views

Model to implement Question Answering System over structured data

I need to write a program(like a chatbot) that retrieves an answer from a CSV datafile based on a question user asks. So for example if the CSV stores list of products and its specifications in 5-10 ...
aninfgroupoid's user avatar
1 vote
0 answers
71 views

global contrast normalization implementation

I'm trying to understand figure 12.1 in Goodfellow available here. I'm not able to reproduce figure 12.1, and I'm wondering what is it I'm missing. The denominator of equation 12.3 is a constant, and ...
NNN's user avatar
  • 113
0 votes
2 answers
1k views

Question answering bot: EM>F1, does it make sense?

I am fine-tuning a Question Answering bot starting from a pre-trained model from HuggingFace repo. The dataset I am using for the fine-tuning has a lot of empty answers. So, after the fine tuning, ...
SilentCloud's user avatar
1 vote
1 answer
45 views

Pretrained models for Propositional logic

Are there any pretrained models which understand propositional logic? For example, the t5 model can do question-answering. Given a context such as "Alice is Bob's mother. Bob is Charlie's father&...
androidguy's user avatar
0 votes
1 answer
219 views

Addressing polysemy in NLP tasks

Looking for modern algorithms using NN Language Model implementations addressing polysemy in NLP tasks, including text classification, question answering and topic modeling. Transfer/Zero-short ...
dokondr's user avatar
  • 295
0 votes
1 answer
50 views

learn information from text and resolve problem using transformers

Let's imagine that we have some question, like this: "x multiplied by x equals 9. What is x?" For this easy question answer is +-3. I want to make AI model answer on questions like that. To ...
Nikto's user avatar
  • 131
1 vote
0 answers
62 views

Best way to suggest answers given historical question-answer pairs

Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia. I have access to a full chat log from the customer service of a large ...
Joep's user avatar
  • 11
0 votes
1 answer
202 views

Which script can be used to finetune BERT for SQuAD question answering in Hugging Face library?

I have gone through lot of blogs which talk about run_squad.py script from Hugging Face, but I could not find it in the latest repo. So, which script has to be used ...
user2478236's user avatar
0 votes
1 answer
366 views

How to pass input to deep learning models for Multiple choice question answering problem?

I'm currently working on a multiple-choice question answering system. The training set consists of a question, answer and 4 options and I need to predict the correct answer among 4 options. Sometimes ...
Aaditya ura's user avatar
1 vote
0 answers
29 views

How to process list type questions in Question Answering task [closed]

How to generate question-answer-context triplets for questions with multiple answer strings? How to measure performance for it? For a question with one single answer, we generate one question-answer-...
Qian's user avatar
  • 11
4 votes
1 answer
1k views

Bert for QuestionAnswering input exceeds 512

I'm training Bert on question answering (in Spanish) and i have a large context, only the context exceeds 512, the total question + context is 10k, i found that longformer is bert like for long ...
Simone's user avatar
  • 242
0 votes
1 answer
270 views

Closed Domain Question Answering which doesn't answer Questions

I've been exploring Closed Domain Question Answering Implementations which have been trained on SQuAD 2.0 dataset. Ideally, it should not answer questions which the context text corpus doesn't contain ...
Anirban Saha's user avatar
1 vote
1 answer
59 views

Select best answer from several existing ones for a question

After analyzing questions on a forum, a human support team has created a set of general answers, that can be used to provide basic answers on the forum. I am trying to build a system that: Selects ...
dokondr's user avatar
  • 295
1 vote
0 answers
82 views

Options to find the most similar question in a dataset of question-answer pairs?

I am building a chatbot that will only handle FAQs, but these FAQs are very specific to an organisation, so I cannot use any existing off-the-shelf solutions, or connect to question-answering APIs. I ...
KOB's user avatar
  • 189
6 votes
2 answers
4k views

Question answering (QA) vs Chatbots

Are Question answering (QA) the same as Chatbots? I can not understand the difference between them. For me it's the same thing: interact with a robot that answers questions.
ladybug's user avatar
  • 161
1 vote
0 answers
232 views

Meaningful Information retrieval and question answering for unstructured data - Is it even possible?

Hello good NLP people, I am working on a task that gradually seems not solvable for me. My data-set consists of long, messy, unstructured documents (pdfs, doc, docx, scans with tables, graphs, text, ...
XsLiar's user avatar
  • 111
4 votes
1 answer
94 views

Answer to Question

Looking for a system which can generate answers to questions. Most systems and blogs posted on internet are on Question to answer but not on answer to question or paraphrasing or keyword to questions. ...
Sandeep Bhutani's user avatar
1 vote
1 answer
93 views

Measuring quality of answers from QnA systems

I am having a question answering system which is using Seq2Seq kind of architecture. Actually it is a transformer architecture. When a question is asked it gives startposition and endposition of ...
Sandeep Bhutani's user avatar
0 votes
1 answer
1k views

BERT - How Question answering is different than classification

Basically I am trying to understand how question answering works in case of BERT. Code for both classes QuestionAnswering and Classification is pasted below for reference. My understanding is: <...
Sandeep Bhutani's user avatar
0 votes
1 answer
130 views

Is it possible to create a rule-based algorithm to compute the relevance score of question-answer pair?

In information retrieval or question answering system, we use TD-IDF or BM25 to compute the similarity score of question-question pair as the baseline or coarse ranking for deep learning. In ...
惊天补扣's user avatar