Questions tagged [question-answering]
The question-answering tag has no usage guidance.
28
questions
0
votes
0
answers
9
views
Approach for Question Answer from thousand of text documents
Recently I was working on natural language processing project, where task was to fetch the top-K paragraphs from thousands of text pages against user Queries.
I decided to go with following approach:
...
- 155
1
vote
0
answers
16
views
Is it possible to access "Data Science" on Stack Exchange using an API?
I am a programmer with C and Python knowledge. I am trying to "educate" or train my Chatbot with name "Stella" in "Science and Technology History" and related areas, ...
- 11
2
votes
2
answers
247
views
Group unstructured chat logs into conversations
I am new to ML/AI/NLP and am interested in tackling the following problem. I have a database of chat logs from a Discord server. The database contains the following labeled data: ...
- 21
0
votes
1
answer
496
views
Train question answering model with custom dataset
How can I train a question-answering ML model with a custom dataset?
I have gathered nearly 110GB of text data, containing documentation manuals for software products and I am looking into different ...
- 113
0
votes
1
answer
66
views
How to Train Q&A model using Bert for multiple comma seperated values in a given data
I'm using the entire text book data by scraping the information of each chapter.
How do I highlight the spacy spancat NER or Bert Q&A based models to train multiple comma separated values in the ...
- 53
0
votes
1
answer
55
views
Models that are good for long answer generation given context and question and what datasets would be the best for training?
Basically I am trying to create a context-needing question and long answer model and I was wondering what model would be best for such tasks, currently I am leaning towards T5, or GPT-NeoX-20B. ...
0
votes
0
answers
12
views
Should I standardise my domain specific text prior to annotation/creation of a Q&A dataset?
I'm going to create my own question and answer dataset to fine-tune a BERT model, however before starting I am trying to understand if any standardisation of the text needs to be performed.
The data I ...
- 1
0
votes
0
answers
20
views
Is it possible for computers to tell how many people are speaking in a audio recording
Suppose I had a audio recording of 15 students saying "Here" all at the same. Can I tell how many students were speaking and who they were using machine learning?
I want to create a school ...
- 101
1
vote
1
answer
245
views
Model to implement Question Answering System over structured data
I need to write a program(like a chatbot) that retrieves an answer from a CSV datafile based on a question user asks. So for example if the CSV stores list of products and its specifications in 5-10 ...
1
vote
0
answers
60
views
global contrast normalization implementation
I'm trying to understand figure 12.1 in Goodfellow available here. I'm not able to reproduce figure 12.1, and I'm wondering what is it I'm missing. The denominator of equation 12.3 is a constant, and ...
- 113
0
votes
2
answers
668
views
Question answering bot: EM>F1, does it make sense?
I am fine-tuning a Question Answering bot starting from a pre-trained model from HuggingFace repo.
The dataset I am using for the fine-tuning has a lot of empty answers. So, after the fine tuning, ...
- 53
1
vote
1
answer
38
views
Pretrained models for Propositional logic
Are there any pretrained models which understand propositional logic?
For example, the t5 model can do question-answering. Given a context such as "Alice is Bob's mother. Bob is Charlie's father&...
- 113
0
votes
1
answer
193
views
Addressing polysemy in NLP tasks
Looking for modern algorithms using NN Language Model implementations addressing polysemy in NLP tasks, including text classification, question answering and topic modeling. Transfer/Zero-short ...
- 295
0
votes
1
answer
50
views
learn information from text and resolve problem using transformers
Let's imagine that we have some question, like this: "x multiplied by x equals 9. What is x?"
For this easy question answer is +-3. I want to make AI model answer on questions like that.
To ...
- 131
1
vote
0
answers
55
views
Best way to suggest answers given historical question-answer pairs
Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia.
I have access to a full chat log from the customer service of a large ...
- 11
0
votes
1
answer
186
views
Which script can be used to finetune BERT for SQuAD question answering in Hugging Face library?
I have gone through lot of blogs which talk about run_squad.py script from Hugging Face, but I could not find it in the latest repo. So, which script has to be used ...
- 113
0
votes
1
answer
252
views
How to pass input to deep learning models for Multiple choice question answering problem?
I'm currently working on a multiple-choice question answering system. The training set consists of a question, answer and 4 options and I need to predict the correct answer among 4 options. Sometimes ...
- 415
1
vote
0
answers
28
views
How to process list type questions in Question Answering task [closed]
How to generate question-answer-context triplets for questions with multiple answer strings? How to measure performance for it?
For a question with one single answer, we generate one question-answer-...
- 11
4
votes
1
answer
923
views
Bert for QuestionAnswering input exceeds 512
I'm training Bert on question answering (in Spanish) and i have a large context, only the context exceeds 512, the total question + context is 10k, i found that longformer is bert like for long ...
- 242
0
votes
1
answer
260
views
Closed Domain Question Answering which doesn't answer Questions
I've been exploring Closed Domain Question Answering Implementations which have been trained on SQuAD 2.0 dataset. Ideally, it should not answer questions which the context text corpus doesn't contain ...
- 152
1
vote
1
answer
51
views
Select best answer from several existing ones for a question
After analyzing questions on a forum, a human support team has created a set of general answers, that can be used to provide basic answers on the forum.
I am trying to build a system that:
Selects ...
- 295
1
vote
0
answers
68
views
Options to find the most similar question in a dataset of question-answer pairs?
I am building a chatbot that will only handle FAQs, but these FAQs are very specific to an organisation, so I cannot use any existing off-the-shelf solutions, or connect to question-answering APIs.
I ...
- 189
6
votes
2
answers
3k
views
Question answering (QA) vs Chatbots
Are Question answering (QA) the same as Chatbots? I can not understand the difference between them.
For me it's the same thing: interact with a robot that answers questions.
- 161
1
vote
0
answers
224
views
Meaningful Information retrieval and question answering for unstructured data - Is it even possible?
Hello good NLP people,
I am working on a task that gradually seems not solvable for me. My data-set consists of long, messy, unstructured documents (pdfs, doc, docx, scans with tables, graphs, text, ...
- 111
4
votes
1
answer
89
views
Answer to Question
Looking for a system which can generate answers to questions. Most systems and blogs posted on internet are on Question to answer but not on answer to question or paraphrasing or keyword to questions.
...
- 884
1
vote
1
answer
83
views
Measuring quality of answers from QnA systems
I am having a question answering system which is using Seq2Seq kind of architecture. Actually it is a transformer architecture. When a question is asked it gives startposition and endposition of ...
- 884
0
votes
1
answer
1k
views
BERT - How Question answering is different than classification
Basically I am trying to understand how question answering works in case of BERT. Code for both classes QuestionAnswering and Classification is pasted below for reference. My understanding is:
<...
- 884
0
votes
1
answer
113
views
Is it possible to create a rule-based algorithm to compute the relevance score of question-answer pair?
In information retrieval or question answering system, we use TD-IDF or BM25 to compute the similarity score of question-question pair as the baseline or coarse ranking for deep learning.
In ...
- 661