0
$\begingroup$

Basically I am trying to create a context-needing question and long answer model and I was wondering what model would be best for such tasks, currently I am leaning towards T5, or GPT-NeoX-20B. Additionally for such tasks what datasets would be the most suitable, as of right now I have looked at CoQA, and SQuAD but none provide long answers.

$\endgroup$
2
  • $\begingroup$ How many words or characters has a long answer? GPT has a function min_lenght and max_lenght when you apply model.generate(...). So basically it can have any length. $\endgroup$ Dec 28, 2022 at 15:54
  • $\begingroup$ I see, that works for me. $\endgroup$ Dec 29, 2022 at 1:37

1 Answer 1

2
$\begingroup$

After the comment from Nicolas Martin, I found gpt2 for qa pair generation which gave reasonable steps on how to utilize Question and Answering for GPT models and then I can specify min_length and max_length to create a long answer.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.