I was trying out various projects available for question generation on GitHub namely NQG,question-generation and a lot of others but I don't see good results form them either they have very bad question formation or the questions generated are off-topic most of the times, Where I found one project that actually generates good questions


It basically accepts a context(paragraph) and an answer to generate the question and I am trying to validate the questions generated by passing the generated question along with the paragraph to allenNLP

Answer generation for a question

And then I am trying to make sure the generated answers are correct for the questions generated with calculating the sentence embedding for both the answers(AllenNLP and PotentialAnswer) using Universal Sentence Encoder and a cosine distance to get how similar the answers match and the filtering question that has least cosine distance.

Wanted to know if this is the best approach or Is there a state of the art implementation for question generation? Please suggest

  • $\begingroup$ The way you are doing will suffice if you are going to feed it to a neural network for training. But if you want to display it to user then it may not be that appealing. What is your actual purpose? $\endgroup$ – Sandeep B Aug 3 at 18:03
  • $\begingroup$ @SandeepB my end purpose is to display it to the user. $\endgroup$ – Sundeep Pidugu Aug 6 at 7:14

It seems that state of art methods use neural encoder-decoder models [1]

[1] Neural Question Generation from Text: A Preliminary Study : https://arxiv.org/pdf/1704.01792.pdf

There is an open source implementation of the paper written with Pytorch on github : https://github.com/magic282/NQG

  • $\begingroup$ Is there any open-source implementation of the same? $\endgroup$ – Sundeep Pidugu Jul 29 at 9:14
  • $\begingroup$ Yes, I edited my post $\endgroup$ – Alexis Pister Jul 29 at 9:56
  • $\begingroup$ the results are not at all good :\ $\endgroup$ – Sundeep Pidugu Aug 2 at 9:54

Keep an eye out on https://github.com/sebastianruder/NLP-progress/blob/master/english/question_answering.md which is regularly updated, the main repository https://github.com/sebastianruder/NLP-progress also shows the state-of-the-art on other tasks

  • $\begingroup$ Thanks but I see all of them are somehow related to question-answer generation but nothing specific to question generation as such but will be watching the repo for changes. $\endgroup$ – Sundeep Pidugu Aug 6 at 7:15
  • $\begingroup$ @SundeepPidugu you could try running some of the models in reverse perhaps? Swapping the input and output, don't know if that's valid but both seem like seq2seq tasks $\endgroup$ – JoelKuiper Aug 6 at 8:30

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.