Questions tagged [text-generation]

The tag has no usage guidance, but it has a tag wiki.

Filter by
Sorted by
Tagged with
1 vote
0 answers
21 views

Guide to Natural language Prompt programming for few-shot learning of Pretrained Language Models

I'm currently working on a project with the goal of producing AI content in the space of a content generation like blog writing, Instagram caption generation etc. Found the in-context few-shot ...
user avatar
0 votes
0 answers
39 views

Using LSTM for text generation keeps generating same word

I work on a simple text generation problem using a portion of the Shakespeare dataset that I decided to use LSTM for. I primarily used this tutorial for reference. However, as I ran the below code, I ...
user avatar
  • 259
1 vote
0 answers
18 views

Does N-gram language model for text generation are more efficient than Neural Network language models?

I recently build an language model with N-gram model for text generation and for change I started exploring Neural Network for text generation. One thing I observed that the previous model results ...
user avatar
  • 11
0 votes
0 answers
8 views

How to generate syntactically correct text for CRNN-CTC text model?

Disregarding the image creation and labeling details, is there a way to generate syntactically correct text examples? As of my current understanding of the CTC model, it takes into consideration the ...
user avatar
  • 101
0 votes
1 answer
71 views

Word-level text generation with word embeddings – outputting a word vector instead of a probability distribution

I am currently researching the topic of text generation for my university project. I decided (ofc) to go with a RNN getting a sequence of tokens as input with a target of predicting the next token ...
user avatar
  • 101
0 votes
0 answers
143 views

Is is possible to make a text generator with sklearn?

So recently I made a Tensorflow model using RNN (Recurrent neural networks) and I was wondering if it was possible with sklearn too, through the usage of SVMs or Naive bayes. I searched up many ...
user avatar
  • 101
0 votes
0 answers
30 views

How effective is text generation?

I have implemented some basic models like composing a poem using the dataset of poems. But the results were not that good in general. I want to make a model that could write an essay for me. One ...
user avatar
0 votes
0 answers
15 views

Transform NL Text to DSL using NN/ML approach

Essentially I have a Corpus of a multitude of system requirements given in a natural language. An example requirement can look like this: ...
user avatar
1 vote
0 answers
28 views

Text generation with deep neural network?

For my master's project, I have to build a deep learning model for text generation: the model learns on a set of sentences, then it generates new sentences based on those from which it learned. I ...
user avatar
  • 11
2 votes
2 answers
64 views

Generation of medical institution names: training corpora?

My question is quite similar to this one: Generation of institution names. I need to be able to produce 'fake' names of medical institutions, specifically to create data for unit tests. Unfortunately, ...
user avatar
1 vote
0 answers
37 views

English to "basic English" translation

I'd like to build something (ideally in Python) that can translate an English sentence into "basic" English. Are there any free/open-source tools/frameworks that can help? If not, what kind ...
user avatar
  • 131
1 vote
0 answers
242 views

LSTM Text Generation with Pytorch

I am currently trying quote generation (character level) with LSTMs using Pytorch. I am currently facing some issues understanding exactly how the hidden state is implemented in Pytorch. Some details: ...
user avatar
1 vote
1 answer
611 views

Pytorch: understanding the purpose of each argument in the forward function of nn.TransformerDecoder

According to https://pytorch.org/docs/stable/generated/torch.nn.TransformerDecoder.html, the forward function of nn.TransformerDecoder contemplates the following arguments: tgt – the sequence to the ...
user avatar
5 votes
1 answer
2k views

Minimal working example or tutorial showing how to use Pytorch's nn.TransformerDecoder for batch text generation in training and inference modes?

I want to solve a sequence-to-sequence text generation task (e.g. question answering, language translation, etc.). For the purposes of this question, you may assume that I already have the input part ...
user avatar
1 vote
0 answers
28 views

Best way to suggest answers given historical question-answer pairs

Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia. I have access to a full chat log from the customer service of a large ...
user avatar
  • 11
1 vote
0 answers
18 views

Img to text tensorflow

I read this article: https://www.tensorflow.org/tutorials/text/image_captioning And i understand main concepts of this article. We have label and image in our dataset. We pass image to our model and ...
user avatar
1 vote
1 answer
23 views

How to handle like meaning sentences when working on text summarization

Suppose we have a text like Today is a very bad day. Very bad day is today. I wont come to play. What kind of technique should I use to summarize similar texts like ...
user avatar
0 votes
3 answers
47 views

Distinguish randomly generated texts from reasonable for human texts [closed]

I have strings short texts of 2 types: '23jd2032n0d2mn', 'fn830n30rn83', 'fhui29n4ok', 'qn4foml', ... and ...
user avatar
1 vote
1 answer
208 views

Based on transformer, how to improve the text generation results?

If I do not pretrain the text generation model like BART, how to improve the result based on transformer like tensor2tensor? What are the improvement ideas for transformer in text generation task?
user avatar
  • 561
0 votes
1 answer
17 views

Question of pretraining text-generation task, it seems that pretraining is not work for a small model?

My task is to generate keywords from sentences. I pretrain a text-generation model. I mask the sentences' tokens and predict the whole sentences' tokens. Pretraining batch_size = 8 and step = 1000000 ...
user avatar
  • 561
1 vote
2 answers
41 views

Generation of institution names

I have found a number of parsers for the automatic extraction of institution names from texts (e.g. this one). My task is in a sense the inverse one: I want to automatically generate reality-like ...
user avatar
2 votes
1 answer
58 views

Generate text using user-supplied keywords

I've got a use case where I need to generate sentences based on a set of user supplied keywords. Here is an example of what I need: User input: End-User: Data Scientists Region: Middle East ...
user avatar
0 votes
1 answer
32 views

Is it a Problem if Training Data and Evaluation Data are Very Similar?

I'm working on a group project where we have decided to use this Microsoft WIP repository as our starting point. It's a project which compares different frameworks and models and their ability to do ...
user avatar
1 vote
0 answers
11 views

Looking for suggestions on performing Sementic Analysis of ASR text

Currently I am working on a project where I have ASR on which I am performing semantic analysis to extract meaning out of it. The ASR text contains huge amount of vague conversational text which needs ...
user avatar
3 votes
2 answers
71 views

How to generate a sentence with exactly N words?

Thanks to GPT2 pretrained model now it is possible to generate meaningful sequence of words with or without prefix. However a sentence should end with a proper endings (.,!,?). I am just wondering how ...
user avatar
1 vote
0 answers
125 views

Paraphrase Generation - state-of-the-art?

I need to paraphrase short, but abstract sentences, such as: He prefers variety to routine. or I am easily discouraged. I've played around couple of online tools (such as https://quillbot.com/)...
user avatar
1 vote
0 answers
48 views

Pretrained Models for Keyword-Based Text Generation

I'm looking for an implementation that allows me to generate text based on a pre-trained model (e.g. GPT-2). An example would be gpt-2-keyword-generation (click here for demo). As the author notes, ...
user avatar
0 votes
1 answer
148 views

predicting next jobtitle

I have a dataset of which has 30M rows each like [current_jobtitles, nextjobtitles]. ...
user avatar
  • 199
4 votes
1 answer
312 views

NLP - Paraphrase extraction in Python

I am trying to develop a NLP model, which takes something like you have high levels of cholesterol(this will be a tag) as input and has to output something like <...
user avatar
2 votes
1 answer
107 views

Create an RNN on text sources with different lengths

I want to create an RNN to generate a new text based on many examples of existing texts of a certain format in the training data. The type of texts in the training data consists of 3 segments, like so:...
user avatar
0 votes
0 answers
41 views

How to build a OCR for reading text from image?

This is my first time working on a OCR application. I have lot of scanned images of English text-book pages like this and I want to build a OCR using DL to ...
user avatar
  • 327
2 votes
1 answer
41 views

Automatic data summarization with text

I would like to automate periodic report writing based on data. Given one/some data tables, the machine should output texts like ...
user avatar
  • 121
3 votes
1 answer
849 views

Choosing the size of Character Embedding for Language Generation models

I am working on a character-based Language Generator, loosely based on this tutorial on the TensorFlow 2.0 website. Following the example, I am using an Embedding() ...
user avatar
  • 5,687
0 votes
1 answer
618 views

Can BERT/ELMo be used (or retrained) to generate a text in both directions?

Text generation is perhaps one of the fun things to do with old NGram or new BERT/ELMo models. I am wondering can BERT be used to generate text from the end of a sentence, or better in both directions....
user avatar
1 vote
0 answers
2k views

Distractor Generation for Multiple Choice Questions

I'm currently working on generating distractor for multiple choice questions. Training set consists of question, answer and 3 distractor and I need to predict 3 distractor for test set. I have gone ...
user avatar
3 votes
0 answers
29 views

Back-Translation model for German and English

Do you know of any pre-trained models for back translation between German and English? I am aware that there are ways to include a monolingual corpus into the training of a machine translation model (...
user avatar
1 vote
1 answer
303 views

Is it possible to use Word2vec for text paraphrasing?

After reading several papers I am not sure if it is possible to some how generate text with the same meaning (paraphrase it) using only Word2vec. I found out other approaches that use sequences of ...
user avatar
1 vote
0 answers
129 views

Generate sentences using given data [closed]

I am working on an automated insights generation use case where I want to generate meaningful sentences from given aggregated data. For example, Data: ...
user avatar
0 votes
1 answer
1k views

Which is better: GPT or RelGAN for text generation?

Based on my understanding, gpt or gpt-2 are using language model loss to train and generate text, which do not contains GAN. So which is better: GPT vs RelGAN/LeakGAN/SeqGAN/TextGAN I am so ...
user avatar
  • 561
2 votes
0 answers
43 views

How to prepare the data for text generation task

First, I'm not sure whether the model contains the encoder during training. EOS means end-of-sentence. Encoder and decoder are part of transformer network. If without-encoder, training time: ...
user avatar
  • 561
-1 votes
1 answer
331 views

What is the difference between TextGAN and LM for text generation?

I'm new to LeakGAN or SeqGAN or TextGAN. I know GAN is to generate text and let discriminator un-judge-able to real text and gen-text. LM(language model) is the task of predicting the next word and ...
user avatar
  • 561
2 votes
1 answer
266 views

NLP text autoencoder that generates text in poetic meter

I would like to create an NLP autoencoder that happens to only generate text that conforms to a poetic meter, for example 'iambic pentameter'. That is, the output should be a series of clauses which ...
user avatar
1 vote
0 answers
17 views

Current state of art approaches in generating features based on other available features and items

I am about to do a project that is about generating texts for missing entries that are related to some object (using information about other available entries related to the same object and ...
user avatar
3 votes
2 answers
105 views

What NN architecture to predict fantasy character names based on description?

I would like to build a neural network to predict a fantasy character name given a description. Like 'Scar-faced long haired elf warrior' -> 'Glorfindel' I have a dataset of about 12,000 fantasy ...
user avatar
  • 141
1 vote
0 answers
34 views

Training an LSTM on two merged writing styles (say Shakespeare and Frost)

I was trying to develop intuitions on how two writing styles can be merged (if at all they can be merged) into a single LSTM and then get meaningful results from the same. Can anybody provide me ...
user avatar
4 votes
1 answer
260 views

Can someone please explain what this sample function is upto?

So there is a function in Dino_Name_Generator at Deeplearning.ai notebook ...
user avatar
  • 2,235
0 votes
1 answer
34 views

Which NN architecture solves my problem?

I want to convert images frame into text, for instance, if I have a image with a dog that plays with a ball I will produce a simple text "Dog plays with ball" (Ok, I know I must have x samples ...
user avatar
1 vote
0 answers
492 views

Why use GAN in NLG?

I am interested in the GAN recently. There are many papers that recently applied GAN to NLG. I do not know much about NLP or NLG, but I wonder why I use GAN for NLG. For better quality? Or for many ...
user avatar
2 votes
1 answer
1k views

Gumbel Softmax vs Vanilla Softmax for GAN training

When training a GAN for text generation, i have seen many people feeding the gumbel-softmax from the generator output and feed into the discriminator. This is to bypass the problem of having to sample ...
user avatar
  • 207
1 vote
0 answers
290 views

Neural network outputting same result for all inputs

I'm building an encoder-decoder neural network in Keras for sequence generation. The specific task is to try and change the styles of the text. Both my encoder and decoders are LSTMs with latent ...
user avatar
  • 207