Questions tagged [text-generation]

The tag has no usage guidance, but it has a tag wiki.

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

How to generate syntactically correct text for CRNN-CTC text model?

Disregarding the image creation and labeling details, is there a way to generate syntactically correct text examples? As of my current understanding of the CTC model, it takes into consideration the ...
0
votes
0answers
7 views

Word-level text generation with word embeddings – outputting a word vector instead of a probability distribution

I am currently researching the topic of text generation for my university project. I decided (ofc) to go with a RNN getting a sequence of tokens as input with a target of predicting the next token ...
0
votes
0answers
50 views

Is is possible to make a text generator with sklearn?

So recently I made a Tensorflow model using RNN (Recurrent neural networks) and I was wondering if it was possible with sklearn too, through the usage of SVMs or Naive bayes. I searched up many ...
0
votes
0answers
26 views

How effective is text generation?

I have implemented some basic models like composing a poem using the dataset of poems. But the results were not that good in general. I want to make a model that could write an essay for me. One ...
0
votes
0answers
13 views

Transform NL Text to DSL using NN/ML approach

Essentially I have a Corpus of a multitude of system requirements given in a natural language. An example requirement can look like this: ...
1
vote
0answers
18 views

Text generation with deep neural network?

For my master's project, I have to build a deep learning model for text generation: the model learns on a set of sentences, then it generates new sentences based on those from which it learned. I ...
2
votes
2answers
64 views

Generation of medical institution names: training corpora?

My question is quite similar to this one: Generation of institution names. I need to be able to produce 'fake' names of medical institutions, specifically to create data for unit tests. Unfortunately, ...
1
vote
0answers
33 views

English to "basic English" translation

I'd like to build something (ideally in Python) that can translate an English sentence into "basic" English. Are there any free/open-source tools/frameworks that can help? If not, what kind ...
0
votes
0answers
13 views

Architecture and feature extraction for keyword suggestion system?

I encountered a use case for a model that takes the title of a product from a marketplace and outputs keywords most frequently encountered in the product's description. For example, if the product ...
1
vote
0answers
41 views

LSTM Text Generation with Pytorch

I am currently trying quote generation (character level) with LSTMs using Pytorch. I am currently facing some issues understanding exactly how the hidden state is implemented in Pytorch. Some details: ...
0
votes
1answer
355 views

Pytorch: understanding the purpose of each argument in the forward function of nn.TransformerDecoder

According to https://pytorch.org/docs/stable/generated/torch.nn.TransformerDecoder.html, the forward function of nn.TransformerDecoder contemplates the following arguments: tgt – the sequence to the ...
3
votes
1answer
619 views

Minimal working example or tutorial showing how to use Pytorch's nn.TransformerDecoder for batch text generation in training and inference modes?

I want to solve a sequence-to-sequence text generation task (e.g. question answering, language translation, etc.). For the purposes of this question, you may assume that I already have the input part ...
1
vote
0answers
25 views

Best way to suggest answers given historical question-answer pairs

Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia. I have access to a full chat log from the customer service of a large ...
1
vote
0answers
16 views

Img to text tensorflow

I read this article: https://www.tensorflow.org/tutorials/text/image_captioning And i understand main concepts of this article. We have label and image in our dataset. We pass image to our model and ...
1
vote
1answer
20 views

How to handle like meaning sentences when working on text summarization

Suppose we have a text like Today is a very bad day. Very bad day is today. I wont come to play. What kind of technique should I use to summarize similar texts like ...
0
votes
3answers
42 views

Distinguish randomly generated texts from reasonable for human texts [closed]

I have strings short texts of 2 types: '23jd2032n0d2mn', 'fn830n30rn83', 'fhui29n4ok', 'qn4foml', ... and ...
1
vote
1answer
184 views

Based on transformer, how to improve the text generation results?

If I do not pretrain the text generation model like BART, how to improve the result based on transformer like tensor2tensor? What are the improvement ideas for transformer in text generation task?
0
votes
1answer
17 views

Question of pretraining text-generation task, it seems that pretraining is not work for a small model?

My task is to generate keywords from sentences. I pretrain a text-generation model. I mask the sentences' tokens and predict the whole sentences' tokens. Pretraining batch_size = 8 and step = 1000000 ...
1
vote
2answers
37 views

Generation of institution names

I have found a number of parsers for the automatic extraction of institution names from texts (e.g. this one). My task is in a sense the inverse one: I want to automatically generate reality-like ...
2
votes
1answer
54 views

Generate text using user-supplied keywords

I've got a use case where I need to generate sentences based on a set of user supplied keywords. Here is an example of what I need: User input: End-User: Data Scientists Region: Middle East ...
0
votes
1answer
31 views

Is it a Problem if Training Data and Evaluation Data are Very Similar?

I'm working on a group project where we have decided to use this Microsoft WIP repository as our starting point. It's a project which compares different frameworks and models and their ability to do ...
1
vote
0answers
10 views

Looking for suggestions on performing Sementic Analysis of ASR text

Currently I am working on a project where I have ASR on which I am performing semantic analysis to extract meaning out of it. The ASR text contains huge amount of vague conversational text which needs ...
3
votes
2answers
58 views

How to generate a sentence with exactly N words?

Thanks to GPT2 pretrained model now it is possible to generate meaningful sequence of words with or without prefix. However a sentence should end with a proper endings (.,!,?). I am just wondering how ...
1
vote
0answers
112 views

Paraphrase Generation - state-of-the-art?

I need to paraphrase short, but abstract sentences, such as: He prefers variety to routine. or I am easily discouraged. I've played around couple of online tools (such as https://quillbot.com/)...
1
vote
0answers
40 views

Pretrained Models for Keyword-Based Text Generation

I'm looking for an implementation that allows me to generate text based on a pre-trained model (e.g. GPT-2). An example would be gpt-2-keyword-generation (click here for demo). As the author notes, ...
0
votes
1answer
105 views

predicting next jobtitle

I have a dataset of which has 30M rows each like [current_jobtitles, nextjobtitles]. ...
4
votes
1answer
268 views

NLP - Paraphrase extraction in Python

I am trying to develop a NLP model, which takes something like you have high levels of cholesterol(this will be a tag) as input and has to output something like <...
2
votes
1answer
77 views

Create an RNN on text sources with different lengths

I want to create an RNN to generate a new text based on many examples of existing texts of a certain format in the training data. The type of texts in the training data consists of 3 segments, like so:...
0
votes
0answers
41 views

How to build a OCR for reading text from image?

This is my first time working on a OCR application. I have lot of scanned images of English text-book pages like this and I want to build a OCR using DL to ...
2
votes
1answer
37 views

Automatic data summarization with text

I would like to automate periodic report writing based on data. Given one/some data tables, the machine should output texts like ...
3
votes
1answer
732 views

Choosing the size of Character Embedding for Language Generation models

I am working on a character-based Language Generator, loosely based on this tutorial on the TensorFlow 2.0 website. Following the example, I am using an Embedding() ...
0
votes
1answer
560 views

Can BERT/ELMo be used (or retrained) to generate a text in both directions?

Text generation is perhaps one of the fun things to do with old NGram or new BERT/ELMo models. I am wondering can BERT be used to generate text from the end of a sentence, or better in both directions....
1
vote
0answers
2k views

Distractor Generation for Multiple Choice Questions

I'm currently working on generating distractor for multiple choice questions. Training set consists of question, answer and 3 distractor and I need to predict 3 distractor for test set. I have gone ...
3
votes
0answers
27 views

Back-Translation model for German and English

Do you know of any pre-trained models for back translation between German and English? I am aware that there are ways to include a monolingual corpus into the training of a machine translation model (...
1
vote
1answer
281 views

Is it possible to use Word2vec for text paraphrasing?

After reading several papers I am not sure if it is possible to some how generate text with the same meaning (paraphrase it) using only Word2vec. I found out other approaches that use sequences of ...
1
vote
0answers
118 views

Generate sentences using given data [closed]

I am working on an automated insights generation use case where I want to generate meaningful sentences from given aggregated data. For example, Data: ...
0
votes
1answer
972 views

Which is better: GPT or RelGAN for text generation?

Based on my understanding, gpt or gpt-2 are using language model loss to train and generate text, which do not contains GAN. So which is better: GPT vs RelGAN/LeakGAN/SeqGAN/TextGAN I am so ...
2
votes
0answers
41 views

How to prepare the data for text generation task

First, I'm not sure whether the model contains the encoder during training. EOS means end-of-sentence. Encoder and decoder are part of transformer network. If without-encoder, training time: ...
-1
votes
1answer
301 views

What is the difference between TextGAN and LM for text generation?

I'm new to LeakGAN or SeqGAN or TextGAN. I know GAN is to generate text and let discriminator un-judge-able to real text and gen-text. LM(language model) is the task of predicting the next word and ...
2
votes
1answer
252 views

NLP text autoencoder that generates text in poetic meter

I would like to create an NLP autoencoder that happens to only generate text that conforms to a poetic meter, for example 'iambic pentameter'. That is, the output should be a series of clauses which ...
1
vote
0answers
17 views

Current state of art approaches in generating features based on other available features and items

I am about to do a project that is about generating texts for missing entries that are related to some object (using information about other available entries related to the same object and ...
3
votes
2answers
96 views

What NN architecture to predict fantasy character names based on description?

I would like to build a neural network to predict a fantasy character name given a description. Like 'Scar-faced long haired elf warrior' -> 'Glorfindel' I have a dataset of about 12,000 fantasy ...
1
vote
0answers
34 views

Training an LSTM on two merged writing styles (say Shakespeare and Frost)

I was trying to develop intuitions on how two writing styles can be merged (if at all they can be merged) into a single LSTM and then get meaningful results from the same. Can anybody provide me ...
4
votes
1answer
254 views

Can someone please explain what this sample function is upto?

So there is a function in Dino_Name_Generator at Deeplearning.ai notebook ...
0
votes
1answer
34 views

Which NN architecture solves my problem?

I want to convert images frame into text, for instance, if I have a image with a dog that plays with a ball I will produce a simple text "Dog plays with ball" (Ok, I know I must have x samples ...
1
vote
0answers
483 views

Why use GAN in NLG?

I am interested in the GAN recently. There are many papers that recently applied GAN to NLG. I do not know much about NLP or NLG, but I wonder why I use GAN for NLG. For better quality? Or for many ...
2
votes
1answer
1k views

Gumbel Softmax vs Vanilla Softmax for GAN training

When training a GAN for text generation, i have seen many people feeding the gumbel-softmax from the generator output and feed into the discriminator. This is to bypass the problem of having to sample ...
1
vote
0answers
289 views

Neural network outputting same result for all inputs

I'm building an encoder-decoder neural network in Keras for sequence generation. The specific task is to try and change the styles of the text. Both my encoder and decoders are LSTMs with latent ...
1
vote
2answers
155 views

How should I format input and output for text generation with LSTMs

I'm attempting to generate a response to an input line of text using an LSTM. I've considered various forms of input, including one-hot encoding each character in the line and passing each input line ...
3
votes
1answer
229 views

Choosing a right algorithm for template-based text generation

I am doing a text generation project -- the task is to basically represent the statistical data in a readable way. The way I decided to go about this is template-based: each data type has a template ...