Questions tagged [openai-gpt]
The openai-gpt tag has no usage guidance.
7
questions with no upvoted or accepted answers
3
votes
0answers
145 views
Fine tune gpt2 via huggingface API for domain specific LM
i am using the script in the examples folder to fine-tune the LM for a bot meant to deal with insurance related queries. So if someone were to type "i am looking to modify my ..." , the autocomplete ...
2
votes
0answers
165 views
Paragraph Generator using BERT or GPT
I am trying to generate similar sentences, called paragraph generation. For example, what is the name of the eldest brother of ram? - For these paragraphs can be - who is the oldest brother of ram? , ...
1
vote
0answers
39 views
How to derive Evidence Lower Bound in the paper "Zero-Shot Text-to-Image Generation"?
Can someone share the derivation of Evidence Lower Bound in this paper ?
Zero-Shot Text-to-Image Generation
The overall procedure can be viewed as maximizing the
evidence lower bound (ELB) (Kingma &...
1
vote
0answers
15 views
How to take the keywords from the given dataset to train GPT-2 based chatbot?
I am working with a dataset that contains Questions on various Events conducted by a college and the corresponding answers for the queries. I am using this dataset to train a GPT-2 355M model to ...
1
vote
0answers
37 views
Pretrained Models for Keyword-Based Text Generation
I'm looking for an implementation that allows me to generate text based on a pre-trained model (e.g. GPT-2).
An example would be gpt-2-keyword-generation (click here for demo). As the author notes, ...
0
votes
0answers
18 views
What tokenizer does OpenAI's GPT3 API use?
I'm building an application for the API, but I would like to be able to count the number of tokens my prompt will use, before I submit an API call. Currently I often submit prompts that yield a 'too-...
0
votes
0answers
13 views
How gpt 3 handle exploding gradients?
In deep neural networks, sometimes we see the problem of exploding and vanishing gradients. So how is it handled by GPT 3 which has billions of parameters?
