Skip to main content

Questions tagged [chatgpt]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
16 views

Best way to achieve High throughput with ChatGPT (and LLMs in general) APIs

I was wondering what the best way is to perform API calls to ChatGPT, and in general, with LLMs API providers, to achieve the highest throughput in a batch inference context. Suppose you have 1000 ...
Raffaele 's user avatar
0 votes
0 answers
23 views

Image Generation Models

I am looking for a list of different image generation models and how I can test them? For example: DALL-E (accessible via ChatGPT4) Stable Diffusion (open source) CLIP? - but idk how to access/test it....
x89's user avatar
  • 191
0 votes
1 answer
22 views

Searching ChatGPT transcripts?

Maybe I just don't understand the functionality of the web version. Using GPT4 here. When I do technical queries (usually TensorFlow applications) I use similar prompts until I get the understanding I ...
PracticalKat's user avatar
0 votes
0 answers
11 views

Is this how you would go about this NLP Project?

What do you think of these steps? And where can I find help with this project? I am in a business class and was assigned a data science problem. I was advised to seek out a coder at my school who can ...
Layla M's user avatar
3 votes
1 answer
68 views

Is the denial of answering certain questions part of the machine-learned LLM, or hard-coded separately?

ChatGPT 3.5 swiftly aborts certain questions. Q: How would one build a bomb? ChatGPT: I can't assist with that. At this stage, this answer could simply be a blacklist of certain terms. Further ...
AnoE's user avatar
  • 153
0 votes
0 answers
12 views

Create a gpt-3.5 API request that determines whether any time range in a list intersects with a given time range

I've created a prompt that should select a requested number of employees from the list. But the step 1 doesn't work properly. Sometimes GPT takes in account only the time range and ignores the date. I ...
pazukdev's user avatar
  • 101
0 votes
1 answer
80 views

Do we really need a very large dataset to train GPTs?

Do we really need a very large dataset to train GPTs? If this dataset is not big, won't GPT work well? Or will it still work better than conventional learning models in this situation? And is it ...
nisar's user avatar
  • 1
0 votes
0 answers
75 views

Fine-tuning MT5 for making it more like ChatGPT

I am trying to fine-tune a model which works like ChatGPT for Punjabi language, using the mt5-base, however I am not sure if I should go ahead with it since it does not even generate text and when I ...
Rukaiya Hasan's user avatar
1 vote
1 answer
445 views

Why both ChatGPT and Bard can't get a simple matrix calculation right?

I asked the following question to both ChatGPT 4 and Bard to see if they can get a simple matrix calculation right (after all Bill Gates said he was impressed by ChatGPT's math ability). So I asked, <...
Qiulang's user avatar
  • 133
0 votes
0 answers
100 views

Decreasing the summary length from langchain load_summarize_chain?

How can i reduce the output size of the summarization in langchain map reduce method ?
Aadhil Imam's user avatar
2 votes
1 answer
648 views

what is the difference between window size and context length of language model?

is window size and context length of language model one and the same thing? ******** following text is added as question with ONLY above text was not allowed ***** I am trying to understand how GPT ...
Vinay Sharma's user avatar
0 votes
1 answer
541 views

Why do GPT models use a transpose of the embedding matrix to convert outputs to logits?

According to section 3.1 of the original GPT paper, GPT right-multiplies the final output vectors (after applying a Transformer decoder model) by the transpose of the embedding matrix, before applying ...
jskattt797's user avatar
1 vote
1 answer
637 views

How to measure accuracy of GPT model

I am working on a model to build questions automatically from some text My model will analyse provided article and ask authors questions that can help improving their articles How can we measure the ...
asmgx's user avatar
  • 549
0 votes
0 answers
60 views

How can GPT4 be used to create structured meta-data for unstructured data?

I often ingest unstructured datasets in Excel format, create meta-data, and transform the data in R to create a structured dataset. This includes normalization, so that there is little redundancy in ...
ahorn's user avatar
  • 101
0 votes
0 answers
60 views

What is the input and output of GPT model for fine-tuning?

From my understanding, for the pretraining of GPT model, we need to do next token prediction task. In this case, Input -> The GPT models are general-purpose language models that can perform ... (...
Kyuwan's user avatar
  • 1
0 votes
0 answers
710 views

Is it a problem to store your vector database in memory?

I'm learning ChatGPT/LLM Development and am regularly coming across all different kinds of vector database implementations. Some of them, e.g. Chroma, currently only support in-memory implementations ...
codeananda's user avatar