5 votes
Accepted

LLMs for text generation

Yes, there are open multimodal LLMs that you can fine-tune yourself, like LlaVa, NextGPT, IDEFICS or SPHINX. Closed multimodal LLMs like GPT-4v don't offer a way to fine-tune them yet.
noe's user avatar
  • 26.6k
3 votes
Accepted

How to select the optimal beam size for beam search?

Large beam sizes do not lead to improvements but to degradation in the generated text quality, as described in the article Empirical Analysis of Beam Search Performance Degradation in Neural Sequence ...
noe's user avatar
  • 26.6k
1 vote

How does RAG (Retrieval Augmented Generation ) work around limited context length?

There are two generic solutions/ post-processing steps to work around hitting the max_token limit irrespective of the model/ LLM you are consuming in langchain. Retain the top_n matches or chunks ...
Mankind_2000's user avatar
1 vote
Accepted

Multilingual sentence generation with Hugging Face

There are a few options there: Different models on HuggingFace GPT2 should fit your use case. If performance is really critical, I'd give distilGPT2 a try. They only generate English sentences but ...
Valentin Calomme's user avatar
1 vote

Fine-tuning a pre-trained LLM for question-answering

Check the steps at the Huggingface beginner's guide Question Answering with SQuAD 2.0 to begin with a normal question answering model. Have some look at the Fine-tuning guide at OpenAI as well (which ...
questionto42's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible