Questions tagged [finetuning]
The finetuning tag has no usage guidance.
53
questions with no upvoted or accepted answers
3
votes
0
answers
2k
views
What is zero-shot vs one-short vs few-shot learning?
Are there any papers/research work that deals with generalizing the matrix of how the *-shot(s) learning are defined?
There's a wide variety of papers that titled ...
- 2,430
2
votes
1
answer
243
views
Does GPT-3 remember data from prompts used to fine tune it?
I am trying to fine tune a model using OpenAI's fine tuning API. I am passing bodies of text (for example, news paper articles) as prompts and the data I want from it as completions.
Let us consider ...
2
votes
0
answers
2k
views
How many samples in dataset are required to fine-tune BERT for binary classification?
I'm trying to fine-tune a BERT-based model for a binary classification task (data is in English). The dataset I'm working with is quite small (~500 samples, out of which 80% are currently used for ...
- 21
2
votes
0
answers
592
views
Fine Tune GPT-3 without prompt?
I was wondering if it's possible to fine tune GPT-3 without using the "prompt" and "completion" method as shown in the documentation. More specifically, I want to fine tune a GPT-3 ...
- 21
2
votes
1
answer
736
views
Why not using linear regression for finetuning the last layer of a neural network?
In transfer learning, often only the last layer of the network is retrained using gradient descent.
However, the last layer of a common neural network performs only a linear transformation, so why do ...
- 605
1
vote
0
answers
26
views
Train a LLM to learn the entropy of the use case
I want to train a LLM (prefered Llama-2-13b) to learn the entropy of german texts - to be specific sports news. I use perplexity as training metric and want to check the training success after the ...
- 121
1
vote
0
answers
79
views
Could someone help with fine-tuning dolphin-2.2.1?
Could someone help with fine-tuning dolphin-2.2.1?
I have a problem with training: my train\loss - 0 and validation\loss - 0.000... after 800-1000 steps and this is overfitting
...
- 11
1
vote
0
answers
132
views
Fine-tuning Hugging Face’s Llama Model with Unlabelled Data from PDFs from niche domain
I’m unsure about the next steps. Specifically, I have the following questions:
How can I prepare my unlabelled data for the fine-tuning process?
What’s the best way to fine-tune the Llama model with ...
- 11
1
vote
0
answers
222
views
How does supervised fine-tuning work in InstructGPT?
See Figure 2 from the InstructGPT paper:
I want to know how Step 1 works. Here is one possible algorithm.
Pass the prompt through the model, and compute the negative log of the probability of the ...
- 155
1
vote
2
answers
87
views
Fine-tune GPT on sketch data (stroke-3)
These past days I have started a personal project where I would like to build a model that, given an uncompleted sketch, it can finish it.
I was planning on using some pretrained models that are ...
- 41
1
vote
1
answer
264
views
How to further fine-tune a transformer NLP model on domain specific dataset, after general fine-tuning
I would like to fine-tune a pre-trained BERT-like model for a semantic similarity analysis task in the fashion of the SNLI/MNLI task (i.e. classify sentence pairs to "entailment" or "...
- 101
1
vote
0
answers
295
views
Is it possible to "fine-tune" a pre-trained logistic regression model?
Fine tuning is a concept commonly used in deep learning. We may have a pre-trained model and then fine-tune it to our specific task.
Does that apply to simple models, such as logistic regression?
For ...
- 111
1
vote
1
answer
26
views
Tuning model by my metric
My project is using a metric to evaluate the performance of regression model, it is not belong to basic metric in Machine learning (MSE,MAE,...).
So, how can I tuning model base on my metric ?
- 21
1
vote
1
answer
822
views
Is it possible to fine-tuning BERT by training it on multiple datasets? (Each dataset having it's own purpose)
BERT can be fine-tuned on a dataset for a specific task. Is it possible to fine-tune it on all these datasets for different tasks and then be utilized for these tasks instead of fine-tuning a BERT ...
1
vote
1
answer
143
views
Train on multi-domains, then fine-tune on specific domain
Would it make sense to first train a model on images from multiple domains, and then do "fine-tuning" on one specific domain to improve its performance on it?
For instance, one could train an object ...
- 11
1
vote
0
answers
38
views
Post-classification after inference in deep learning models
I designed a fire detection using Deep Learning binary classification in Keras (fire vs none). It's a simple model with a few layers. In my training dataset, I ...
- 217
1
vote
0
answers
371
views
fine tune BERT in a small GPU
I want to to fine tune the BERT base model but the only accelerated HW I have access to is a couple of Quadro 600 GPUs which only pack 1GB RAM and 96 CUDA cores each.
My question: is it even possible ...
- 35
0
votes
1
answer
12
views
How could I further improve my detection model?
I am currently tasked with the creation of a model which is able to detect burrows of small rodents from high resolution aerial images.
My labeled images are look like this:
My results now are the ...
0
votes
0
answers
10
views
Is FLAN-t5 a good MT model at this stage for baseline comparision?
I'm currently working on a research project which involves collecting some information about baselines of Machine Translation Tasks (preferably WMT '19, WMT '14 datasets), and wanted to get a broad ...
0
votes
0
answers
29
views
Encoding Numerical Data in Text Sequences for Pre-training BERT from scratch
I have a time-series-based app usage logs dataset with columns such as:
App: the app being used (categorical)
...
0
votes
0
answers
16
views
Instrument classification on a full audio stem with Yamnet fine-tuned with NSynth dataset
My goal is to feed my model an audio track, or more specifically a stem, and have it predict the instrument of this audio file.
I have done feature extraction on the Yamnet model, trained it with the ...
0
votes
0
answers
35
views
Recommendation System: Two-Tower Model Underperforming Simple Embedding Average Baseline
I'm trying to build a recommendation on a dataset of product purchases. The dataset consists of roughly 4 Amazon products that a particular user has bought (in sequence). I want to use the first 3 ...
- 1
0
votes
0
answers
185
views
NaN grad norm even with a stable loss and gradient
Currently I am working on a custom fine-tune of several code LLMs and while working on the DeepSeekCoder I encountered a strange behaviour.
When training the model earlier or later the loss goes to ...
- 1
0
votes
0
answers
21
views
How can I make my Hugging Face fine-tuned model's config.json file reference a specific revision/commit from the original pretrained model?
I uploaded this model: https://huggingface.co/pamessina/CXRFE, which is a fine-tuned version of this model: https://huggingface.co/microsoft/BiomedVLP-CXR-BERT-specialized
Unfortunately, CXR-BERT-...
- 387
0
votes
1
answer
53
views
Detection of musical instruments using Yamnet
My goal is to detect musical instruments with AI (machine learning).
I'm currently using the Yamnet model to make inferences, but it has a very wide range of categories, for example, "Growling&...
0
votes
0
answers
10
views
Validation accuracy dip and recovery when restarting training
i was fine-tuning this large language model with Stochastic Gradient Descent and mid epoch i stopped training, and saved the model weights. Then at a later time, reloaded the weights and restarted the ...
- 101
0
votes
0
answers
57
views
Fine tuning a model for question-answering task without context on the dataset
I have a small dataset (contains around 2.5k question answer pairs) which I would like to train a T-5 base model on.
The code examples that I have came across fine-tune with a dataset which has ...
0
votes
0
answers
44
views
How is a causal language model correctly fine-tuned?
I want to fine-tune an SLM like Phi-2 through the huggingface API. I am in doubt how to achieve that, because I see two ways to do that and I am wondering which is the correct way.
The task is just a ...
- 113
0
votes
0
answers
81
views
Can I fine tune MedPaLM model
Is it possible to fine-tune MedPaLM and MedPaLM2; Google's llms trained using PaLM specialized for medical domain. Can we fine-tune these models further to get more specialized models?
- 37
0
votes
0
answers
11
views
Help with a MaNet finetuning (binary semantic segmentation task)
Introduction: I am currently working on a computer vision problem, I have satellite images and I have to detect a particular archeological structure (Tell). I have access to the previously made ...
0
votes
0
answers
27
views
why does my multi-modal model can not learn anything?
I have a multi-modal model. I want to train it using the Pytorch Framework. I have a balanced dataset. I have approximately 150 samples for each client. (I had preprocessed my text data.)
when I train ...
0
votes
0
answers
68
views
RLHF fine-tune llama2 in vertex ai
I have fine tune RLHF with Vertex AI Pipeline. But deployed model not showing in model registry. Why?
code i have used:
...
0
votes
0
answers
30
views
How to control and optimize optuna
i'm here with a pretty open question.
I'm using Optuna to fine tune a Catboost Regressor and i've found, trying a set of parameters by hand, that the "best params" it outputs are not the ...
- 101
0
votes
1
answer
91
views
Fine-tune zero-shot classification model multi-label
I started a small project where I am trying to fine-tune a zero-shot classification model on a proprietary dataset. I was thinking to use the NLI approach, building contradiction and entailment ...
0
votes
0
answers
78
views
Fine-tuning MT5 for making it more like ChatGPT
I am trying to fine-tune a model which works like ChatGPT for Punjabi language, using the mt5-base, however I am not sure if I should go ahead with it since it does not even generate text and when I ...
0
votes
0
answers
30
views
For Finetuning Llama 2, what form of data is required?
I am working on a customer service chatbot project. I have files of different product's manuals on which i need to train the LLM which is Llama 2. As these are manuals so they not in Q/A form. In this ...
0
votes
0
answers
26
views
TFRobertaSequenceClassification for Address Normalization task
I have dataset with two column: one with faulty addresses, and other with correct addresses. I want to train a model such that, I can use it later for correcting all the incoming faulty addresses.
I ...
0
votes
0
answers
31
views
Is it the right approach to select the model when it gives highest accuracy on validation dataset?
I am training the Densenet121 Model on an image dataset. I divided the dataset into 80% for training and 20% for testing.
Then I further divided the training data into 85% for training and 15% for ...
0
votes
0
answers
90
views
Can LLM fine-tuning be used to improve a language?
I'm Danish, and with all the excitement around open LLM models, I'm feeling a little left out.
Take Llama 2, for example - it was trained on a very small Danish dataset. Just enough to learn the words ...
- 101
0
votes
1
answer
333
views
Fine-tuning LLM with limited documents and hierarchy
Hello LLM enthusiasts.
I am wondering w.r.t. a neighbouring project if there are state of the art approaches to fine tune a model if:
the realm of documents is limited (still more than just a few),
...
- 1
0
votes
1
answer
97
views
Can I add a new output class to a decoder and train only the final layer?
I am wondering how to approach a project, where I would like to increase the number of output classes of an already trained network. I have very good reason to believe that the model has already ...
- 123
0
votes
0
answers
1k
views
Easyocr Fine tune english_g2.pth text recognition model using my custom dataset
Am using easy OCR from the link below
https://github.com/JaidedAI/EasyOCR
I have custom dataset of 25000 images for training and 1000 images for validation in all_data folder generated. Max image ...
0
votes
0
answers
299
views
How to finetune a closed generative huggingface model?
I want to finetune a huggingface pretrained model on our internal documentation in a way it stats answering related questions. I could not find the adequate tutorial.
- 131
0
votes
0
answers
58
views
Parameters for training a sentence-similarity model using Bert?
I have a list of sentences :
sentences = ["Missing Plate", "Plate not found"]
I am trying to find the most similar sentences in the list by ...
0
votes
0
answers
2k
views
ValueError: Mixed precision training with AMP or APEX (`--fp16` or `--bf16`) and half precision evaluation (`--fp16) can only be used on CUDA devices
i’m fine tuning the wav2vec-xlsr model. i’ve created a virtual env for that and i’ve installed cuda 11.0 and tensorflow-gpu==2.5.0 but it gives the following error : ValueError: Mixed precision ...
0
votes
1
answer
27
views
Are most deep learning models online learning models?
I'm online learning starter. from my perspective, online learning model is the model which can update its paramater with data flows(I've seen a article pointing out that incremental model is ...
- 1
0
votes
0
answers
100
views
Value accuracy remains the same
I have used my own build model and also fine-tuned other two model ResNeT50 and VGG16, but val_acc remains the same for them all.
...
- 21
0
votes
0
answers
143
views
Where to download the weights for PyTorch Efficientnet-b6
I would like to know how to download the weights for PyTorch Efficientnet-b6 architecture. Only the weights, not the entire architecture.
- 715
0
votes
1
answer
601
views
How to fine-tune GPT-J with small dataset
Firstly, thank you so much for looking at this post. I could really use some help.
I have followed this guide as closely as possible: https://github.com/kingoflolz/mesh-transformer-jax
I'm trying to ...
- 101
0
votes
0
answers
188
views
How long does it take to fine-tune XLNet?
XLNet takes a lot more time than BERT during pre-training. This results in XLNet performing better than BERT in over 20 NLP tasks. How long does XLNet take for fine-tuning (let's assume this is ...