Questions tagged [finetuning]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
29 views

fine tune BERT in a small GPU

I want to to fine tune the BERT base model but the only accelerated HW I have access to is a couple of Quadro 600 GPUs which only pack 1GB RAM and 96 CUDA cores each. My question: is it even possible ...
6
votes
1answer
58 views

What are the good parameter ranges for BERT hyperparameters while finetuning it on a very small dataset?

I need to finetune BERT model (from the huggingface repository) on a sentence classification task. However, my dataset is really small. I have 12K sentences and only 10% of them are from positive ...
0
votes
0answers
7 views

should I re-initialize my optimizer and my scheduler before I try to fine tune my neural network on the different dataset?

I am doing NLP, and I have this block of Transformer body that was already trained on dataset A. Now I am interested in fine tuning this same Transformer on a new dataset B. In my Python code, should ...
0
votes
0answers
29 views

Optimizing parameters for an image-generation algorithm

I have a program that takes an image and a list of parameters and generates a new image. I would like to automate the selection of parameters to produce the 'best' image. 'Best' in this context doesn'...
0
votes
2answers
37 views

Tuning a classifier for high precision, with no regard for recall

I understand this falls under the decision making aspect, rather than the probabilistic, but for the purposes of some work I am doing, I need the classifier to have very high precision, as I can't ...
0
votes
1answer
118 views

CNNs - Hyperparameter tuning with different training sizes of the same data set

I would like to compare how much the classification performance (test accuracy) of CNNs changes depending on the size of the data set. For this I would like to use a data set like MNIST or Fashion ...
0
votes
0answers
51 views

Finetuning pretrained inception_v3 in pytorch

I'm following this tutorial but I'm having some trouble with inception. Every architecture works successfully, but when I run the tutorial code for inception, I get the following error: ...
3
votes
1answer
761 views

Which is the fastest image pretrained model?

I had been working with pre-trained models and was just curious to know the fastest forward propagating model of all the computer vision pre-trained models. I have been trying to achieve faster ...