Questions tagged [pretraining]
The pretraining tag has no usage guidance.
11
questions
0
votes
0answers
19 views
Pretrained CNN model on animal dataset ( turtles images if exist )
I was wondering if there is a pretrained CNN model on an animal dataset. I am participating in a turtle face detection competition and was wondering if there was a pretrained image model to fine tune ...
0
votes
2answers
26 views
Logic behind pre-trained weights and transfer learning
I am not sure about the logic behind, how pre-trained weights actually make sense and translate into a new problem.
To be more specific; for example in a object detection network, how would a model's ...
0
votes
0answers
11 views
With one pretrained CNN model do I get only one vector of descriptors for an image?
I am given a dataset of 2D medical images. I am asked to extract image descriptors from the hidden layer of the neural network pre-trained on the ImageNet dataset. I consider to use two networks: ...
1
vote
2answers
62 views
Does finetuning BERT involving updating all of the parameters or just the final classification layer?
Currently learning and reading about transformer models, I get that during the pretraining stage the BERT model is trained on a large corpus via MLM and NSP. But during finetuning, for example trying ...
0
votes
0answers
14 views
Any pretrained models for Style Transfer trained with large images (>512px)?
I have found some pretrained models that are prepared for small image sizes.
https://tfhub.dev/google/magenta/arbitrary-image-stylization-v1-256/2' (256x256px)
https://keras.io/api/applications/vgg/#...
1
vote
1answer
316 views
Deploying multiple pre-trained model (tar.gz files) on Sagemaker in a single endpoint
We have followed the following steps:
Trained 5 TensorFlow models in local machine using 5 different training sets.
Saved those in .h5 format.
Converted those into tar.gz (Model1.tar.gz,...Model5.tar....
0
votes
0answers
12 views
How to use an encoder to do feature extraction
I'm newbie with all of data science.
I have a pre-trained U-Net network from which I get its encoder.
Now I have to use a picture to get its features.
With the whole U-Net I do this with fit method:
<...
3
votes
1answer
30 views
Are there any objections to using the same (unlabelled) data for pre-training of a BERT-Based model and the downstream task?
I'm looking to train an Electra model using unlabelled data in a specific field. Are there any objections to using the same data for unsupervised learning and then using the same data downstream for ...
0
votes
0answers
63 views
How to go about fine-tuning BERT using a next-sentence task
I've got a large corpus of documents, and I want to use bert to generate embeddings for a variety of predictive tasks. The documents are multi-sentence, in a non-standard domain, and have labels at ...
0
votes
1answer
25 views
Semantic segmentation with greyscale images
I'm trying to reproduce a research with greyscale images instead of colour images.
I have found that there are pre-trained networks, like VGG16, with ImageNet. But that dataset has colour images, and ...
0
votes
1answer
12 views
Question of pretraining text-generation task, it seems that pretraining is not work for a small model?
My task is to generate keywords from sentences.
I pretrain a text-generation model. I mask the sentences' tokens and predict the whole sentences' tokens.
Pretraining batch_size = 8 and step = 1000000
...