Questions tagged [huggingface]

The tag has no usage guidance.

9 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
1
vote
0answers
21 views

How to apply pruning on a BERT model?

I have trained a BERT model using ktrain (tensorflow wrapper) to recognize emotion on text, it works but it suffers from really slow inference. That makes my model not suitable for a production ...
1
vote
1answer
27 views

Should weight distribution change more when fine-tuning transformers-based classifier?

I'm using pre-trained DistilBERT model from Huggingface with custom classification head, which is almost the same as in the reference implementation: ...
0
votes
0answers
27 views

PyTorch Hugging Face - Language generation with torchscript model

Have a fine-tuned a summarization model following the Hugging Face seq2seq guide (starting from sshleifer/distilbart-xsum-12-6). We are interested in using AWS elastic inference for deployment for ...
0
votes
0answers
35 views

huggingface bert - need help on working of code

Looking for some explanation of understanding of the BERT implementation by huggingface. I would explain my understanding below and then ask question: Below is code for question answering ...
0
votes
1answer
134 views

Overfitting in Huggingface's TFBertForSequenceClassification

I'm using Huggingface's TFBertForSequenceClassification for multilabel tweets classification. During training the model archives good accuracy, but the validation accuracy is poor. I've tried to solve ...
0
votes
0answers
12 views

Transformers trainer sequence classification problem

I wanted to use XLMRobertaForSequenceClassification to classify a sequence into 1 or 0. <...
0
votes
0answers
115 views

BERT Implementaion for Sequence Classification

I am trying to implement BERT using HuggingFace - transformers implementation. I am following two links: by analytics-vidhya and by HuggingFace Below is the code: ...
0
votes
0answers
52 views

HuggingFace/Transformers Implementation for Classification

I am trying to implement BERT using HuggingFace - transformers implementation. I am following two links: by analytics-vidhya and by HuggingFace If we consider inputs for both the implementations: 1) ...
0
votes
0answers
36 views

How can I make a whitespace tokenizer and use it to build a language model from scratch using transformers

I have raised a ticket in github, whose link is here Which has a problem statement as mentioned below. If you have any solution to this, do answer. I am trying to make a language model using a ...