Skip to main content

Questions tagged [huggingface]

The tag has no usage guidance.

64 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
0 votes
0 answers
141 views

Fine-Tune Llama on main and auxiliary task

I am trying to fine-tune Llama model on two task at the same time, using hugging face library: Main task: Causal language model like the model was initially trained for A classification task based on ...
Dimits's user avatar
  • 11
0 votes
0 answers
22 views

Sentiment extraction with hugging face ready to use model

I have a set of reviews for which I need to extract their sentiments and use those sentiments as an independent variable in an econometric model. I used one of the ready-to-use models of hugging face ...
m sh's user avatar
  • 3
0 votes
0 answers
40 views

Which language model to use for this use case? [Finetuning on custom dataset]

An example from my train data is as follows: ...
ksgr5566's user avatar
  • 101
0 votes
0 answers
189 views

Multiple CSV files input for hugging face table question-answering in Python

I am trying to write a code in HuggingFace Python to input multiple CSV files and feed them to the tokenizer for table question-answering. If I were to input only one CSV file, the code would look ...
Ramin Salimi's user avatar
0 votes
0 answers
14 views

Large Language model for regression on urls

I am trying to fit a BERT model for a URL regression task. I have a URL as a feature and I have to predict a metric M for it. Keeping a learning rate like $10^{-5}$, the model is overfitting in about ...
guesta's user avatar
  • 1
0 votes
0 answers
19 views

"Probabilistic" One-Hot-Encoder for transformers library

I'm using the transformers library to fine-tune a LLM for classification. However, my problem is a bit particular, as the labels are hierarchical, that is, in the form A-1, A-2, B-1, B-2 etc. ...
EzrielS's user avatar
  • 323
0 votes
1 answer
158 views

Can we train the Dolly v-2 model on a large general purpose unlabelled text?

I am familiar with ML and Deep Learning concepts and have had a look at Dolly and even got the pretrained model running on a Jupyter lab notebook on Databricks. However when I take a look at their ...
London guy's user avatar
0 votes
0 answers
1k views

RuntimeError: It looks like your LightningModule has parameters that were not used in producing the loss returned by training_step

I'm trying to use donut, which is a transformer model with a huggingface implementation, and pre-train it on a language it hasn't been yet on my desktop. Unfortunately the version of the stack ...
lte__'s user avatar
  • 1,350
0 votes
0 answers
291 views

How to finetune a closed generative huggingface model?

I want to finetune a huggingface pretrained model on our internal documentation in a way it stats answering related questions. I could not find the adequate tutorial.
welu's user avatar
  • 131
0 votes
0 answers
894 views

How to deal with DataCollator and DataLoaders in Huggingface?

I have issues combining a DataLoader and DataCollator. The following code with DataCollatorWithPadding results in a ...
3r1c's user avatar
  • 101
0 votes
0 answers
2k views

Hugging face Model Output 'last_hidden_state'

I am using the Huggingface BERTModel, The model gives Seq2SeqModelOutput as output. The output contains the past hidden states and the last hidden state. These are my questions What is the use of the ...
Fhunmie's user avatar
  • 17
0 votes
0 answers
37 views

Which steps are involved in sentiment analysis with Huggingface Transformers?

I want to perform a sentiment analysis of a dataset of (Spanish) tweets about COVID-19 vaccines. I've already scraped the tweets and identified a pretrained model I can use for Spanish. What I don't ...
LeLuc's user avatar
  • 131
0 votes
0 answers
151 views

List of Google T5 possible operations

I am trying to use the huggingface.co pre-trained model of Google T5 (https://huggingface.co/t5-base) for a variety of tasks. But I can`t find a list of many tasks it really supports and how to ...
tschomacker's user avatar
0 votes
0 answers
166 views

BERT for classification model degenerates into all-positive predictions

As a learning project, I'm training a BERT model with the CoLA dataset to detect sentence acceptability. Unfortunately my model is learning to classify every instance as "acceptable", and I'...
jdferreira's user avatar

1
2