Questions tagged [huggingface]
The huggingface tag has no usage guidance.
105
questions
0
votes
0
answers
19
views
Hugging Face Real Time Object Detection Deployment
I'm developing a live object detection app using Streamlit and the YOLOv8 model. The app runs smoothly with real-time inference on my local machine. However, when I deploy it to Hugging Face Spaces, ...
- 1
0
votes
0
answers
21
views
How can I make my Hugging Face fine-tuned model's config.json file reference a specific revision/commit from the original pretrained model?
I uploaded this model: https://huggingface.co/pamessina/CXRFE, which is a fine-tuned version of this model: https://huggingface.co/microsoft/BiomedVLP-CXR-BERT-specialized
Unfortunately, CXR-BERT-...
- 387
0
votes
0
answers
20
views
Does it common for LM (hundreds million parameters) beat LLM (billion parameters) for binary classification task?
Preface
I am trying to fine-tune the transformer-based model (LM and LLM). The LM that I used is DEBERTA, and the LLM is LLaMA 3. The task is to classify whether a text contains condescending language ...
0
votes
0
answers
25
views
NLP: how to handle bad tokenization
I get nonsense when trying to translate the following german sentence to swedish using google/madlad400-3b-mt:
a. Natürliche Personen: BundID mit ELSTER-Zertifikat oder nPA/eID/eAT-Authentifizierung
...
1
vote
1
answer
75
views
attentions not returned from transformers ViT model when using output_attentions=True
I'm using this code snippet from the docs of HuggingFace ViT classification model - with one addition: I'm using the output_attentions=True parameter. Nevertheless, ...
- 111
0
votes
0
answers
37
views
Instruction LLM - extract data from text wrongly continues
I'm trying to fine-tune open sourced LLMs, for now let's stick with Mistral-7b-instruct model.
My task is a follow: I have emails, that represents "price requests" for shipments sends by our ...
- 101
3
votes
1
answer
70
views
Since LoRA parameters are randomly initialized, shouldn't that mean that initially breaks a models output?
I have just tried using LoRA on Llama 3 8B and I found without doing any fine tuning it performed pretty well on my dataset. But then I realized that surely the LoRA parameters are randomly ...
- 67
1
vote
0
answers
561
views
"No sentence-transformers model found with name" on huggingface even though it exists
I am trying to use infgrad/stella-base-en-v2 on hugging to generate embeddings using langchain
The model exists on the huggingface hub
The model is listed on the MTEB leaderboard
The model has ...
- 883
0
votes
0
answers
43
views
Not able to use huggingface inference API to get text embeddings
From the tutorials I am using the example that is provided
...
- 883
2
votes
1
answer
311
views
How do I get model.generate() to omit the input sequence from the generation?
I'm using Huggingface to do inference on llama-3-B. Here is my model:
...
- 67
0
votes
0
answers
45
views
Does Fine Tuning with Custom Label Build Upon the Capability of Zero Shot Classification or Does It Train from Scratch?
The task is to classify email text bodies into exclusive categories like feedback, complaint etc. I have a labelled dataset available having about 350 samples.
I have tried the ...
- 335
1
vote
1
answer
39
views
Public Email Classification Dataset but not Spam vs Ham
Context
Working to deliver a POC on automated email classification (in customer service context) to tag emails as related to feedback, complain, lost and found etc. The tags are not entirely exclusive,...
- 335
0
votes
1
answer
75
views
Generate VTT file from speech to text
I was able to generate text from an audio file using huggingface, using this code
...
- 103
0
votes
0
answers
18
views
Training split generation - Extremely Slow
I am fine-tuning mbert on wikipedia dataset, loaded with Datasets (Hugging face)
...
0
votes
0
answers
9
views
Will hypermeters tuned on sampled dataset work for the whole dataset?
I'm doing multi-label classification on text data using BERT model. Since the dataset is huge, around 50 thousand rows, I was thinking to use stratify sampling on dataset to reduce it to around 2-4 ...
0
votes
0
answers
10
views
dimensions conflict when trying to use a pretrained wav2vec2-xls-r-300m model
i am trying to use a pretrained model facebook/wav2vec2-xls-r-300m and fine tune it for audio classification and more specifically emotion recognition. i am using an audio labeled dataset ( 12 labels )...
0
votes
0
answers
63
views
How to find LLM that is best at STS task?
I'm trying to find large language models that maps an embedding vector in proximity if they are semantically similar, in Korean. I tried looking at bunch of leaderboard such as MTEB_ko-ko STS, AI Hub ...
- 469
0
votes
0
answers
9
views
Reducing language bias for text classification, transformer model
I am working on a text classification model predicting classes for text. We have languages from many parts of the world and some of our classes are dominated by specific languages. The model we are ...
- 876
0
votes
0
answers
217
views
Safetensors are slower than torch.load. Why?
Lately, I have been testing safetensors. It claims that the safetensors are faster and safer than pickle. So I did my own comparison with the code below:
...
- 103
0
votes
1
answer
54
views
Getting rid of the warning "The following columns ... have been ignored" and "ValueError: batch_size should be a positive integer value ..."
I train a fine-tuning model with the PyTorch Trainer class:
...
- 195
0
votes
1
answer
202
views
Outdated Transformers TextDataset class drops last block when text overlaps. Replace by datasets Dataset class as input of Trainer train_dataset?
Why I try to replace the transformers TextDataset class with datasets Dataset class
I stumbled upon this when I tried to make ...
- 195
0
votes
0
answers
17
views
How to perform inference on a finetuned falcon 7b model fine tuned on open assistant dataset
I finetuned a falcon 7b model on the open assistant dataset using the official colab notebook provided by huggingface at https://colab.research.google.com/drive/1BiQiw31DT7-cDp1-0ySXvvhzqomTdI-o?usp=...
1
vote
1
answer
45
views
Falcon-7B llm giving random output
I am using a falcon 7B model for a chatbot without any finetuning with the following code
...
0
votes
2
answers
706
views
How can you get a Huggingface fine-tuning model with the Trainer class from your own text where you can set the arguments for truncation and padding?
I want to find out the role of truncation and padding in Huggingface Transformers pretrained models and any fine-tuning model on top of that. Therefore I played around with these parameters, but I ...
- 195
2
votes
2
answers
2k
views
Should you care about truncation and padding in an LLM even if it has a very large tokenizer.max_length so that truncation will never happen?
I want to find out the role of truncation and padding in Huggingface Transformers pretrained models and/or any fine-tuning models on top. Taking a large language model like the German GPT2 shows that ...
- 195
1
vote
0
answers
77
views
Could someone help with fine-tuning dolphin-2.2.1?
Could someone help with fine-tuning dolphin-2.2.1?
I have a problem with training: my train\loss - 0 and validation\loss - 0.000... after 800-1000 steps and this is overfitting
...
- 11
0
votes
1
answer
42
views
Multilingual sentence generation with Hugging Face
For an application I need to generate some random sentences, i.e. I don't need the output sentences to have any specific link to the prompt other than using the same language. If possible I need this ...
- 25.7k
0
votes
1
answer
151
views
RuntimeError: mat1 and mat2 shapes cannot be multiplied (25x7 and 1x512)
I am dealing with multivariate time series forecasting using Transformers.
below is my code step by step:
After some preprocessing and windowing time series dataset …
1- Creating Mask function
...
- 21
1
vote
1
answer
52
views
Understanding processors in huggingface tokenizer library
tl;dr
What are the :0 and :1 in the following huggingface processors reference usage given on their page:
...
- 883
1
vote
0
answers
130
views
Fine-tuning Hugging Face’s Llama Model with Unlabelled Data from PDFs from niche domain
I’m unsure about the next steps. Specifically, I have the following questions:
How can I prepare my unlabelled data for the fine-tuning process?
What’s the best way to fine-tune the Llama model with ...
- 11
0
votes
0
answers
89
views
What happens when I set is_decoder to True in the bert API from huggingface?
Please help me understand the implications of initialising the bert model from huggingface with is_decoder parameter set to True
...
- 883
0
votes
1
answer
180
views
Open-Source Large Language Models (LLM): Your experience and recommendation
I’m looking for an open-source LLM for a new project. I want to use it for instructions and to fine-tune the model to a specific domain like legal and rights. Some LLMs are open-source, but they didn’...
- 121
0
votes
0
answers
70
views
F1 and Exact-Match (EM) Score in Extractive QA NLP
I have a question as to how the F1 should be calculated in NLP and whether the text normalization is optional or not.
So I have been working on a project where we created a closed-domain extractive QA ...
- 101
0
votes
0
answers
73
views
How to use Bertweet model for topic modeling
The problem is implementation of Bertweet in a topic-modeling project with understandable output like BERTopic, i want to use it on a relatively large (20k tweets) unlabelled dataset to segment it ...
- 1
0
votes
0
answers
322
views
How to get Llama-2 Rotary Embeddings?
I want to get the Llama-2 rotary embeddings. I do print(model) and get the following output:
In the picture I highlight the rotary embeddings.
How can get the ...
- 121
0
votes
0
answers
31
views
Errors in results after saving model vs using directly from memory
I am trying to save a Fine Tuned model using trainer.save_model() but after I load the saved_model it just responds with the input back again and does not give any ...
- 191
0
votes
0
answers
274
views
Specifying arguments of HuggingFaceHub
In this tutorial, when specifying
llm = HuggingFaceHub(
repo_id=repo_id, model_kwargs={"temperature": 0.5, "max_length": 64})
only ...
- 49
1
vote
1
answer
616
views
How to Use Multiple Adapters with a Pretrained Model in Hugging Face Transformers for Inference?
I have a pretrained Llama-2 model in the models_hf directory and two fine-tuned adapters: a summarization adapter in ...
- 33
1
vote
0
answers
81
views
Deploying a model with GPU and pay-per-inference
I may have the wrong stack exchange. If that's the case, could someone point me to a stack that could help with this. Anyways...
My backend employs a sentence transformer model from HuggingFace. Since ...
- 141
0
votes
1
answer
851
views
Can I run falcon-7b on a free google colab?
I'm a beginner at ML and AI.
Background:
I wanted to try out falcon-7b, the example I'm trying out: https://colab.research.google.com/drive/1BiQiw31DT7-cDp1-0ySXvvhzqomTdI-o?usp=sharing (Falcon-...
- 103
1
vote
0
answers
256
views
How to load Hugginface model on CPU?
My system runs out of memory on GPU. But I want just to test if it works and want to load it on CPU. How do I do that?
Adding device = torch.device(‘cpu’) before ...
- 123
2
votes
1
answer
178
views
How can someone evaluate llama index model?
I have built a openAI llama index based model which takes multiple pdf and able to give chatbot based response. I want to evaluate the llm for accuracy. I already know method such as Rouge and Bleu. ...
3
votes
1
answer
2k
views
LMM Fine Tuning - Supervised Fine Tuning Trainer (SFTTrainer) vs transformers Trainer
When should one opt for the Supervised Fine Tuning Trainer (SFTTrainer) instead of the regular Transformers Trainer when it comes to instruction fine-tuning for Language Models (LLMs)? From what I ...
3
votes
1
answer
1k
views
Fine-tuning a pre-trained LLM for question-answering
Objective
My goal is to fine-tune a pre-trained LLM on a dataset about Manchester United's (MU's) 2021/22 season (they had a poor season). I want to be able to prompt the fine-tuned model with ...
- 33
1
vote
0
answers
240
views
How to monitor training of text generation models?
I'm finetuning a pretrained Huggingface model based on Transformers for a downstream Text Generation task, but I have doubts on how the fine-tuning process should be monitored:
In classification, I ...
- 171
0
votes
1
answer
160
views
Can we train the Dolly v-2 model on a large general purpose unlabelled text?
I am familiar with ML and Deep Learning concepts and have had a look at Dolly and even got the pretrained model running on a Jupyter lab notebook on Databricks.
However when I take a look at their ...
- 101
1
vote
0
answers
753
views
Creating LLM chatbot using llama-index + langchain
As the title suggests: I'm trying to build a chatbot which his goal should be sort of like "chatgpt".
The chatbot will be installed on Slack workspace and I'm struggling with which scope I ...
- 209
1
vote
0
answers
87
views
trainable weights in automodel and comparison with lora
if i use RobertaForSequenceClassification or AutoModelForSequenceClassification,
are all the weights trained or only the new classification head trained
also ,
i am also noticing for "roberta-...
- 11
0
votes
1
answer
266
views
Passing target text to gpt2 and T5 for fine tuning to learn text generation task
I have text with each line in following format:
<text-1> some text-1 <text-2> some text-2 <text-3> some text-3
I want fine tune model to learn ...
- 105
1
vote
2
answers
1k
views
Fine-tuned MLM based RoBERTa not improving performance
We have lots of domain-specific data (200M+ data points, each document having ~100 to ~500 words) and we wanted to have a domain-specific LM.
We took some sample data points (2M+) & fine-tuned ...
- 11