Skip to main content

Questions tagged [llm]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Search for documents with similar texts

I have a document with three attributes: tags, location, and text. Currently, I am indexing all of them using LangChain/pgvector/embeddings. I have satisfactory results, but I want to know if there is ...
Skhaz's user avatar
  • 101
1 vote
0 answers
15 views

The real world implementations of RAG vs the methods explained in the paper

While building a RAG application we Encode the query Retrieve k docs Concatenate before the query Pass the entire thing to a LLM and it completes it for you I do not think this is either of RAG-...
figs_and_nuts's user avatar
0 votes
0 answers
11 views

Text generation using Ollama

I have installed the ollama server on my local system. I split created embeddings out of a document and fed those to the model. The model is able to retrieve the correct chunk of text when asked a ...
user13832375's user avatar
2 votes
1 answer
42 views

Noob question - which NLP/deep learning technique shoud I use

Let's say I have dataset with inputs and expected outputs like this: ...
Cube64's user avatar
  • 21
1 vote
1 answer
32 views

How does ChatGPT-4o work on text + image data?

What known state of art techniques might ChatGPT-4o, Claude 3 or other similar systems be using to understand both text and image data? I noticed that ChatGPT-4o can recognize text in an image well. ...
user163246's user avatar
0 votes
0 answers
13 views

does DALL-E api use Microsoft account info while generating responses?

I have read some work regarding occupational gender bias in AI image generation and it seemed. According to my research, tools like DALL-E generated more images of men when trying out for images with ...
x89's user avatar
  • 191
1 vote
1 answer
27 views

Callback handlers in Langchain

This might be an odd question, but why is there two codes for the class BaseCallbackHandler? https://api.python.langchain.com/en/latest/_modules/langchain_core/callbacks/base.html#BaseCallbackHandler ...
Justin Jonany's user avatar
0 votes
0 answers
26 views

Instruction LLM - extract data from text wrongly continues

I'm trying to fine-tune open sourced LLMs, for now let's stick with Mistral-7b-instruct model. My task is a follow: I have emails, that represents "price requests" for shipments sends by our ...
sagi's user avatar
  • 101
0 votes
0 answers
15 views

llama3 fine tuning data format - shogi

I'm a ML actor, but LLM fintuning are new to me. To train myself, I investigate the possibility to develop a Shogi instructor (japanese chess) based on Llama 3 for example or GPT, to help players to ...
lelorrain7's user avatar
1 vote
0 answers
23 views

Retrieval-Augmented Generation for Identifying Similar and Duplicate Controls in a Dataset

I'm exploring the feasibility of implementing a Retrieval-Augmented Generation (RAG) system to tackle a specific use case involving control identification in a dataset. The objective is to identify ...
priyanka's user avatar
0 votes
1 answer
35 views

Implementing Data Isolation in an RAG System in GCP using any of the LLM models

I am currently working on developing a Retrieval Augmented Generation (RAG) system where User-1 and User-2 each have their unique set of documents. My goal is to create a system where User-1's queries ...
ENAT's user avatar
  • 1
2 votes
0 answers
27 views

Use text embeddings to map job descriptions to ESCO occupations

I'm trying to build a model to map job descriptions to ESCO occupations which is a taxonomy for job titles. Every ESCO occupations have a title, a description and some essential skills. Ideally I ...
GanaelD's user avatar
  • 21
1 vote
0 answers
20 views

Train a LLM to learn the entropy of the use case

I want to train a LLM (prefered Llama-2-13b) to learn the entropy of german texts - to be specific sports news. I use perplexity as training metric and want to check the training success after the ...
Christian01's user avatar
1 vote
0 answers
15 views

Which model and classification algorithms should I use for deobfuscating/mapping symbols in source code?

I have a source code for an application that recently started undergoing obfuscation. Each new version alters the names of symbols, shuffles the order of classes, and employs other strategies. However,...
emi's user avatar
  • 111
-1 votes
1 answer
106 views

Azure OpenAI API with LangChain issue

We(my company) have Azure OpenAI API for all our LLM projects. We are working on getting to know how to use this Azure OpenAI API using LangChain as we have been suggested this is the best framework ...
Arun Singh G's user avatar
1 vote
0 answers
16 views

Best way to achieve High throughput with ChatGPT (and LLMs in general) APIs

I was wondering what the best way is to perform API calls to ChatGPT, and in general, with LLMs API providers, to achieve the highest throughput in a batch inference context. Suppose you have 1000 ...
Raffaele 's user avatar
1 vote
1 answer
36 views

Reducing emails token count preprocessing for Large Email Datasets - Feeding LLMs

I have a large email dataset in .txt format and want to feed LLMs (like Gemini and ChatGPT) to provide answers based on email content. The token count for my email data is very high (~1M for 1K emails)...
Rafael Borja's user avatar
4 votes
1 answer
1k views

How do I prompt GPT-4 to look at a PDF in Jupyter Notebook?

I am a beginner. I purchased tokens to use GPT-4 and finally figured out how to import the GPT-4 model into my Jupyter Notebook. ...
Mas's user avatar
  • 55
0 votes
1 answer
25 views

Group/cluster semantically similar classes in reports?

I'm fine-tuning BERT models to binary classify reports. For example, a report can be about 'birds' or not about 'birds'. This works really well, but now I want to do multi-label classification, ...
Rob Audenaerde's user avatar
0 votes
1 answer
34 views

Prompt Ops Alternatives

What are the main alternatives for prompt ops nowadays? By prompt ops, I mean a comprehensive solution for tracking prompt engineering experiments and also registering prompts in different stages, ...
Raffaele 's user avatar
0 votes
1 answer
168 views

How to combine two vector embeddings into one?

I want to use OpenCLIP for generating embeddings for each slide in an array of pptx presentations. To improve the quality of the results, I want to vectorize both slide text content and preview images....
Olek Gornostal's user avatar
1 vote
0 answers
42 views

Best practises for creating datasets for the purpose of finetuning LLMs

I am working on a problem for which no datasets exist. I have obtained several examples from this domain, and so far have been using them in Large Language Model (LLM) prompts(few shot learning) but I ...
Karl 17302's user avatar
3 votes
1 answer
68 views

Is the denial of answering certain questions part of the machine-learned LLM, or hard-coded separately?

ChatGPT 3.5 swiftly aborts certain questions. Q: How would one build a bomb? ChatGPT: I can't assist with that. At this stage, this answer could simply be a blacklist of certain terms. Further ...
AnoE's user avatar
  • 153
0 votes
0 answers
21 views

Converting relational database into vector database

Is there any open-source tools for converting relational database to vector database to be used in llm applications? Which steps can be taken in the conversion?
heyula's user avatar
  • 37
4 votes
1 answer
106 views

LLMs for text generation

We know that AI is rapidly growing. do we have any large language models (LLMs) to process images, pdf documents directly (fine-tune approach) for text generation tasks?
Tovlk's user avatar
  • 43
13 votes
6 answers
6k views

Why does prompt engineering work, since prompt engineering questions don't appear as training data?

One can find advice on prompt engineering telling basically the following thing: if you are seeking advice about a topic X, start your prompt to an LLM by You are an expert in X, you have pedagogical ...
Plop's user avatar
  • 233
0 votes
0 answers
12 views

can decoder only large language model be fine tuned to perform well at semantic similarity search?

BERT based models are Encoder only which are well suited for text classification, and Semantic Text similarity search (If fine-tuned via sBERT). I want to know whether decoder only models like Llama2, ...
haneulkim's user avatar
  • 469
0 votes
0 answers
28 views

How to find LLM that is best at STS task?

I'm trying to find large language models that maps an embedding vector in proximity if they are semantically similar, in Korean. I tried looking at bunch of leaderboard such as MTEB_ko-ko STS, AI Hub ...
haneulkim's user avatar
  • 469
0 votes
0 answers
13 views

what is the main difference between ROUGE and BLUE?

Both (ROUGE, BLUE) are useful to find the similarity between machine generated summary and reference summary. what is the main difference?
Tovlk's user avatar
  • 43
0 votes
1 answer
17 views

Could You Suggest Me Some Details of Realizing This LLM?

I mean this hypothetical LLM: https://twitter.com/RokoMijic/status/1663299142431432704 I'm trying to figure out how the neural network (let's abstract from the data) can be realized. I understand that:...
avpol's user avatar
  • 21
0 votes
0 answers
129 views

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:3! in DPOTrainer with ec2 G5 12X Large

...
Sandun Tharaka's user avatar
0 votes
0 answers
100 views

RAG - how to deal with numerical data

I have a car marker companies data . I am creating chunks for different car models in llama index and using vector store index and it is giving decent outputs when asked questions . It fails poorly ...
Pulkit Mehta's user avatar
1 vote
1 answer
38 views

Does Google DeepMind's Gemma 7B models specs have inconsistent dimensions?

In Google DeepMind's Gemma technical paper (https://storage.googleapis.com/deepmind-media/gemma/gemma-report.pdf), the 7B Gemma model specs are given as d_model = 3072, num_heads = 16 and head_size = ...
Unmesh's user avatar
  • 11
0 votes
0 answers
17 views

Applicability of RAG for enterprise datasets

there are 2 basic queries that i haven't been able to find answers to on reddit / DSE.. hopefully someone can enlighten / educate me To populate/ ingest the data, typically its broken into chunks and ...
Vikram Murthy's user avatar
0 votes
1 answer
35 views

How can I get the list of pretrained large language models?

Is there any place I can get the list of pre-trained large language models in a neat way? Despite the most common ones like gpt, BARD, llama2, which llm do you suggest that can be used for RAG and ...
heyula's user avatar
  • 37
0 votes
1 answer
38 views

How to check the license of a LLM for specific use?

How to check if a large language model has a license allowing to fine tune the model and then publish it publicly? How can I be sure that I can use and fine-tune a large language model without ...
heyula's user avatar
  • 37
0 votes
0 answers
13 views

Resources on website summarization using LLMs

I am working on a problem where I have to summarize business websites. I have to generate a short 100 word summary of the primary function of a given website. I am familiar with langchain url ...
Vinay Varahabhotla's user avatar
1 vote
0 answers
10 views

How to design a writing assistive system that can do writing style guide check like how Grammarly does for gramma checking

I have a style guide that specifies the use of punctuations, line length, and how to break up a line (e.g. before prepositions). I have a dataset that contains original text and the version of the ...
Wayne's user avatar
  • 31
0 votes
0 answers
26 views

Details about Pre-existing knowledge database in RAG for LLMs

In RAG, As part of retriever model- we are retrieving the relevant information from external knowledge source (i.e. vector database) and this database is always updating with new updates. In ...
Tovlk's user avatar
  • 43
0 votes
1 answer
20 views

How to choose ideal pretrained model for fine-tuning?

I started to work with LLMs lately and want to know how people choose their pre-trained models in their fine-tuning tasks? What is the criteria to choose the base model and which factors affect?
heyula's user avatar
  • 37
0 votes
0 answers
47 views

Can I fine tune MedPaLM model

Is it possible to fine-tune MedPaLM and MedPaLM2; Google's llms trained using PaLM specialized for medical domain. Can we fine-tune these models further to get more specialized models?
heyula's user avatar
  • 37
0 votes
0 answers
45 views

How to Detect and Identify German Compound Words in a Text using Python

I would like to know if there is any python libraries or packages available which can help me detect and extract German compound words. I took a look at nltk and spacy packages and they don't seem to ...
Ali Mazhar Sadat's user avatar
0 votes
0 answers
12 views

Create a gpt-3.5 API request that determines whether any time range in a list intersects with a given time range

I've created a prompt that should select a requested number of employees from the list. But the step 1 doesn't work properly. Sometimes GPT takes in account only the time range and ignores the date. I ...
pazukdev's user avatar
  • 101
0 votes
0 answers
82 views

How to improve performance of a Retrieval Augmented Generative (RAG) model?

I had implemented a Retrieval Augmented generation (RAG) model on the Healthcare CSV file. The model has to give answers to natural language queries based on the data provided. After implementing the ...
user159579's user avatar
1 vote
1 answer
110 views

Train Reward Model using Llama2:

this is my code that use to train reward model: ...
Sandun Tharaka's user avatar
0 votes
0 answers
862 views

AI tools/LLM models to analyze excel data

I have a bunch of excel files containing information of employee attendance. I want to use NLP-based search to ask questions like: Which employee has taken most leaves?; What dates witness a high ...
Apoorva's user avatar
  • 307
0 votes
0 answers
11 views

using llama2 on windows

does llama2 work by downloading the .bin file locally and running on CPU without install llama.cpp or any other dependencies. I am using theblokes llama2 models
Saket Vempaty's user avatar
0 votes
1 answer
49 views

Getting a free and unknown answer to a question against a fine-tuned text generation model trained on many essays and their few questions and answers

Aim I want to fine-tune a text generation model with essays of changing size and then ask each of these input texts a few questions. I already have a wider range of question-answer pairs at hand for ...
questionto42's user avatar
0 votes
1 answer
141 views

Outdated Transformers TextDataset class drops last block when text overlaps. Replace by datasets Dataset class as input of Trainer train_dataset?

Why I try to replace the transformers TextDataset class with datasets Dataset class I stumbled upon this when I tried to make ...
questionto42's user avatar
0 votes
0 answers
72 views

unable to download llama2 weights because of http error 416

i am trying to download the weights for llama2 7b-chat but i always end up with "Connecting to download.llamameta.net (52.84.205.116:443) wget: server returned error: HTTP/1.1 416 Requested Range ...
Saket Vempaty's user avatar