Questions tagged [information-retrieval]

Information Retrieval is an area of study concerning with retrieving documents, information or metadata from a collection of unstructured or semi-structured data.

Filter by
Sorted by
Tagged with
1 vote
0 answers
17 views

Train a LLM to learn the entropy of the use case

I want to train a LLM (prefered Llama-2-13b) to learn the entropy of german texts - to be specific sports news. I use perplexity as training metric and want to check the training success after the ...
Christian01's user avatar
0 votes
1 answer
20 views

Searching ChatGPT transcripts?

Maybe I just don't understand the functionality of the web version. Using GPT4 here. When I do technical queries (usually TensorFlow applications) I use similar prompts until I get the understanding I ...
PracticalKat's user avatar
0 votes
0 answers
16 views

Applicability of RAG for enterprise datasets

there are 2 basic queries that i haven't been able to find answers to on reddit / DSE.. hopefully someone can enlighten / educate me To populate/ ingest the data, typically its broken into chunks and ...
Vikram Murthy's user avatar
1 vote
0 answers
54 views

Information retrieval SOTA models

Where can I find sota models of information retrieval? My task is to rank documents by given query by semantic search of embedding. I know that models like ColBERT, SPLADE solve this problem, but I ...
prostak's user avatar
  • 121
0 votes
0 answers
60 views

How to improve performance of a Retrieval Augmented Generative (RAG) model?

I had implemented a Retrieval Augmented generation (RAG) model on the Healthcare CSV file. The model has to give answers to natural language queries based on the data provided. After implementing the ...
user159579's user avatar
0 votes
1 answer
70 views

How the retriever model (Query encoder) is end-to-end trained in Retrieval Augmented Generation (RAG)?

RAG architecture from the original paper Since loss is calculated at the output layer of the generator, how the gradients are back propagated to the retriever model? Because the input to the Generator ...
Ritwik's user avatar
  • 141
0 votes
1 answer
63 views

How does RAG query affect the similarity search?

I have a RAG pipeline where I want to extract a piece of information called "X" In a regular RAG pipeline, there is a query entered by the user. Then, ...
ahmedmoh123's user avatar
0 votes
1 answer
278 views

How does RAG (Retrieval Augmented Generation ) work around limited context length?

My understanding of the RAG pipeline can be summarized with the following diagram: I understand steps 1-7 splits and vectorizes an external text data source into chunks and steps 8-11 retrieves n ...
Clement's user avatar
0 votes
0 answers
55 views

How to find proper context in open book question answering?

I want to make an Open Book Question Answering / Retrieval Augmented Generation system. The major concern here is the proper context selection. There are some fundamental issues related to this. For ...
hafiz031's user avatar
  • 121
0 votes
1 answer
93 views

Fastest way to do Maximum Inner Product Search?

There have lots of $d-$dimension vectors, they combine a set $X$. We use an input query $q$. We need to find the $p$, which has the maximum inner product from the set $X$. $$ p = \arg \max_{x \in ...
jackson's user avatar
  • 25
0 votes
0 answers
25 views

What options do I have when performing RAG on similarly phrased chunks?

I'm building a RAG pipeline to extract real estate phrases from excel documents. These phrases are short (2-5 words) and are often phrased differently. I've manually added in different phrases to each ...
codeananda's user avatar
0 votes
0 answers
19 views

How to calucate recall at k when the number of relevant document is large?

In information retrieval, how to calculate r@k when the number of the relevant document is large? The formular is: $ \text{Recall@K} = \frac{\text{True positive}}{\text{relevant document}} $ If ...
Inhyeok Yoo's user avatar
1 vote
2 answers
4k views

Splitting documents with langchain when a sentence straddles the a page break

I've been following this guide to Langchain: https://learn.deeplearning.ai/langchain-chat-with-your-data/lesson/3/document-splitting It seems like the Langchain document loaders treat each page of a ...
Sinnombre's user avatar
  • 153
0 votes
0 answers
40 views

Can I use faiss as retrieve on recommendation system?

I'm planning on using faiss to generate candidates and then lightgbm to rank the candidates. I think about using E-commerce data, as most of the examples I see using faiss are textual data. Is using ...
Marcos Mota's user avatar
0 votes
0 answers
18 views

Add parameter efficient training in retrieval natural language processing

I am studying some paper with retrieval augmented generation and parameter efficient work on NLP task, ex: adapter, prefix tuning, prompt ... I wonder that can I get better performance with parameter-...
jackson's user avatar
  • 25
0 votes
1 answer
11 views

How to handle using input feature (clicks) when it is used in target too?

I am trying to create a ranking model, where I am thinking about creating ground truth based on clicks by user. But at same time past clicks made by users seems like a vital input feature too. Any ...
dcusmeb's user avatar
0 votes
1 answer
30 views

Survey on image retrieval datasets

I am on a survey about image retrieval datasets. I have found some, such as: NUS-WIDE Oxford5k Oxford105k Paris6k MSCOCO I have been way too confused about the detection metrics and the metrics they ...
sminitis's user avatar
1 vote
1 answer
29 views

Empirical indications regarding demanded skills and tasks of data science jobs?

I am wondering if there are is any information about the current (and prospected) shares in skills required for advertised/existing data science jobs. This includes of course also the concrete tasks ...
Radio Controlled's user avatar
1 vote
1 answer
155 views

How to add significance weighting in user based collaborative filtering

I have been learning about recommender systems these past days. More specifically about the collaborative filtering. While exploring I found that it can be useful to use "significance weighting&...
ilved17's user avatar
  • 31
2 votes
1 answer
387 views

Why is accuracy not a useful measure for information retrieval problems?

I have been studying about information retrieval and recommender systems. While reading about it I found that accuracy not a useful measure in information retrieval. I understand that, accuracy might ...
ilved17's user avatar
  • 31
1 vote
0 answers
217 views

information retrieval vs recommendation system

Apologizes in advance, if this question is so basic, Problem: I have read this paper and noticed that Information Retrieval can be identified as a field of study whereas Recommender Systems are a ...
doplano's user avatar
  • 151
1 vote
0 answers
34 views

Optimizing Rank Aggregation of Two Different Methods in Information Retrieval

As the title suggests, I would like to train a rank-aggregating model. My target problem is to rank text2s from a database as best as possible to a given query, <...
You_Donut's user avatar
1 vote
1 answer
91 views

Effectiveness of tf-idf on documents with repeated keywords

I was doing some ML reading and came upon tf-idf. The tf portion counts the relative frequency of a relevant word in a document, while idf measures how common or rare a word is across the corpus. The ...
disguisedtoast's user avatar
0 votes
1 answer
26 views

What method/algorithm to use to extract information from project documents about objectives, activities, and other variables?

I'm more-or-less new to NLP so assume little existing knowledge! But I have strong coding skills in R and to a lesser extent Python. We're interested in extracting key information about objectives, ...
Rory's user avatar
  • 1
1 vote
2 answers
490 views

How to interpret rank output from BM25?

I'm using the FTS5 functionality in Sqlite3 to compute a search rank, which uses BM25. Maybe I'm just not seeing it, but I can't find any description of how to actually interpret BM25's output ranking....
Cerin's user avatar
  • 121
0 votes
1 answer
272 views

What did Sentence-Bert return here?

I used sentence bert to embed sentences from this tutorial https://www.sbert.net/docs/pretrained_models.html ...
user900476's user avatar
1 vote
1 answer
59 views

A way to perform voting and select a candidate based on nearest neighbours

I'm working on a project where I use FAISS to retrieve n neighbouring vectors based on a query vector. The data in question is textual and is being embedded by using a machine learning model to create ...
mabergerx's user avatar
  • 111
1 vote
1 answer
729 views

How can I implement lambda-mart with lightgbm?

I have a learning to rank task at hand and I want to use the lightgbm implementation of LambdaMART. I'm also following this notebook. ...
Akash Dubey's user avatar
1 vote
1 answer
149 views

Can I use Sentence-Bert to embed event triples?

I extracted event triples from sentences using OpenIE. Can I concatenate the components in the event triple to make it a sentence and use Sentence-Bert to embed it? It seems no one has done this way ...
user900476's user avatar
2 votes
1 answer
160 views

How "similarity" is measured in image retrieval?

I know what content based image retireval is. I have read this and this as one of them says: "given a query images, get a rank list that are most similar to the query image, based on the content ...
David's user avatar
  • 131
2 votes
1 answer
298 views

How to determine the "total number of relevant documents" in calculatiion of Recall in Precision and Recall if it's not known? Can it be estimated?

On Wikipedia there is a practical example of calculating Precision and Recall: When a search engine returns 30 pages, only 20 of which are relevant, while failing to return 40 additional relevant ...
Banik's user avatar
  • 131
1 vote
0 answers
32 views

Extracting information from bills, tax statements, etc: What ML model to use?

I have a bunch of documents such as bank statements, utilities bills, personal expenditure invoices, etc. The document types range is very broad. Some of these files are saved as pictures, others as ...
An old man in the sea.'s user avatar
2 votes
0 answers
499 views

Is there a Mean Average Recall for Item Retrieval/ Recommendation Systems?

Mean Average Precision for Information retrieval is computed using Average Precision @ k (AP@k). AP@k is measured by first computing Precision @ k (P@k) and then averaging the P@k only for the k's ...
VaM's user avatar
  • 121
1 vote
0 answers
57 views

Difference between the architectures of semantic and instance segmentation

My question is about the difference between the architectures of semantic segmentation and instance segmentation models. So, as far as I understand, a semantic segmentation model is making pixel-wise ...
The Exile's user avatar
  • 111
0 votes
1 answer
5k views

How to extract details (educational details, exp details etc.) from a resume?

I am trying to build a resume parser which can extract details such as Name, Address, Education details (degree name, college name, university name, course duration), Experience details (designation, ...
SRJ577's user avatar
  • 197
1 vote
1 answer
135 views

Document ranking on a web scraped dataset without any labelled data

I want to create a document ranking model which returns similar rows in the dataset for a sample query. The text in this corpus is standard english but without any labels (ie no query-related ...
sarva's user avatar
  • 11
0 votes
0 answers
30 views

How do I verify and test a machine learning model against reality during time?

As a software engineers we familiar with a concept of testing (unit, integration, e2e) Tests give us a level of confidence about the code and changes in our code. Looks like for ML the "code"...
BogdanSnisar's user avatar
1 vote
0 answers
36 views

Approximate maximum dot product between a vector and set of vectors using only a single vector representation for the latter

If we have a vector $q$ and a set of vectors $D = \{d_1, d_2, ..., d_l\}$ is there a way to create functions $QF$ and $DF$ such that $QF(q)^TDF(D) \approx \max_i(q^Td_i)$ ? Use case: I want to build ...
Curious Ion's user avatar
0 votes
0 answers
21 views

How is a textual search engine able to recognize subwords from words?

I am interested to know how information retrieval systems are able to consider relevant subwords from a main search word when performing a keyword search. For example, the word ...
Darrel's user avatar
  • 1
3 votes
1 answer
123 views

Origin of the Boolean Model of Information Retrieval

Simple question, but I can't really find the answer to that: Who "invented" Boolean Retrieval? Of course, I assume that the concept grew over time, but is there a paper or publication that ...
TiMauzi's user avatar
  • 81
1 vote
1 answer
513 views

What is the difference between Okapi bm25 and NMSLIB?

I was trying to make a search system and then I got to know about Okapi bm25 which is a ranking function like tf-idf. You can make an index of your corpus and later ...
coderina's user avatar
  • 113
0 votes
1 answer
66 views

How to stem plural words properly?

I'm looking for a way to avoid removing ending s when s isn't a suffix. In order to do that, I first check if a word exists in ...
Mahdi Ghajary's user avatar
1 vote
1 answer
65 views

Evaluation of recommendation systems

I have developed a content-based recommendation system and it is working fine. The input is a set of documents={d1,d2,d3,...,dn} and the output will be Top N similar documents for a given document ...
Raj's user avatar
  • 159
3 votes
1 answer
431 views

Evaluation metric for Information retrieval system

I am currently reading Semantic Product Search paper published by Amazon. They are using two evaluation subtasks matching and ranking. In matching, they tune the model hyperparameters to maximize ...
Sayali Sonawane's user avatar
-1 votes
1 answer
30 views

How to find correlated knowledge among different documents? [closed]

Say I have a sequence of documents clicked by a user, how can I mine the identical or semanticly similar word/knowledge/phrases shared among different documents? Maybe someone can give a paper or ...
namespace-Pt's user avatar
1 vote
1 answer
619 views

Using BM25 to rank words

How effective is it to use BM25 to rank words, to be more specific i have a dictionary of words and i want to rank only words in a document that are also in my dictionary. I want to rank all words in ...
voltage's user avatar
  • 41
1 vote
0 answers
688 views

Merging (intersecting) more than two posting list in linear time

The intersecting algorithm for two posting lists implemented below: ...
Mostafa Ghadimi's user avatar
1 vote
0 answers
22 views

Effecient Feature Searching

I have got multiple features(descriptor, vector with elements of natural or real number) from a single image, which need to be searched against many image with multiple features. It is a problem from ...
Krueger's user avatar
  • 111
1 vote
0 answers
89 views

Using transformers for information extraction

Task I am trying to do some information extraction on earnings reports. I am trying to extract certain metrics, e.g. net sales for quarters. The earnings reports differ quite a lot in how they are ...
mr.bjerre's user avatar
  • 111
4 votes
2 answers
839 views

Building a tag-based recommendation engine given a set of user tags?

Basically, the idea is to have users following tags on the site, so each users has a set of tags they are following. And then there is a document collection where each document in the collection has a ...
Wasiim Ouro-sama's user avatar