Questions tagged [information-retrieval]

Information Retrieval is an area of study concerning with retrieving documents, information or metadata from a collection of unstructured or semi-structured data.

Filter by
Sorted by
Tagged with
2 votes
1 answer
31 views

How "similarity" is measured in image retrieval?

I know what content based image retireval is. I have read this and this as one of them says: "given a query images, get a rank list that are most similar to the query image, based on the content ...
user avatar
  • 121
1 vote
1 answer
14 views

How to determine the "total number of relevant documents" in calculatiion of Recall in Precision and Recall if it's not known? Can it be estimated?

On Wikipedia there is a practical example of calculating Precision and Recall: When a search engine returns 30 pages, only 20 of which are relevant, while failing to return 40 additional relevant ...
user avatar
  • 11
1 vote
0 answers
12 views

Extracting information from bills, tax statements, etc: What ML model to use?

I have a bunch of documents such as bank statements, utilities bills, personal expenditure invoices, etc. The document types range is very broad. Some of these files are saved as pictures, others as ...
user avatar
2 votes
0 answers
33 views

Is there a Mean Average Recall for Item Retrieval/ Recommendation Systems?

Mean Average Precision for Information retrieval is computed using Average Precision @ k (AP@k). AP@k is measured by first computing Precision @ k (P@k) and then averaging the P@k only for the k's ...
user avatar
  • 21
1 vote
0 answers
24 views

Difference between the architectures of semantic and instance segmentation

My question is about the difference between the architectures of semantic segmentation and instance segmentation models. So, as far as I understand, a semantic segmentation model is making pixel-wise ...
user avatar
0 votes
1 answer
592 views

How to extract details (educational details, exp details etc.) from a resume?

I am trying to build a resume parser which can extract details such as Name, Address, Education details (degree name, college name, university name, course duration), Experience details (designation, ...
user avatar
  • 177
0 votes
0 answers
12 views

Find business vertical of a website just by its URL or cluster similar website by its url

I have been exploring this problem a lot about just using the website url to tag or cluster them as per their business domain. For example: ...
user avatar
1 vote
1 answer
56 views

Document ranking on a web scraped dataset without any labelled data

I want to create a document ranking model which returns similar rows in the dataset for a sample query. The text in this corpus is standard english but without any labels (ie no query-related ...
user avatar
  • 11
0 votes
0 answers
27 views

How do I verify and test a machine learning model against reality during time?

As a software engineers we familiar with a concept of testing (unit, integration, e2e) Tests give us a level of confidence about the code and changes in our code. Looks like for ML the "code"...
user avatar
1 vote
0 answers
28 views

Approximate maximum dot product between a vector and set of vectors using only a single vector representation for the latter

If we have a vector $q$ and a set of vectors $D = \{d_1, d_2, ..., d_l\}$ is there a way to create functions $QF$ and $DF$ such that $QF(q)^TDF(D) \approx \max_i(q^Td_i)$ ? Use case: I want to build ...
user avatar
0 votes
0 answers
19 views

How is a textual search engine able to recognize subwords from words?

I am interested to know how information retrieval systems are able to consider relevant subwords from a main search word when performing a keyword search. For example, the word ...
user avatar
  • 1
0 votes
0 answers
7 views

Search / Multiple Choice System evaluation

I have a DB with N items. My system can output an ID for the item or say N/A (not found). What are different ways to evaluate the performance of such system, and what are the characteristics/tradeoffs ...
user avatar
0 votes
0 answers
26 views

Evaluate scoring algorithm

I have several large datasets (100k samples) with label 1 / 0 and scoring algorithms that should score each sample, after the scoring of the dataset I sort it by the score. I would like to evaluate ...
user avatar
  • 273
3 votes
1 answer
87 views

Origin of the Boolean Model of Information Retrieval

Simple question, but I can't really find the answer to that: Who "invented" Boolean Retrieval? Of course, I assume that the concept grew over time, but is there a paper or publication that ...
user avatar
  • 81
1 vote
1 answer
203 views

What is the difference between Okapi bm25 and NMSLIB?

I was trying to make a search system and then I got to know about Okapi bm25 which is a ranking function like tf-idf. You can make an index of your corpus and later ...
user avatar
  • 113
0 votes
1 answer
24 views

How to stem plural words properly?

I'm looking for a way to avoid removing ending s when s isn't a suffix. In order to do that, I first check if a word exists in ...
user avatar
1 vote
1 answer
38 views

Evaluation of recommendation systems

I have developed a content-based recommendation system and it is working fine. The input is a set of documents={d1,d2,d3,...,dn} and the output will be Top N similar documents for a given document ...
user avatar
  • 149
3 votes
1 answer
66 views

Evaluation metric for Information retrieval system

I am currently reading Semantic Product Search paper published by Amazon. They are using two evaluation subtasks matching and ranking. In matching, they tune the model hyperparameters to maximize ...
user avatar
-1 votes
1 answer
26 views

How to find correlated knowledge among different documents? [closed]

Say I have a sequence of documents clicked by a user, how can I mine the identical or semanticly similar word/knowledge/phrases shared among different documents? Maybe someone can give a paper or ...
user avatar
1 vote
1 answer
158 views

Using BM25 to rank words

How effective is it to use BM25 to rank words, to be more specific i have a dictionary of words and i want to rank only words in a document that are also in my dictionary. I want to rank all words in ...
user avatar
  • 31
1 vote
0 answers
158 views

Merging (intersecting) more than two posting list in linear time

The intersecting algorithm for two posting lists implemented below: ...
user avatar
1 vote
0 answers
22 views

Effecient Feature Searching

I have got multiple features(descriptor, vector with elements of natural or real number) from a single image, which need to be searched against many image with multiple features. It is a problem from ...
user avatar
  • 111
1 vote
0 answers
38 views

Using transformers for information extraction

Task I am trying to do some information extraction on earnings reports. I am trying to extract certain metrics, e.g. net sales for quarters. The earnings reports differ quite a lot in how they are ...
user avatar
  • 111
3 votes
2 answers
551 views

Building a tag-based recommendation engine given a set of user tags?

Basically, the idea is to have users following tags on the site, so each users has a set of tags they are following. And then there is a document collection where each document in the collection has a ...
user avatar
1 vote
1 answer
21 views

Domain scoring based on ranking

I am a computer science student working on a small information retrieval project. I have a dictionary with a domain as a key and it's ranking as value. Based on that ranking, I need to score every ...
user avatar
  • 11
4 votes
1 answer
101 views

Visualizing F-score differences in information extraction

I have several corpora and NLP systems (including a few merge ensembles of output of these systems combined in unions and intersections) with which I have extracted the annotation span sets {(begin, ...
user avatar
1 vote
0 answers
165 views

Meaningful Information retrieval and question answering for unstructured data - Is it even possible?

Hello good NLP people, I am working on a task that gradually seems not solvable for me. My data-set consists of long, messy, unstructured documents (pdfs, doc, docx, scans with tables, graphs, text, ...
user avatar
  • 101
3 votes
1 answer
122 views

Evaluating a IR system (Precision and Recall)

I am studying by now IR system, in the field of valuation of IR system outputs related to a specific query but I need some help to understand it properly. My book states that when an IR system has ...
user avatar
9 votes
1 answer
2k views

How can you build a model that extracts data out from receipts?

I'm trying to build a model that is capable of identifying information on receipts and invoices. I have used google cloud vision api for text extraction from the receipt but the problem is it just ...
user avatar
  • 327
4 votes
1 answer
60 views

How is "relevance" defined in information retrieval outside the context of systems with user feedback?

I've seen information retrieval systems that return some results from a query, and then the user rates these results as either "relevant" or "not relevant". What can you do if you do not have user ...
user avatar
  • 53
5 votes
1 answer
90 views

Evaluating the performance of a machine learned recommendation system

I have a set of resumes $R=\{{r_1,...,r_n\}}$, which I've transformed to a vector space using TF-IDF. Each resume has a label, which is the name of their current employer. Each of these labels comes ...
user avatar
  • 437
1 vote
0 answers
20 views

Populating Knowledge Base - Stanford DeepMind Alternatives

I am dealing with the task to extract structured information from domain-specific unstructured documents. The end goal is to obtain a reliable, queryable system, i.e. in the form of a chat-bot or ...
user avatar
  • 101
1 vote
0 answers
1k views

Connecting to IEX with Pandas Datareader

My Problem is regarding Algorythmic trading. I hope this is the right site for this kind of Question. In specific I try to connect to the "iex" API via the pandas Data reader to retrieve some ...
user avatar
  • 181
4 votes
1 answer
596 views

TS-SS and Cosine similarity among text documents using TF-IDF in Python

A common way of calculating the cosine similarity between text based documents is to calculate tf-idf and then calculating the linear kernel of the tf-idf matrix. TF-IDF matrix is calculated using ...
user avatar
1 vote
1 answer
129 views

Information Extraction/Semantic Search for long, unstructured documents

I am stuck with a particular task of information extraction. I have a few hundred, long (5-35 pages) pdf, doc and docx project documents from which I seek to extract specific information and store ...
user avatar
  • 101
0 votes
1 answer
74 views

Is it possible to create a rule-based algorithm to compute the relevance score of question-answer pair?

In information retrieval or question answering system, we use TD-IDF or BM25 to compute the similarity score of question-question pair as the baseline or coarse ranking for deep learning. In ...
user avatar
  • 561
1 vote
1 answer
282 views

Getting answers to bullets (numbered items) from text via NLP

This is related to information extraction. In real world data, documents are written in bullets/numbered items form. For example, ...
user avatar
1 vote
1 answer
65 views

Why TREC set two task: document ranking and passage ranking

TREC is https://microsoft.github.io/TREC-2019-Deep-Learning/ I am new to text retrieval. Still can not understand why set the two similar task. Thank you very much.
user avatar
  • 561
1 vote
2 answers
98 views

Intuition behind the entropy definition

The definition of information entropy is defined below: This looks fine but I got no intuition why it is defined this way. Could any one share their ideas on this? Thanks!
user avatar
  • 2,465
1 vote
1 answer
464 views

Find specific topics with topic modelling

I am looking for a way to classifiy text automatically by specific topics, i don´t have labeled data. Is this a possible/usual method of achieving this? If not, what would be better? Topic Modelling ...
user avatar
0 votes
2 answers
80 views

Targeted information extraction / focused extractive summarization

I have a large collection of project manuals, each with a large number of pages. Each manual contains some form of summary paragraphs, although these are not necessarily similar in structure or format ...
user avatar
  • 3
2 votes
0 answers
98 views

Text Mining with Pubmed Widget Orange

When I was running the text mining I did not have an issue for 57 different searches. I was able to retrieve all of the records regardless of how many there were. Until these 2 errors popped up. I ...
user avatar
4 votes
4 answers
469 views

Best way to combine two similar document

I have f.ex.: two news-articles that report the same event. However, these two text are similar BUT not the same. I would like to combine these two texts creating one text that contains only the most "...
user avatar
  • 187
0 votes
1 answer
44 views

Dissimilarity Matrix of non-metric proximity data

we currently have a coding exercise, where we are asked to implement Constant Shift Embedding (Paper). This in itself is not a big problem. For the algorithm, all you need is a symmetric non-zero ...
user avatar
  • 1
2 votes
1 answer
240 views

How to implement Semantic Search in R or Python

I have a task to provide semantic searching capabilities. For example, if I have a dataset of resume and if I search for "machine learning" than it should return me all resumes which have data science-...
user avatar
1 vote
0 answers
555 views

Doc2vec most similar document to a query string

I'm working on a project and I created doc2vec representation of different academics which include their patents and publications etc. For each publication and patent I have information such as title ...
user avatar
  • 11
4 votes
1 answer
1k views

Detect sensitive data from unstructured text documents [closed]

I know this question is broad, but I need an advice to know if it's possible to achieve what I want to do. The problem is that I have around 2500 documents with sensitive data being replaced by four ...
user avatar
2 votes
1 answer
807 views

Can macro F1 score be greater than micro F1 score?

I am reading about evaluation metrics, and it seems that micro scores are more useful. But I was wondering about scenarios where macro F1 score is greater than micro F1 score, and if this is at all ...
user avatar
1 vote
1 answer
1k views

Word embeddings for Information Retrieval - Document search?

What are good ways to find for single sentence (query) the most similiar document (text). I asked myself if word vectors (weighted average of the documents) are suitable to map a single sentence to a ...
user avatar
  • 183
1 vote
1 answer
111 views

Algorithm for document retrieval in QA system

I am working with question answering and machine reading comprehension system. I want to match questions and documents (around 100,000 docs) in database. I've used tf-idf but it accuracy is about 55% ...
user avatar