Questions tagged [indexing]

Indexing is the almost most important part of data to get an efficient, properly storing and retrieval data from mediums

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Utility of using a Primary Index in a relational dbms

If the records stored in each block are ordered by the primary key, what is the vantage of using a primary index? In fact, without a primary index, I still can do a binary search: taking the block in ...
0
votes
0answers
15 views

Vector de-factorization

Suppose one has a data set with a column/vector which consists of factor-like character strings: ["a level", "b value", "c bound", "a level", ...] For conversion ...
0
votes
0answers
8 views

Implementing Data Catalog from scratch

I have a requirement of ingesting huge amount of user specific data and then searching on it. Trying to be low cost solution, I am leaning towards creating Kafka based ingestion pipelines and ...
0
votes
1answer
2k views

How to create dictionary with multiple keys from dataframe in python?

I have a pandas dataframe as follows, I want to convert it to a dictionary format with 2 keys as shown: ...
2
votes
1answer
64 views

Pandas dataframe with multiple hierarchical indices

I have a data frame which looks like this ...
2
votes
2answers
104 views

Pandas: Assign back to table from grouping by column and index

I am trying to implement Exponential Moving Average calculation on a DataFrame. The formula is An additional complication is that my table is grouped and there is ...
1
vote
1answer
7k views

How to resolve too many indices for array Index Error

I'm performing a binary classification in Keras and attempting to plot the ROC curves. When I tried to compute the fpr and tpr metrics, I get the "too many indices for array" error. Here is my code: <...
3
votes
1answer
5k views

convert single index pandas data frame to multi-index

I have a data frame with following structure: ...
8
votes
2answers
14k views

Counting indexes in pandas

I feel like this is a rudimentary question but I'm very new to this and just haven't been able to crack it / find the answer. Ultimately what I'm trying to do here is to count unique values on a ...
4
votes
1answer
431 views

Why keep vocabulary and posting list separate in a search engine

I am taking a class in information retrieval. We learned that the index of a search engine has (possibly among other things): A vocabulary mapping terms to their statistics (frequency, type, ...) and ...
1
vote
1answer
26 views

Index for efficient argmax(w.x) query ~ 20d

I'm looking for a spatial index that can efficiently find the most extreme n points in a certain direction, i.e. for a given w, find x[0:n] in the dataset where x0 gives the largest value of w.x and ...
10
votes
1answer
763 views

What is the most efficient data indexing technique

As we all know, there are some data indexing techniques, using by well-known indexing apps, like Lucene (for java) or Lucene.NET (for .NET), MurMurHash, B+Tree etc. For a No-Sql / Object Oriented ...