Questions tagged [indexing]

Indexing is the almost most important part of data to get an efficient, properly storing and retrieval data from mediums

Filter by
Sorted by
Tagged with
0 votes
1 answer
31 views

Finding the labels of a shuffled pandas dataframe

I have a dataframe (namely 'original') with over a thousand numerical columns as features and one label column. I also have a shuffled version of the same dataframe (namely 'shuffled') with label ...
asmani's user avatar
  • 101
0 votes
0 answers
93 views

Amazon Kendra's performance on data rich in text vs data rich in numbers

I used Amazon's Kendra to build a semantic search engine. I took 2 datasets for this task - csv & excel. The csv dataset is mostly text. The excel dataset is mostly numbers. The data to be used is ...
Apoorva's user avatar
  • 275
-2 votes
2 answers
46 views

Why the numbers 6 and 8 not selected when indexing this numpy array?

In the below code why the numbers 6 and 8 not selected? ...
Rahul's user avatar
  • 1
1 vote
1 answer
612 views

The difference between Faiss Index and a Database Index

An index points to data in a table. In a database, indexes are similar to those in books. I am a little bit confused about the meaning of index in Faiss library and how it's different from the one in ...
Avv's user avatar
  • 231
1 vote
0 answers
61 views

How does google indexes text documents?

Unfortunately, I didn't find much information surrounding this, no pdfs, no textbooks that discuss this in just enough detail. And I didn't see any forums posts about this. I just want to learn an ...
jewloa's user avatar
  • 11
1 vote
0 answers
121 views

How to solve this IndexError? [closed]

I have created a training dataframe Traindata as following: dataFile='/content/drive/Colab Notebooks/.../Normal_Anomalous_8Digits.csv' data8=pd.read_csv(dataFile) ...
TariqS's user avatar
  • 21
0 votes
1 answer
48 views

Block matrix indexing

Hello this might be a stupid question but i need some help indexing a Matlab matrix consisting of several sub-matrices. ...
Frank Ch's user avatar
2 votes
1 answer
57 views

Tiering after clustering with Kmeans

I would like to have some suggestions on possible avenues that would make sense in the following context. 3 Optimal clusters have been identified in a 5000 list of customers using Kmeans Data model ...
Roger Steinberg's user avatar
0 votes
2 answers
4k views

Replacing rows of dataframe with rows of another dataframe that have the same index

I have a dataframe that has rows with indices 0 to 128 and a smaller dataframe with indices 4, 8, 105, and 107. I made edits to the rows in the smaller dataframe and am now trying to replace rows ...
Davis's user avatar
  • 1
0 votes
0 answers
34 views

Equitable selection of users through ranking

I am looking to take a dataset largely derived of user input in categorical form, this sign up sheet asks for many data points such as age group, race, sign up date, as well as a few others. My goal ...
ShoDaKhan's user avatar
0 votes
1 answer
57 views

How to stem plural words properly?

I'm looking for a way to avoid removing ending s when s isn't a suffix. In order to do that, I first check if a word exists in ...
Mahdi Ghajary's user avatar
1 vote
0 answers
39 views

Book indexing data science project [closed]

Is it possible to perform Book index searching using Machine learning algorithms? Inputs : 1 Book pages with page numbers as images. 2 Index words in the book. Output: Tracing the page number/s with ...
Prashant Akerkar's user avatar
1 vote
0 answers
8 views

Primary indexes [closed]

I would like to ask you two questions about indexing: 1) Since a primary index, or clustering index, stores the tuples of a relation in the primary index itself (but primary index might also be ...
Angelo Giannuzzi's user avatar
1 vote
0 answers
60 views

Primary indexes and index-sequential files

I am studying the physical organization of databases and right now I trying to understand the concept of primary index or clustering index. The book states the primary index can be realized by storing ...
Angelo Giannuzzi's user avatar
1 vote
1 answer
24k views

How to create dictionary with multiple keys from dataframe in python?

I have a pandas dataframe as follows, I want to convert it to a dictionary format with 2 keys as shown: ...
KHAN irfan's user avatar
4 votes
1 answer
277 views

Pandas dataframe with multiple hierarchical indices

I have a data frame which looks like this ...
Phil's user avatar
  • 73
2 votes
2 answers
620 views

Pandas: Assign back to table from grouping by column and index

I am trying to implement Exponential Moving Average calculation on a DataFrame. The formula is An additional complication is that my table is grouped and there is ...
Steztric's user avatar
  • 181
1 vote
1 answer
27k views

How to resolve too many indices for array Index Error

I'm performing a binary classification in Keras and attempting to plot the ROC curves. When I tried to compute the fpr and tpr metrics, I get the "too many indices for array" error. Here is my code: <...
shiva's user avatar
  • 311
3 votes
1 answer
8k views

convert single index pandas data frame to multi-index

I have a data frame with following structure: ...
Rakib's user avatar
  • 205
11 votes
2 answers
23k views

Counting indexes in pandas

I feel like this is a rudimentary question but I'm very new to this and just haven't been able to crack it / find the answer. Ultimately what I'm trying to do here is to count unique values on a ...
Mr. Hasquestions's user avatar
4 votes
1 answer
556 views

Why keep vocabulary and posting list separate in a search engine

I am taking a class in information retrieval. We learned that the index of a search engine has (possibly among other things): A vocabulary mapping terms to their statistics (frequency, type, ...) and ...
icehawk's user avatar
  • 141
1 vote
1 answer
40 views

Index for efficient argmax(w.x) query ~ 20d

I'm looking for a spatial index that can efficiently find the most extreme n points in a certain direction, i.e. for a given w, find x[0:n] in the dataset where x0 gives the largest value of w.x and ...
user1158559's user avatar
10 votes
1 answer
1k views

What is the most efficient data indexing technique

As we all know, there are some data indexing techniques, using by well-known indexing apps, like Lucene (for java) or Lucene.NET (for .NET), MurMurHash, B+Tree etc. For a No-Sql / Object Oriented ...
sihirbazzz's user avatar