Skip to main content

Questions tagged [hashing-trick]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2 votes
1 answer
40 views

Is the hashing-trick just a random clustering algorithm when used on e.g user-id?

Say I have 1.000.000 user-ids and I choose to use the (signed) hashing-trick with a hash-vector length of 500.000. Wouldn't that effectively just mean that half of the time, we would have two ...
CutePoison's user avatar
2 votes
1 answer
1k views

AB testing split algorithm

I want to understand what is the most effective algorithm for splitting. I have ids of users and I want to split them into 2 groups. Now I have 2 variants: Modulo approach - let's say we will place ...
AO1992's user avatar
  • 123
2 votes
0 answers
403 views

Hashing trick for dimensionality reduction

I am building a model that uses TF-IDF NLP features in Spark Mllib. The TF-IDF HashingTF function in Mllib uses the 'hashing trick' to efficiently allocate terms to features. My question is: does the ...
John's user avatar
  • 21
1 vote
0 answers
14 views

Appearance-based hashing for similarity detection for picking the 100 most distinct images out 500 images

I would like to perform appearance-based hashing for similarity detection. I have 500 photos for each of my categories but I only want to maintain the 100 of them that are most distinct. How should I ...
Mona Jalal's user avatar
0 votes
1 answer
815 views

RandomizedSearchCV() not scoring all fits

I'm experiencing an issue with a RandomizedSearchCV grid that is not able to evaluate all of the fits. 50 of the 100 fits I'm calling do not get scored (score=nan), so I'm worried I'm wasting a bunch ...
Nick Bohl's user avatar
5 votes
1 answer
1k views

How should I choose n_features in FeatureHasher in sklearn?

How should I choose n_features for FeatureHasher in scikit-learn? Assume that I have 1000 categories in feature "case" and I would like to hash them.
tohid mon's user avatar
4 votes
2 answers
397 views

How to use hashing trick with field-aware factorization machines

Field-aware factorization machines (FFM) have proved to be useful in click-through rate prediction tasks. One of their strengths comes from the hashing trick (feature hashing). When one uses hashing ...
learner's user avatar
  • 359
0 votes
1 answer
3k views

Using scikit-learn FeatureHasher

I have a huge data set with one of the columns named 'mail_id'. The mail_id is given in a very creepy format as shown below: ...
enterML's user avatar
  • 3,041