Questions tagged [ndcg]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

Is there a way to compute micro-average for NDCG

I know how both micro and macro averages computed and there is a great discussion of the topic: Micro Average vs Macro average Performance in a Multiclass classification setting The macro-average for ...
1
vote
0answers
16 views

How to use the position factor in known data as a feature in recommendation surfacing?

The problem is recommending stories on a website, just below each story based on how similar the stories are and some historic data based on what recommended stories were clicked or not clicked. So ...
1
vote
0answers
35 views

How to explain a stable NDCG@K in extreme multilabel recommender model

I am working in a multilabel recommender project and I try to evaluate it as a ranking problem. I calculate recall@k and precision@k which both looks quite well. Recall increases and Precision ...
1
vote
1answer
1k views

How to calculate NDCG in recommendation system

This is a question about NDCG, which is a recommendation evaluation metric. The following are being used as evaluation indicators for recommendations. $$DCG = r_1 + \sum\limits_{i=2}^{N}\frac{r_i}{...
0
votes
0answers
46 views

nDCG - choose relevance scores

I am evaluating a recommender system using nDCG. The recommender system predicts similar movies for a given movie. I want to evaluate predicted similarity rankings by comparing them to a ground truth ...
0
votes
1answer
97 views

Fix for NDCG Limitation

One limitation of NDCG and way to overcome the limitation (as mentioned in https://en.wikipedia.org/wiki/Discounted_cumulative_gain#Limitations) is "Normalized DCG does not penalize for missing ...
2
votes
0answers
437 views

Xgboost rank:ndcg learning per group or for all dataset

I'm trying to implement xgboost with an objective of rank:ndcg I want the target to be between 0-3. In my data for most of the groups, there is only 1 event per ...
2
votes
1answer
120 views

What is the difference between nDCG and rank correlation methods?

When do we use one or the other? My use case: I want to evaluate a linear space to see how good retrieval results are. I have a set of data X (m x n) and some weights W (m x 1). I want to measure ...
1
vote
0answers
247 views

NDCG score is greater than 1

I'm solving a problem of ranking classes for each unique id based on the utilization quantity. I have 6 unique classes in the training and test data. My neural net mode predicts the utilization ...