recommenders-team/recommenders
GitHub で見る[ASK] Question on ndcg_at_k calculation
Open
#1,962 opened on 2023年7月24日
help wanted
Repository metrics
- Stars
- (17,706 stars)
- PR merge metrics
- (平均マージ 6d 16h) (30d で 10 merged PRs)
説明
Description
Why are we using rank ('first) to get the order of the ideal ranking instead of rank('min') or rank('average)?
https://github.com/microsoft/recommenders/blob/main/recommenders/evaluation/python_evaluation.py#L687 line 597 df_idcg["irank"] = df_idcg.groupby(col_user, as_index=False, sort=False)[ col_rating ].rank("first", ascending=False)
In this case, if there is a tied in the rating, for example, item A, B, C, D, rating is 1, 0, 0,0. Using rank('first), irank = 1,2,3,4. But should we take the tied condition into consideration, that means the irank = 1,2,2,2?