recommenders-team/recommenders
GitHub で見る[ASK] Running evaluation on test set for DKN
Open
#1,807 opened on 2022年8月4日
help wanted
Repository metrics
- Stars
- (17,706 stars)
- PR merge metrics
- (平均マージ 6d 16h) (30d で 10 merged PRs)
説明
Description
I've have been using DKN Deep Dive, but I wanted to add evaluation on the test data. When I run model.run_eval(test_file) I am getting an error. I believe this is because the test data has users that are not present in the training data.
I am using the small MIND dataset. But I split my training, validation and test data a little differently. Training is all of the small training data but the last day. Validation is the last day of the small training data Test is all of the small validation data.
Is this the expected behavior?