Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于性能的建议 #77

Open
YukinoAsuna opened this issue Dec 28, 2023 · 0 comments
Open

关于性能的建议 #77

YukinoAsuna opened this issue Dec 28, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@YukinoAsuna
Copy link

您好,我想询问一下关于模型性能的建议。
在你提供的文件中,BPR,LightGCN,SimGCL在ML-10M的性能如下

Method Recall@10 MRR@10 NDCG@10 Hit@10 Precision@10
BPR 0.1776 0.4187 0.2401 0.7199 0.1779
LightGCN 0.1861 0.4388 0.2538 0.7330 0.1863
SimGCL 0.2029 0.4550 0.2667 0.7640 0.1933
但是在我自己运行的时候得到如下结果
BPR: test result: OrderedDict([('recall@10', 0.2466), ('mrr@10', 0.4895), ('ndcg@10', 0.2928), ('hit@10', 0.7815), ('precision@10', 0.1962)])
LightGCN: test result: OrderedDict([('recall@10', 0.1853), ('mrr@10', 0.376), ('ndcg@10', 0.2116), ('hit@10', 0.6819), ('precision@10', 0.1406)])
SimGCL: test result: OrderedDict([('recall@10', 0.1273), ('mrr@10', 0.1989), ('ndcg@10', 0.1134), ('hit@10', 0.4899), ('precision@10', 0.0692)])
上述结果都与报告结果存在明显差距。
@YukinoAsuna YukinoAsuna added the bug Something isn't working label Dec 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant