Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

real_learner_bart_CGEC_exam.pt在MuCGEC test上无法对齐 #11

Open
zxyucas opened this issue Nov 17, 2023 · 6 comments
Open

real_learner_bart_CGEC_exam.pt在MuCGEC test上无法对齐 #11

zxyucas opened this issue Nov 17, 2023 · 6 comments

Comments

@zxyucas
Copy link

zxyucas commented Nov 17, 2023

你好，我这边在real_learner_bart_CGEC_exam.pt上测试MuCGEC test集 F0.5是40.67,为什么对不上论文里的45.68
@HillZhang1999
Copy link
Owner

参考MuCGEC的原论文，需要注意是先分句纠正再合并，这一个小trick对模型性能影响比较大。

@zxyucas
Copy link
Author

zxyucas commented Nov 21, 2023

依据MuCGEC中的predict.py里先分句再合并，达到41.28，还是无法对齐论文里的45.68

@HillZhang1999
Copy link
Owner

具体precison/recall是多少呢

@zxyucas
Copy link
Author

zxyucas commented Nov 22, 2023

具体precison/recall是多少呢

NaCGEC
参考第一行

@HillZhang1999
Copy link
Owner

请问你是什么版本跑的，transformers还是fairseq?

@HillZhang1999
Copy link
Owner

论文中的结果是beam search的结果，不是greedy decoding，也需要注意

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@HillZhang1999 @zxyucas