New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

没找到官方的预训练脚本，只用MLM做继续预训练效果如何？ #50

Open

ShadowTeamCN opened this issue Nov 11, 2022 · 1 comment

ShadowTeamCN commented Nov 11, 2022

缺少其他的预训练任务感觉会破坏模型效果

Contributor

Ag2S1 commented Dec 12, 2022

如果你做领域适应的话应该会有效果，前提是数据质量足够好

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment