New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] MPO for other mllms #926

Open

jumbo-q opened this issue Feb 25, 2025 · 1 comment

jumbo-q commented Feb 25, 2025

Motivation

根据结构来看好像是用dpo脚本训练internVL的MPO
请问如果是QwenVL的模型是不是不支持有没有什么方法迁移过去

Related resources

No response

Additional context

No response

amoreZgx1n commented Feb 28, 2025

请问你在使用mpo脚本训练的时候，遇到使用自己数据集训练的loss始终为0的情况吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment