Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training Hunyuan Video Checkpoint Finetuning #98

Open
aperire opened this issue Feb 24, 2025 · 4 comments
Open

Training Hunyuan Video Checkpoint Finetuning #98

aperire opened this issue Feb 24, 2025 · 4 comments

Comments

@aperire
Copy link

aperire commented Feb 24, 2025

Hi, are there any finetune scripts or resources for Hunyuan video? It would be a similar format to existing sd-scripts for Flux and SD. Let me know if it is in progress or already exists, thanks!

@Sarania
Copy link

Sarania commented Feb 25, 2025

Do you mean full fine tuning? At least that I'm aware of, none of the training projects so far support full fine tuning. Both Musubi Tuner(this project) and Diffusion Pipe (https://github.com/tdrussell/diffusion-pipe) support training LORA for HunyuanVideo but not yet full fine tunes. I expect that at some point in the future there will be a way to do so.

Edit: Incorrect, see below!

@aperire
Copy link
Author

aperire commented Feb 25, 2025

I see, this also applies for merging lora to checkpoints, right?

@Sarania
Copy link

Sarania commented Feb 25, 2025

Merging LoRAs to checkpoints can be done in a couple of ways. I've read of people doing it directly in ComfyUI ( https://civitai.com/models/1237378/huncusvid?modelVersionId=1394503 has a workflow example) and also Musubi Tuner comes with a merge_lora.py capable of doing the same. Can read a bit more: #45

@sdbds
Copy link
Contributor

sdbds commented Feb 26, 2025

https://github.com/sdbds/musubi-tuner-scripts
This project has supported full-parameters fine-tuning for hunyuanVideo model long ago .
If you are not very familiar with the command line, you can use this script tool.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants