Frame selection question

[paul-lupu]

Hello,

What happens if you do a head select of [1,150,200] but one of the videos in the dataset only has 124 frames?

Is it still picked up?

I'm trying with very scaled down videos so that allows me to potentially load a lot more frames.

[Sarania]

IIRC it just skips processing that latent if it's impossible to create. So for the shorter video you'd likely only get the 1 bucket latent, but not the 150 or 200. It's simple enough to just put it in a separate directory and list it separately with a more appropriate frame bucket length:

[general]
caption_extension = ".txt"
enable_bucket = true
bucket_no_upscale = false
batch_size = 1
frame_extraction = "head"
resolution = [480, 272]

[[datasets]]
video_directory = "/home/blyss/projects/art/extra/dataset/"
cache_directory = "/home/blyss/projects/art/extra/dataset/"
target_frames = [1, 150, 200]

[[datasets]]
video_directory = "/home/blyss/projects/art/extra/short_dataset/"
cache_directory = "/home/blyss/projects/art/extra/short_dataset/"
target_frame = [1, 73, 121]

That's what I do in this scenario. Note ideally frame lengths should be a multiple of 4 +1, I think Musubi internally adjusts to that anyway though.