I train h3 on 768p 10s videos with 9 reference images using parameter here:
--height 1344
--width 768
--num_frames 243 \
using 4*8h100 (84G memory), I get oom error. So I am curious about that one sample is very large, and should be splitted into different gpus with sequence parallel? I am not sure whether it supports sequence or context paralle.
I train h3 on 768p 10s videos with 9 reference images using parameter here:
--height 1344
--width 768
--num_frames 243 \
using 4*8h100 (84G memory), I get oom error. So I am curious about that one sample is very large, and should be splitted into different gpus with sequence parallel? I am not sure whether it supports sequence or context paralle.