add swa version

[liubo0902]

add swa version, when using 720p 81 frames, inference time may reduce 30%

test videos

WanVideoWrapper_I2V_00002.mp4

00000008.mp4

WanVideoWrapper_I2V_00005.mp4

WanVideoWrapper_I2V_00006.mp4

[nanwanj]

Hi @liubo0902 , we are interested in this enhancement, however, we don't see inference time reduction when using 14B-Control model with examples/wan2.1_fun/predict_v2v_control.py script. Inference time is same when we set swa=TRUE and swa=FALSE in WanTransformer3DModel init function (https://github.com/aigc-apps/VideoX-Fun/pull/156/files#diff-3a0e419208035f56603399b70631762d9db3a6a4f689cb0088d5750ca480c478R622).

Kindly request to provide some context on how to enable this enhancement. Thanks!