fix #14063 for Kandinsky5 pipeline load with device_map=balanced#14050

dg845 merged 2 commits into

huggingface:mainhuggingface/diffusers:mainfrom

kaixuanliu:kandinsky5_fixkaixuanliu/diffusers:kandinsky5_fixCopy head branch name to clipboard