How to load a ckpt or safetensor file directly using StableDiffusionControlNetImg2ImgPipeline ?
Activity
patrickvonplaten commentedon Jul 4, 2023
Think for now we have to manually convert and load with
from_pretrained
. More than happy to accept a pull request working on this though!0sparsh2 commentedon Jul 5, 2023
I was trying out a similar pipeline, ControlNetInpaint
Over there the following steps worked for me, you can try the same ->
It worked for me
WhiteWolf47 commentedon Jul 6, 2023
@patrickvonplaten wdym by "manually convert and load with from_pretrained"? Can you please give an example if i have .ckpt file of the model!
patrickvonplaten commentedon Jul 12, 2023
@yiyixuxu maybe you can check this as well (should be the same PR / mechanism): #2584
patrickvonplaten commentedon Jul 13, 2023
And another one: #3722
Seems like we can close three issues with one pull request:
patrickvonplaten commentedon Jul 13, 2023
And another one: #4052 - wow this is a wanted feature!
patrickvonplaten commentedon Jul 13, 2023
@yiyixuxu let me take this as you're already on a bunch of other issues :-)
patrickvonplaten commentedon Jul 18, 2023
Hey @thenol,
Can you check if this works for you: #4084
EmilioNicolas commentedon Jul 19, 2023
Thanks @patrickvonplaten for the PR that's looking great, but meanwhile as I am working with REPLICATE-COG and sticking to new releases of the library, how could I load a CKPT file for a stable_diffusion_controlnet_img2img? Should I follow this? https://huggingface.co/docs/diffusers/v0.18.2/en/using-diffusers/other-formats#pytorch-ckpt
patrickvonplaten commentedon Jul 19, 2023
Hey @EmilioNicolas,
You can load
.ckpt
files also with thefrom_single_file(...)
function