The Modular Diffusers

[yiyixuxu]

TO-DOs before merge

• We overrode changes in this PR https://github.com/huggingface/diffusers/pull/11652/files, need to make sure the updated code works for this case
• guider needs to be a ConfigMixin
• PAG needs to be a guider on its own
• ModularPipelineBlocks.from_pretrained needs to work with official blocks
• One more guide on how to write a PipelineBlock; and how to assemble SequentialPipelineBlocks ane AutoPipelineBlocks
• a simple test case: slow case for now

Guides

• Getting started with Modular diffusers

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[yoland68]

Very cool!

[oozzy77]

hi this is very interesting! I'm making a Python pipeline flow visual scripting tool, that can auto-convert functions to visual nodes for fast and modular UI blocks demo. Itself is a pip package: https://pypi.org/project/nozyio/

I wanted to integrate diffusers with my flow nodes UI project but found its not very modular. But this PR may change that! Looking forward to see how this evolves.

github: https://github.com/oozzy77/nozyio happy to connect!

[yiyixuxu]

@oozzy77 thanks!
do you want to join a slack channel with me? if you want to experiment building something with this PR I'm eager to hear your feedback and iterate base on that

[oozzy77]

Hi super willing to join slack channel with you! What’s the workspace channel I should join？or you can invite me ***@***.***

…

On Thu, Oct 31, 2024 at 4:59 AM YiYi Xu ***@***.***> wrote: @oozzy77 <https://github.com/oozzy77> thanks! do you want to join a slack channel with me? if you want to experiment building something with this PR I'm eager to hear your feedback and iterate base on that — Reply to this email directly, view it on GitHub <#9672 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BMBK3ZHNSKN56N262LBH3WLZ6FCBNAVCNFSM6AAAAABP5SYMXOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINBYGM3DQMBYGE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[yiyixuxu]

@oozzy77 I sent an invite!