Plugins and addons

[carelesswhisp]

Hi there guys, wanted to ask if vllm has a plugin or addon repository m? Coming from oogabooga, where there's plugins for various things like deep memory and websearching to add thoae functions. I see the page for plugins on vllm but can't find anything. Is there a list? Am i also misunderstanding vllms use? Thanks.

[hmellor]

I don't know if you've seen https://docs.vllm.ai/en/latest/design/plugin_system.html, but it explains that the vLLM plugins are mainly for supporting custom models and custom devices.

They could technically be used to add capabilities like you mention, but today I am not aware of any that do.

[netanell-duplex]

Hi,
Is this design system works also for V1? or only for V0 ?
What is the best way to add plugin when working with V1?
Thanks!