Skip to content

Commit de906b9

Browse files
authored
[Bugfix] Fix for the condition to accept empty encoder inputs for mllama (vllm-project#17732)
Signed-off-by: Gregory Shtrasberg <[email protected]>
1 parent d456aea commit de906b9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/engine/llm_engine.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -2021,7 +2021,7 @@ def _validate_model_input(
20212021
if not prompt_ids:
20222022
if prompt_type == "encoder" and model_config.is_multimodal_model:
20232023
pass # Mllama may have empty encoder inputs for text-only data
2024-
if prompt_inputs["type"] == "embeds":
2024+
elif prompt_inputs["type"] == "embeds":
20252025
pass
20262026
else:
20272027
raise ValueError(f"The {prompt_type} prompt cannot be empty")

0 commit comments

Comments
 (0)