Skip to content

Commit 3ccf76b

Browse files
committed
fix input to deployment framework
Signed-off-by: kta-intel <[email protected]>
1 parent f04ae08 commit 3ccf76b

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

server/text_generation_server/inference_engine/hf_transformers_ipex.py

+1
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ def __init__(
1414
model_path: str,
1515
model_class: type[_BaseAutoModelClass],
1616
dtype: torch.dtype,
17+
quantize: Optional[str],
1718
model_config: Optional[Any]
1819
) -> None:
1920
super().__init__(model_path, model_config)

0 commit comments

Comments
 (0)