Skip to content

Commit e6ee6f7

Browse files
committed
fix: test issues
Signed-off-by: dittops <[email protected]>
1 parent 90d3be8 commit e6ee6f7

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

PolyLingua/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22

33
A production-ready translation service built with **OPEA (Open Platform for Enterprise AI)** components, featuring a modern Next.js UI and microservices architecture.
44

5-
### Components
5+
## Components
66

77
1. **vLLM Service** - High-performance LLM inference engine for model serving
88
2. **LLM Microservice** - OPEA wrapper providing standardized API

PolyLingua/docker-compose.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33

44
services:
55
vllm-service:
6-
image: budstudio/vllm-cpu:0.1.0
6+
image: budstudio/vllm-cpu:0.11.0
77
container_name: vllm-service
88
ports:
99
- "8028:8000"
@@ -23,7 +23,7 @@ services:
2323
volumes:
2424
- "${MODEL_CACHE:-./data}:/root/.cache/huggingface/hub"
2525
shm_size: 1g
26-
command: --model ${LLM_MODEL_ID} --host 0.0.0.0 --port 8000
26+
command: --model ${LLM_MODEL_ID} --host 0.0.0.0 --port 8000 --max-model-len 8192
2727

2828
llm:
2929
image: ${REGISTRY:-opea}/llm-textgen:${TAG:-latest}

0 commit comments

Comments
 (0)