[Feature]: any way to config the prefix of chatcmpl-tool?

[elvizlai]

🚀 The feature, motivation and pitch

When using vllm generated tool_call message, then send the response to OpenAI, it report:

messages[2].tool_calls[0].id': string too long. Expected a string with maximum length 40, but got a string with 
length 46 instead.

This because of the random_tool_id using format: chatcmpl-tool-{uuid}, any way to config the prefix?

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[chaunceyjiang]

Can you try this and see if #21009 meets your needs?

[elvizlai]

Maybe not solved. The problem I met was tool id too long, not message id.

I modify the code

vllm/vllm/entrypoints/chat_utils.py

Line 1349 in 0e3bb54

return f"chatcmpl-tool-{random_uuid()}"

changing from chatcmpl-tool- to call_ solved my problem.