Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

T5 like encoder-decoder model support #668

Closed
XiangmingWang opened this issue Aug 3, 2023 · 2 comments
Closed

T5 like encoder-decoder model support #668

XiangmingWang opened this issue Aug 3, 2023 · 2 comments
Labels
feature request New feature or request

Comments

@XiangmingWang
Copy link

XiangmingWang commented Aug 3, 2023 •
edited
Loading

vllm is a great open source project and we are looking forward to running the T5 model with vllm.I know there is a plan for T5 in the roadmap, but I still want to know, is there an approximate time for this? Or can there be a specific encoder-decoder code structure, and then everyone will work together to contribute
@zhuohan123 zhuohan123 mentioned this issue Aug 7, 2023
Closed
76 tasks
@zhuohan123 zhuohan123 added the feature request New feature or request label Aug 7, 2023
@shermansiu
Copy link

Yes. See #187. It's also on the dev roadmap (#244).

@hmellor
Copy link
Member

hmellor commented Mar 6, 2024

Closing as duplicate of #187

@hmellor hmellor closed this as completed Mar 6, 2024
pi314ever pushed a commit to pi314ever/vllm that referenced this issue Jan 9, 2025
@kdamaszk
Add mllama support to benchmark_throughput (vllm-project#668)
8f53dee
@hmellor hmellor closed this as completed Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@XiangmingWang @shermansiu @zhuohan123 @hmellor