能否支持根据模型，自定义max_tokens #416

Open

Labels

opened

on Jan 28, 2024

Contributor

通过对接one-api实现了接入其他家大语言模型，但是各家大语言模型对max_tokens限制不同，我看代码里都是统一写死了1024，能不能支持一下自定义？

added

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Participants