Skip to content

Bug: Anthropic throws unknown model for some models due to missing max tokens clause. #160

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
rjmacarthy opened this issue Mar 4, 2025 · 4 comments · Fixed by #174
Closed

Comments

@rjmacarthy
Copy link
Contributor

The issue is here:

export const getDefaultMaxTokens = (model: string): number => {

The clause does not contain the models for max tokens of 8192.

@szypetike
Copy link

Anthropic models are not working, are you expecting a fix?

@szypetike
Copy link

It says unrecognized model even though the model is clearly in the list.

@szypetike
Copy link

We also tried expanding the model list and that didn't work either for the latest Gemini models. Literally all the models we needed we can't use - 3.5 sonnet 3.7 sonnet or the latest Gemini models...

@rjmacarthy
Copy link
Contributor Author

I accidentally closed my PR, I think it fixed the issues. Also I ended up forking this repository for my own project which has this fix currently too. https://github.com/twinnydotdev/fluency.js

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants