Skip to content

Commit 62d2ac3

Browse files
RPate97RPate97
authored
Merge pull request #118 from token-js/pate/new-models
feat: New model support
2 parents 0df1012 + 4d3a3f9 commit 62d2ac3

File tree

10 files changed

+5209
-5648
lines changed

10 files changed

+5209
-5648
lines changed

‎.changeset/cold-pugs-cry.md

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Support Claude 3.5 models in AWS Bedrock

‎.changeset/healthy-bikes-switch.md

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Support o1-preview and o1-mini

‎.changeset/heavy-pets-carry.md

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Support gemini-1.5-flash-8b

‎docs/providers/anthropic.md

+1
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ main()
4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| -------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
4343
| claude-3-5-sonnet-20240620 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
44+
| claude-3-5-haiku-20241022 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
4445
| claude-3-opus-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4546
| claude-3-sonnet-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4647
| claude-3-haiku-20240307 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |

‎docs/providers/bedrock.md

+24-21
Original file line numberDiff line numberDiff line change
@@ -40,27 +40,30 @@ main()
4040
<!-- compatibility -->
4141
## Supported Models
4242

43-
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44-
| --------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45-
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46-
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47-
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48-
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49-
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
50-
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
51-
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
52-
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
53-
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
54-
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
55-
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56-
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
57-
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
58-
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59-
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60-
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61-
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62-
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63-
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
43+
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44+
| ----------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45+
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47+
| anthropic.claude-3-5-sonnet-20240620-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48+
| anthropic.claude-3-5-sonnet-20241022-v2:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49+
| anthropic.claude-3-5-haiku-20241022-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
50+
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
51+
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
52+
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
53+
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
54+
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
55+
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56+
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
57+
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
58+
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59+
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60+
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61+
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62+
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63+
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
64+
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
65+
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
66+
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
6467

6568
### Legend
6669
| Symbol | Description |

‎docs/providers/gemini.md

+6-5
Original file line numberDiff line numberDiff line change
@@ -38,11 +38,12 @@ main()
3838
<!-- compatibility -->
3939
## Supported Models
4040

41-
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
42-
| ---------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| gemini-1.5-pro | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
44-
| gemini-1.5-flash | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
45-
| gemini-1.0-pro | ✅ | ✅ | ➖ | ➖ | ✅ | ✅ |
41+
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
42+
| ------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43+
| gemini-1.5-pro | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
44+
| gemini-1.5-flash | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
45+
| gemini-1.5-flash-8b | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
46+
| gemini-1.0-pro | ✅ | ✅ | ➖ | ➖ | ✅ | ✅ |
4647

4748
### Legend
4849
| Symbol | Description |

‎docs/providers/openai.md

+4
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,10 @@ main()
6363
| gpt-3.5-turbo-1106 | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ |
6464
| gpt-3.5-turbo-0125 | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ |
6565
| gpt-3.5-turbo-16k-0613 | ✅ | ✅ | ➖ | ➖ | ➖ | ✅ |
66+
| o1-mini | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
67+
| o1-mini-2024-09-12 | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
68+
| o1-preview | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
69+
| o1-preview-2024-09-12 | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
6670

6771
### Legend
6872
| Symbol | Description |

‎package.json

+6-6
Original file line numberDiff line numberDiff line change
@@ -28,15 +28,15 @@
2828
"keywords": [],
2929
"license": "MIT",
3030
"dependencies": {
31-
"@anthropic-ai/sdk": "^0.24.3",
32-
"@aws-sdk/client-bedrock-runtime": "^3.609.0",
33-
"@google/generative-ai": "^0.14.1",
34-
"@mistralai/mistralai": "^0.5.0",
31+
"@anthropic-ai/sdk": "0.24.3",
32+
"@aws-sdk/client-bedrock-runtime": "3.609.0",
33+
"@google/generative-ai": "0.14.1",
34+
"@mistralai/mistralai": "0.5.0",
3535
"chalk": "^4.1.2",
36-
"cohere-ai": "^7.10.6",
36+
"cohere-ai": "7.10.6",
3737
"mime-types": "^2.1.35",
3838
"nanoid": "^5.0.7",
39-
"openai": "^4.52.2"
39+
"openai": "4.52.2"
4040
},
4141
"devDependencies": {
4242
"@babel/eslint-parser": "^7.18.2",

0 commit comments

Comments
 (0)