Skip to content

Commit 4d3a3f9

Browse files
RPate97RPate97
committed
feat: Support Claude 3.5 models in AWS Bedrock
1 parent b5d8fa6 commit 4d3a3f9

File tree

6 files changed

+1946
-1582
lines changed

6 files changed

+1946
-1582
lines changed

‎.changeset/cold-pugs-cry.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Support Claude 3.5 models in AWS Bedrock

‎docs/providers/anthropic.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ main()
4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| -------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
4343
| claude-3-5-sonnet-20240620 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
44+
| claude-3-5-haiku-20241022 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
4445
| claude-3-opus-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4546
| claude-3-sonnet-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4647
| claude-3-haiku-20240307 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |

‎docs/providers/bedrock.md

Lines changed: 24 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -40,27 +40,30 @@ main()
4040
<!-- compatibility -->
4141
## Supported Models
4242

43-
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44-
| --------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45-
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46-
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47-
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48-
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49-
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
50-
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
51-
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
52-
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
53-
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
54-
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
55-
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56-
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
57-
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
58-
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59-
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60-
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61-
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62-
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63-
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
43+
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44+
| ----------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45+
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47+
| anthropic.claude-3-5-sonnet-20240620-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48+
| anthropic.claude-3-5-sonnet-20241022-v2:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49+
| anthropic.claude-3-5-haiku-20241022-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
50+
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
51+
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
52+
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
53+
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
54+
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
55+
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56+
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
57+
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
58+
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59+
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60+
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61+
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62+
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63+
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
64+
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
65+
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
66+
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
6467

6568
### Legend
6669
| Symbol | Description |

‎package.json

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -28,15 +28,15 @@
2828
"keywords": [],
2929
"license": "MIT",
3030
"dependencies": {
31-
"@anthropic-ai/sdk": "^0.24.3",
32-
"@aws-sdk/client-bedrock-runtime": "^3.609.0",
33-
"@google/generative-ai": "^0.14.1",
34-
"@mistralai/mistralai": "^0.5.0",
31+
"@anthropic-ai/sdk": "0.24.3",
32+
"@aws-sdk/client-bedrock-runtime": "3.609.0",
33+
"@google/generative-ai": "0.14.1",
34+
"@mistralai/mistralai": "0.5.0",
3535
"chalk": "^4.1.2",
36-
"cohere-ai": "^7.10.6",
36+
"cohere-ai": "7.10.6",
3737
"mime-types": "^2.1.35",
3838
"nanoid": "^5.0.7",
39-
"openai": "^4.72.0"
39+
"openai": "4.52.2"
4040
},
4141
"devDependencies": {
4242
"@babel/eslint-parser": "^7.18.2",

0 commit comments

Comments
 (0)