Skip to content

Commit d05aef0

Browse files
RPate97RPate97
committed
feat: Support Claude 3.5 models in AWS Bedrock
1 parent b5d8fa6 commit d05aef0

File tree

4 files changed

+44
-21
lines changed

4 files changed

+44
-21
lines changed

‎.changeset/cold-pugs-cry.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Support Claude 3.5 models in AWS Bedrock

‎docs/providers/anthropic.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,7 @@ main()
4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| -------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
4343
| claude-3-5-sonnet-20240620 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
44+
| claude-3-5-haiku-20241022 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
4445
| claude-3-opus-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4546
| claude-3-sonnet-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
4647
| claude-3-haiku-20240307 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |

‎docs/providers/bedrock.md

Lines changed: 24 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -40,27 +40,30 @@ main()
4040
<!-- compatibility -->
4141
## Supported Models
4242

43-
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44-
| --------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45-
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46-
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47-
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48-
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49-
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
50-
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
51-
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
52-
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
53-
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
54-
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
55-
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56-
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
57-
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
58-
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59-
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60-
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61-
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62-
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63-
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
43+
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
44+
| ----------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45+
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47+
| anthropic.claude-3-5-sonnet-20240620-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48+
| anthropic.claude-3-5-sonnet-20241022-v2:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49+
| anthropic.claude-3-5-haiku-20241022-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
50+
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
51+
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
52+
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
53+
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
54+
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
55+
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56+
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
57+
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
58+
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59+
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60+
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61+
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62+
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63+
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
64+
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
65+
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
66+
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
6467

6568
### Legend
6669
| Symbol | Description |

‎src/models.ts

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -125,6 +125,7 @@ export const models = {
125125
anthropic: {
126126
models: [
127127
'claude-3-5-sonnet-20240620',
128+
'claude-3-5-haiku-20241022',
128129
'claude-3-opus-20240229',
129130
'claude-3-sonnet-20240229',
130131
'claude-3-haiku-20240307',
@@ -135,6 +136,7 @@ export const models = {
135136
supportsCompletion: true,
136137
supportsStreaming: [
137138
'claude-3-5-sonnet-20240620',
139+
'claude-3-5-haiku-20241022',
138140
'claude-3-opus-20240229',
139141
'claude-3-sonnet-20240229',
140142
'claude-3-haiku-20240307',
@@ -151,6 +153,7 @@ export const models = {
151153
] as const,
152154
supportsToolCalls: [
153155
'claude-3-5-sonnet-20240620',
156+
'claude-3-5-haiku-20241022',
154157
'claude-3-opus-20240229',
155158
'claude-3-sonnet-20240229',
156159
'claude-3-haiku-20240307',
@@ -223,6 +226,9 @@ export const models = {
223226
models: [
224227
'amazon.titan-text-lite-v1',
225228
'amazon.titan-text-express-v1',
229+
'anthropic.claude-3-5-sonnet-20240620-v1:0',
230+
'anthropic.claude-3-5-sonnet-20241022-v2:0',
231+
'anthropic.claude-3-5-haiku-20241022-v1:0',
226232
'anthropic.claude-3-opus-20240229-v1:0',
227233
'anthropic.claude-3-sonnet-20240229-v1:0',
228234
'anthropic.claude-3-haiku-20240307-v1:0',
@@ -245,6 +251,9 @@ export const models = {
245251
supportsStreaming: [
246252
'amazon.titan-text-lite-v1',
247253
'amazon.titan-text-express-v1',
254+
'anthropic.claude-3-5-sonnet-20240620-v1:0',
255+
'anthropic.claude-3-5-sonnet-20241022-v2:0',
256+
'anthropic.claude-3-5-haiku-20241022-v1:0',
248257
'anthropic.claude-3-opus-20240229-v1:0',
249258
'anthropic.claude-3-sonnet-20240229-v1:0',
250259
'anthropic.claude-3-haiku-20240307-v1:0',
@@ -269,11 +278,16 @@ export const models = {
269278
// `responseFormat` field.
270279
supportsJSON: [],
271280
supportsImages: [
281+
'anthropic.claude-3-5-sonnet-20240620-v1:0',
282+
'anthropic.claude-3-5-sonnet-20241022-v2:0',
272283
'anthropic.claude-3-sonnet-20240229-v1:0',
273284
'anthropic.claude-3-opus-20240229-v1:0',
274285
'anthropic.claude-3-haiku-20240307-v1:0',
275286
] as const,
276287
supportsToolCalls: [
288+
'anthropic.claude-3-5-sonnet-20240620-v1:0',
289+
'anthropic.claude-3-5-sonnet-20241022-v2:0',
290+
'anthropic.claude-3-5-haiku-20241022-v1:0',
277291
'anthropic.claude-3-opus-20240229-v1:0',
278292
'anthropic.claude-3-sonnet-20240229-v1:0',
279293
'anthropic.claude-3-haiku-20240307-v1:0',

0 commit comments

Comments
 (0)