Skip to content

Commit 28fc680

Browse files
authored
add jumpstart and bedrock deployments (#2663)
add 2 new deployment options
1 parent 29b63d4 commit 28fc680

File tree

1 file changed

+13
-1
lines changed

1 file changed

+13
-1
lines changed

deepseek-r1-aws.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,7 @@ We collaborate with Amazon Web Services to make it easier for developers to depl
2424
Let’s review how you can deploy and fine-tune DeepSeek R1 models with Hugging Face on AWS.
2525
- [Deploy DeepSeek R1 models](#deploy-deepseek-r1-models)
2626
- [Deploy on AWS with Hugging Face Inference Endpoints](#deploy-on-aws-with-hugging-face-inference-endpoints)
27+
- [Deploy on Amazon Bedrock Marketplace]
2728
- [Deploy on Amazon SageMaker AI with Hugging Face LLM DLCs](#deploy-on-amazon-sagemaker-ai-with-hugging-face-llm-dlcs)
2829
- [DeepSeek R1 on GPUs](#deepseek-r1-on-gpus)
2930
- [Distilled models on GPUs](#distilled-models-on-gpus)
@@ -48,6 +49,12 @@ You can find DeepSeek R1 and distilled models, as well as other popular open LLM
4849

4950
| **Note:** The team is working on enabling DeepSeek models deployment on Inferentia instances. Stay tuned!
5051

52+
### Deploy on Amazon Bedrock Marketplace
53+
54+
You can deploy the Deepseek distilled models on Amazon Bedrock via the marketplace, which will deploy an endpoint in Amazon SageMaker AI under the hood. Here is a video of how you can navigate through the AWS console:
55+
56+
![bedrock-deployment.gif](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deepseek-aws/bedrock-deployment.gif)
57+
5158
### Deploy on Amazon Sagemaker AI with Hugging Face LLM DLCs
5259

5360
#### DeepSeek R1 on GPUs
@@ -56,7 +63,12 @@ You can find DeepSeek R1 and distilled models, as well as other popular open LLM
5663

5764
#### Distilled models on GPUs
5865

59-
Let’s walk through the deployment of DeepSeek-R1-Distill-Llama-70B.
66+
You can deploy the Deepseek distilled models on Amazon Sagemaker AI with Hugging Face LLM DLCs using Jumpstart directly or using the Python Sagemaker SDK.
67+
Here is a video of how you can navigate through the AWS console:
68+
69+
![jumpstart-deployment.gif](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/deepseek-aws/jumpstart-deployment.gif)
70+
71+
Now we have seen how to deploy usig Jumpstart, let’s walk through the Python Sagemaker SDK deployment of DeepSeek-R1-Distill-Llama-70B.
6072

6173
Code snippets are available on the model page under the Deploy button!
6274

0 commit comments

Comments
 (0)