Open
Description
Describe the feature you'd like
Request image_uris.retrieve utility to include inf2 containers.
baseimage = sagemaker.image_uris.retrieve(
framework="Neuron",
region=region,
py_version="py310",
image_scope="inference",
version="2.12.0",
instance_type="ml.inf2.24xlarge",
)
print(baseimage)
FileNotFoundError: [Errno 2] No such file or directory: '/home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/sagemaker/image_uri_config/Neuron.json'
Need to update this: src/sagemaker/image_uri_config/
Output should be the correct ECR image:
eg. 763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.12.0-ubuntu20.04
Describe alternatives you've considered
Manually searching in https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-containers