Skip to content

Request image_uris.retrieve utility to include inf2 / neuron containers.  #4035

Open
@ashivadi

Description

@ashivadi

Describe the feature you'd like
Request image_uris.retrieve utility to include inf2 containers.

baseimage = sagemaker.image_uris.retrieve(
    framework="Neuron",
    region=region,
    py_version="py310",
    image_scope="inference",
    version="2.12.0",
    instance_type="ml.inf2.24xlarge",
)
print(baseimage)

FileNotFoundError: [Errno 2] No such file or directory: '/home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/sagemaker/image_uri_config/Neuron.json'

Need to update this: src/sagemaker/image_uri_config/

Output should be the correct ECR image:

eg. 763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.12.0-ubuntu20.04

Describe alternatives you've considered
Manually searching in https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-containers

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions