How to create a custom docker image for Backend.AI?

[Vladislav2951]

Good day!

When open the Environments tab I see many of available images from cr.backend.ai registry. Also I see the option to add my own registry. I have created the local one:

docker run -d -p 5000:5000 --name registry registry:2

I registered this registry as localhost with http://localhost:5000 URL and docker type. Then I used the basic docker busybox image as the test one:

docker tag busybox:latest localhost:5000/busybox:latest
docker push localhost:5000/busybox:latest

and got

curl http://localhost:5000/v2/_catalog
{"repositories":["busybox"]}

I tried to rescan the registry and got this error:

$ backend.ai admin image rescan -r localhost
✓ Started updating the image metadata from the configured registries.
✗ Error occurred: TaskGroupError('unhandled errors in a TaskGroup', (TaskGroupError('unhandled errors in a TaskGroup', (TaskGroupError('unhandled errors in a TaskGroup', (ContentTypeError(RequestInfo(url=URL('http://localhost:5000/v2/busybox/manifests/latest'), method='GET', headers=<CIMultiDictProxy('Host': 'localhost:5000', 'Accept': 'application/vnd.docker.distribution.manifest.list.v2+json', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'Python/3.12 aiohttp/3.9.5')>, real_url=URL('http://localhost:5000/v2/busybox/manifests/latest')), (), message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', headers=<CIMultiDictProxy('Content-Length': '1128', 'Content-Type': 'application/vnd.docker.distribution.manifest.v1+prettyjws', 'Docker-Content-Digest': 'sha256:eb18a6c9f3b3abc196339fece3ec720ff7a4dde18c4e646bed2d8233bf4b0c16', 'Docker-Distribution-Api-Version': 'registry/2.0', 'Etag': '"sha256:eb18a6c9f3b3abc196339fece3ec720ff7a4dde18c4e646bed2d8233bf4b0c16"', 'X-Content-Type-Options': 'nosniff', 'Date': 'Mon, 14 Oct 2024 12:00:31 GMT')>),)),)),))

I think that the error is in "mediaType": "application/vnd.oci.image.index.v1+json".
I tried to make the new docker image:

FROM debian:buster-slim

RUN apt-get update && apt-get install -y curl && rm -rf /var/lib/apt/lists/*

ENTRYPOINT [ "curl" ]

docker buildx build --push --platform linux/amd64 -t localhost:5000/debian-test:latest .

After rescan I got the same error:

✓ Started updating the image metadata from the configured registries.
✗ Error occurred: TaskGroupError('unhandled errors in a TaskGroup', (TaskGroupError('unhandled errors in a TaskGroup', (TaskGroupError('unhandled errors in a TaskGroup', (ContentTypeError(RequestInfo(url=URL('http://localhost:5000/v2/debian-test/manifests/latest'), method='GET', headers=<CIMultiDictProxy('Host': 'localhost:5000', 'Accept': 'application/vnd.docker.distribution.manifest.list.v2+json', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'Python/3.12 aiohttp/3.9.5')>, real_url=URL('http://localhost:5000/v2/debian-test/manifests/latest')), (), message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', headers=<CIMultiDictProxy('Content-Length': '2769', 'Content-Type': 'application/vnd.docker.distribution.manifest.v1+prettyjws', 'Docker-Content-Digest': 'sha256:0e2ebb67ce3970f44637472ee5ede9711ebd6bf4c1d52f449e7edfee3df4ce53', 'Docker-Distribution-Api-Version': 'registry/2.0', 'Etag': '"sha256:0e2ebb67ce3970f44637472ee5ede9711ebd6bf4c1d52f449e7edfee3df4ce53"', 'X-Content-Type-Options': 'nosniff', 'Date': 'Mon, 14 Oct 2024 12:12:22 GMT')>),)),)),))

Please, help me with adding own docker images to Backend.AI. Maybe there is an instruction that I missed?

Thank you!

[achimnol]

I think this is resolved by #2815.
If you still have the issue, please let us know!