Add support for Python 3.11

[pmeier]

As of today, Python 3.11 is not available in the defaults channel of Anaconda, which we are building against: https://anaconda.org/anaconda/python

As stated in #6841 (comment), we cannot build against the conda-forge channel.

As soon as it is available in the defaults channel, there is #6959 to add support in our CI and in turn for the nightlies and the next release.

[CtrlC-Root]

ContinuumIO/anaconda-issues#13082

[johnnynunez]

conda create --name pytorch python=3.11 -c conda-forge -y
Torchvision is blocking my tests for upgrade to pytorch 1.13.1 with 3.11

[pmeier]

@johnnynunez You are using the conda-forge channel. As explained above, we are not building against that, but rather the defaults channel:

$ conda create --name pytorch python=3.11 --dry-run
[...]
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - python=3.11

Current channels:

  - https://repo.anaconda.com/pkgs/main/linux-64
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/r/linux-64
  - https://repo.anaconda.com/pkgs/r/noarch
[...]

[johnnynunez]

@johnnynunez You are using the conda-forge channel. As explained above, we are not building against that, but rather the defaults channel:

$ conda create --name pytorch python=3.11 --dry-run
[...]
Solving environment: failed

PackagesNotFoundError: The following packages are not available from current channels:

  - python=3.11

Current channels:

  - https://repo.anaconda.com/pkgs/main/linux-64
  - https://repo.anaconda.com/pkgs/main/noarch
  - https://repo.anaconda.com/pkgs/r/linux-64
  - https://repo.anaconda.com/pkgs/r/noarch
[...]

They are working on that: conda/conda#11170
Why does it rely on conda and not on python binaries as in pytorch repository?

[pmeier]

Why does it rely on conda and not on python binaries as in pytorch repository?

Because we are not just building against the Python ABI, but a few other libraries as well. Mainly libpng and libjpeg.

[johnnynunez]

Why does it rely on conda and not on python binaries as in pytorch repository?

Because we are not just building against the Python ABI, but a few other libraries as well. Mainly libpng and libjpeg.

Thank you for clarify

[malfet]

I'm curious, if we should just add python 3.11 library to pytorch channel to unblock the wheels builds.

[pmeier]

@malfet I favor this. If we do, we should also consider 4. of #6563 since we are missing out on quite a big performance improvement again due to lack of support in the defaults channel.

[johnnynunez]

@pmeier Python 3.11 is out in anaconda
ContinuumIO/anaconda-issues#13082 (comment)

conda create -n py311 python=3.11

[pentium10]

any progress on this one? pytorch was enabled for linux builds, and wondering if vision is up to a point to be tested?