[v2-10-test] Workaround Python 3.8 alibabacloud issue

Alibabacloud 1.0 has a confusing setup.py where it changes dependencies
dynamically based on sys.version.minor and it confuses installers -
uv installs appsheduler 3.11 for Python 3.8 where pip expects < 3.11

We upgrade both `pip` and `uv` to latest versions and add manual
protection to avoid this from happening.

Also celery integration tests are not valid with the last celery
version. The test was supposed to be run with latest provider
and it should not be part of core integration tests.

Author: potiuk

.github/actions/install-pre-commit/action.yml

@@ -24,7 +24,7 @@ inputs:
     default: "3.9"
   uv-version:
     description: 'uv version to use'
-    default: "0.5.24"  # Keep this comment to allow automatic replacement of uv version
+    default: "0.6.14"  # Keep this comment to allow automatic replacement of uv version
   pre-commit-version:
     description: 'pre-commit version to use'
     default: "3.5.0"  # Keep this comment to allow automatic replacement of pre-commit version

Dockerfile

@@ -53,9 +53,9 @@ ARG PYTHON_BASE_IMAGE="python:3.8-slim-bookworm"
 # You can swap comments between those two args to test pip from the main version
 # When you attempt to test if the version of `pip` from specified branch works for our builds
 # Also use `force pip` label on your PR to swap all places we use `uv` to `pip`
-ARG AIRFLOW_PIP_VERSION=25.0
+ARG AIRFLOW_PIP_VERSION=25.0.1
 # ARG AIRFLOW_PIP_VERSION="git+https://github.com/pypa/pip.git@main"
-ARG AIRFLOW_UV_VERSION=0.5.24
+ARG AIRFLOW_UV_VERSION=0.6.14
 ARG AIRFLOW_USE_UV="false"
 ARG UV_HTTP_TIMEOUT="300"
 ARG AIRFLOW_IMAGE_REPOSITORY="https://github.com/apache/airflow"

Dockerfile.ci

@@ -911,7 +911,7 @@ function check_boto_upgrade() {
     set -x
     # shellcheck disable=SC2086
     ${PACKAGING_TOOL_CMD} install ${EXTRA_INSTALL_FLAGS} --upgrade boto3 botocore \
-       "oss2>=2.14.0" "cryptography<43.0.0" "requests!=2.32.*,<3.0.0,>=2.24.0"
+       "oss2>=2.14.0" "cryptography<43.0.0" "requests!=2.32.0,!=2.32.1,!=2.32.2,<3.0.0,>=2.24.0"
     set +x
     pip check
 }
@@ -1249,9 +1249,9 @@ COPY --from=scripts common.sh install_packaging_tools.sh install_additional_depe
 # You can swap comments between those two args to test pip from the main version
 # When you attempt to test if the version of `pip` from specified branch works for our builds
 # Also use `force pip` label on your PR to swap all places we use `uv` to `pip`
-ARG AIRFLOW_PIP_VERSION=25.0
+ARG AIRFLOW_PIP_VERSION=25.0.1
 # ARG AIRFLOW_PIP_VERSION="git+https://github.com/pypa/pip.git@main"
-ARG AIRFLOW_UV_VERSION=0.5.24
+ARG AIRFLOW_UV_VERSION=0.6.14
 # TODO(potiuk): automate with upgrade check (possibly)
 ARG AIRFLOW_PRE_COMMIT_VERSION="3.5.0"
 

airflow/providers/alibaba/provider.yaml

@@ -53,6 +53,7 @@ dependencies:
   - oss2>=2.14.0
   - alibabacloud_adb20211201>=1.0.0
   - alibabacloud_tea_openapi>=0.3.7
+  - apscheduler<3.11.0; python_version >= "3.8"
 
 integrations:
   - integration-name: Alibaba Cloud OSS

dev/breeze/doc/ci/02_images.md

@@ -442,8 +442,8 @@ can be used for CI images:
 | `DEV_APT_DEPS`                  |                            | Dev APT dependencies installed in the first part of the image (default empty means default dependencies are used) |
 | `ADDITIONAL_DEV_APT_DEPS`       |                            | Additional apt dev dependencies installed in the first part of the image                                          |
 | `ADDITIONAL_DEV_APT_ENV`        |                            | Additional env variables defined when installing dev deps                                                         |
-| `AIRFLOW_PIP_VERSION`           | `25.0`                     | `pip` version used.                                                                                               |
-| `AIRFLOW_UV_VERSION`            | `0.5.24`                   | `uv` version used.                                                                                                |
+| `AIRFLOW_PIP_VERSION`           | `25.0.1`                   | `pip` version used.                                                                                               |
+| `AIRFLOW_UV_VERSION`            | `0.6.14`                   | `uv` version used.                                                                                                |
 | `AIRFLOW_PRE_COMMIT_VERSION`    | `3.5.0`                    | `pre-commit` version used.                                                                                        |
 | `AIRFLOW_USE_UV`                | `true`                     | Whether to use UV for installation.                                                                               |
 | `PIP_PROGRESS_BAR`              | `on`                       | Progress bar for PIP installation                                                                                 |