[SPARK-53744][PYTHON][TESTS] Update black python to 24.3.0

[eschcam]

What changes were proposed in this pull request?

Updating python dependency black from 23.12.1 to 24.3.0

Why are the changes needed?

To bring the latest improvements and bug fixes.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Passed all CI tests

Was this patch authored or co-authored using generative AI tooling?

No

[eschcam]

The large number of changes was required to get the CI tests to pass with the new version

[jcw024]

Would you be able to add more details in the PR why the large number of formatting changes were needed to pass the CI tests? If this dependency upgrade changes the behavior of CI tests, it would be good to explain that in the description

[eschcam]

Would you be able to add more details in the PR why the large number of formatting changes were needed to pass the CI tests? If this dependency upgrade changes the behavior of CI tests, it would be good to explain that in the description

It is due to the style changes within black between version 23.12.1 and 24.3.0.
I am not sure if there is a good way of summarising CHANGES.md as there are a number of style changes

[jcw024]

Thanks for linking the changes.md for reference.

I'm comparing with the previous PR that upgraded the black version to 23.12.1 and I see a couple of files which might also need to have the black version be updated:

• .github/workflows/pages.yml
• dev/spark-test-image/docs/Dockerfile

[eschcam]

Thanks for linking the changes.md for reference.

I'm comparing with the previous PR that upgraded the black version to 23.12.1 and I see a couple of files which might also need to have the black version be updated:

* .github/workflows/pages.yml

* dev/spark-test-image/docs/Dockerfile

Thanks I must have missed those in my search

[jcw024]

changes LGTM!

[dongjoon-hyun]

To @eschcam , please get a new JIRA ID because we are already in the difficult situation because of reusing of SPARK-52844.

$ git log --oneline | grep SPARK-52844
ed326b2d13c [SPARK-52844][PYTHON] Update `protobuf` Python package to 5.29.5
43f650eaa43 [SPARK-52844][PYTHON] Update numpy to 1.22

[eschcam]

To @eschcam , please get a new JIRA ID because we are already in the difficult situation because of reusing of SPARK-52844.

$ git log --oneline | grep SPARK-52844
ed326b2d13c [SPARK-52844][PYTHON] Update `protobuf` Python package to 5.29.5
43f650eaa43 [SPARK-52844][PYTHON] Update numpy to 1.22

Apologies. I was unaware a Jira ticket couldn't be used for multiple pull requests. I will keep this in mind for future PRs