Skip to content

Conversation

khatwanimohit
Copy link
Collaborator

Description

This PR introduces an API for resharding which uses split_by_mesh_axis from pathwaysutils. It includes a function to find intermediate shardings for split_by_mesh_axis when possible.

If the change fixes a bug or a Github issue, please include a link, e.g.,:
FIXES: b/449217704

Notice 1: Once all tests pass, the "pull ready" label will automatically be assigned.
This label is used for administrative purposes. Please do not add it manually.

Notice 2: For external contributions, our settings currently require an approval from a MaxText maintainer to trigger CI tests.

Tests

A test which runs on v5p-64 with pathways as backend

Checklist

Before submitting this PR, please make sure (put X in square brackets):

  • I have performed a self-review of my code. For an optional AI review, add the gemini-review label.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have run end-to-end tests tests and provided workload links above if applicable.
  • I have made or will make corresponding changes to the doc if needed.

@khatwanimohit khatwanimohit force-pushed the mohit/new_resharding branch 9 times, most recently from 83a60f0 to 6b754d0 Compare October 13, 2025 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant