Add storage read/write support to sequential perftest #1033
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What?
Add storage read/write support to sequential KV bench (matrix indices ≥ world_size map to storage), with per-TP files and NIXL FILE transfers for rank→storage and storage→rank I/O.
Why?
How?
example with world size 1:
(0 0)
(100m 0)
Row 1 = storage file 0. 100mb will be read from the file (created in init phase) to rank 0 via selected backend.