Skip to content

perf/codec chain#3722

Open
d-v-b wants to merge 7 commits intozarr-developers:mainfrom
d-v-b:perf/codec-chain
Open

perf/codec chain#3722
d-v-b wants to merge 7 commits intozarr-developers:mainfrom
d-v-b:perf/codec-chain

Conversation

@d-v-b
Copy link
Contributor

@d-v-b d-v-b commented Feb 26, 2026 •
edited
Loading

This PR defines a CodecChain object, which is similar to CodecPipeline except that it performs no orchestration. It just defines array-spec-aware, pure-compute encoding and decoding routines for collections of codecs. Part of #3720

depends on #3721

d-v-b and others added 4 commits February 25, 2026 18:33
@d-v-b
add sync methods to codecs
2b64daa
@d-v-b @claude
add CodecChain dataclass and sync codec tests
cd4efb0 
Introduces CodecChain, a frozen dataclass that chains array-array,
array-bytes, and bytes-bytes codecs with synchronous encode/decode
methods. Pure compute only -- no IO, no threading, no batching.

Also adds sync roundtrip tests for individual codecs (blosc, gzip,
zstd, crc32c, bytes, transpose, vlen) and CodecChain integration tests.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@d-v-b
refactor codecchain
41b7a6a
@d-v-b
separate codecs and specs
5a2a884
@github-actions github-actions bot added the needs release notes Automatically applied to PRs which haven't added release notes label Feb 26, 2026
@d-v-b d-v-b mentioned this pull request Feb 26, 2026
Open
@d-v-b
Copy link
Contributor Author

d-v-b commented Feb 27, 2026

updating this PR to blend the codecchain logic with array_spec logic to define a ChunkTransform object that carries both together.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

needs release notes Automatically applied to PRs which haven't added release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@d-v-b