Releases: huggingface/xet-core
Releases · huggingface/xet-core
v0.1.3
What's Changed
- Profiler by @hoytak in #143
- feat: client telemetry by @port8080 in #121
- missing files from previous push by @port8080 in #145
- in-memory MDBShardFile cache. by @hoytak in #144
- Download benchmark results: set concurrent range gets to 8 by @assafvayner in #146
- Reduce memory usage by @seanses in #148
- Compress models better by @seanses in #130
- Remove small file passthrough by @ylow in #149
- Fix ubuntu aarch64 build by @seanses in #152
- Added base64 util to DataHash by @hoytak in #153
- Move Threadpool class to separate module by @hoytak in #151
- Separation of shard and cache directories by endpoint. by @hoytak in #154
- chunk cache change hash to checksum by @assafvayner in #156
- Fixing clippy issues present in upgraded rust version by @hoytak in #155
- check max chunk nums by @assafvayner in #158
- Simplify shard manager by @hoytak in #157
- Fragmentation Prevention by @ylow in #147
- Avoid uploading empty xorbs. by @hoytak in #161
- Caching system for shard file manager by @hoytak in #159
- Get repo_type from caller by @seanses in #160
- Up the chunk deduplication size. by @hoytak in #163
- Migration utility by @seanses in #150
- cache gets verifies crc checksum on stored cache items by @assafvayner in #164
- Wrap cache reader in BufReader for speed. by @hoytak in #166
- Expose a convenient function to migrate files in repo scanner by @seanses in #167
- singleflight remove explicit threadpool by @assafvayner in #169
- hfxet 0.1.3 by @assafvayner in #171
New Contributors
Full Changelog: v0.1.2...v0.1.3
v0.1.2
What's Changed
- disable client telemetry by default by @assafvayner in #142
Full Changelog: v0.1.1...v0.1.2
v0.1.1
What's Changed
- Deadlock fix. by @hoytak in #140
- Update Cargo.toml to version 0.1.1 by @rajatarya in #141
Full Changelog: v0.1.0...v0.1.1
v0.1.0
What's Changed
- Only load the shard chunk dedup tables for the upload path by @hoytak in #129
- Drop xet_error. by @hoytak in #134
- Drop on shard_file_manager issues warning in debug mode instead of error. by @hoytak in #128
- Added CoC, contribution guide, and updated readme by @rajatarya in #133
- CI & Release GH Action updates by @rajatarya in #135
- Update release.yml, fix GH publish by @rajatarya in #136
- GitHub release + PyPi publishing by @rajatarya in #137
- Update release.yml by @rajatarya in #138
- Update release.yml by @rajatarya in #139
Full Changelog: v20241218-00-dedup-upload-ctrlc...v0.1.0
v20241218-00: Dedup fixes, Upload Progress Bar, CTRL+C cancellation
What's Changed
- Universal Build WHL instructions by @rajatarya in #116
- remove x86 as a linux target by @jgodlew in #117
- remove vendored feature from x86_64 by @jgodlew in #118
- Parallelize xorb upload by @seanses in #98
- add BatchQueryReconstructionRequest by @assafvayner in #123
- upload progress bar work by @assafvayner in #120
- Update threadpool by @hoytak in #122
- Skip register shard that are already registered by @seanses in #127
- Python CTRL-C cancellation by @hoytak in #119
Full Changelog: v20241211-00-throughput-ux...v20241218-00-dedup-upload-ctrlc