Release v0.1.3 · huggingface/xet-core

What's Changed

Profiler by @hoytak in #143
feat: client telemetry by @port8080 in #121
missing files from previous push by @port8080 in #145
in-memory MDBShardFile cache. by @hoytak in #144
Download benchmark results: set concurrent range gets to 8 by @assafvayner in #146
Reduce memory usage by @seanses in #148
Compress models better by @seanses in #130
Remove small file passthrough by @ylow in #149
Fix ubuntu aarch64 build by @seanses in #152
Added base64 util to DataHash by @hoytak in #153
Move Threadpool class to separate module by @hoytak in #151
Separation of shard and cache directories by endpoint. by @hoytak in #154
chunk cache change hash to checksum by @assafvayner in #156
Fixing clippy issues present in upgraded rust version by @hoytak in #155
check max chunk nums by @assafvayner in #158
Simplify shard manager by @hoytak in #157
Fragmentation Prevention by @ylow in #147
Avoid uploading empty xorbs. by @hoytak in #161
Caching system for shard file manager by @hoytak in #159
Get repo_type from caller by @seanses in #160
Up the chunk deduplication size. by @hoytak in #163
Migration utility by @seanses in #150
cache gets verifies crc checksum on stored cache items by @assafvayner in #164
Wrap cache reader in BufReader for speed. by @hoytak in #166
Expose a convenient function to migrate files in repo scanner by @seanses in #167
singleflight remove explicit threadpool by @assafvayner in #169
hfxet 0.1.3 by @assafvayner in #171

Full Changelog: v0.1.2...v0.1.3