A focused, easy to use, idiomatic, high performance, async
object
store library for interacting with object stores.
Using this crate, the same binary and code can easily run in multiple clouds and local test environments, via a simple runtime configuration change. Supported object stores include:
- AWS S3
- Azure Blob Storage
- Google Cloud Storage
- Local files
- Memory
- HTTP/WebDAV Storage
- Custom implementations
Originally developed by InfluxData and later donated to Apache Arrow.
See docs.rs for usage instructions
See CONTRIBUTING.md to learn how to contribute to this project.
It's possible to build object_store
for the wasm32-unknown-unknown
target, however the cloud storage features aws
, azure
, gcp
, and http
are not supported.
cargo build -p object_store --target wasm32-unknown-unknown
Here are several related crates in different repositories from other Apache projects.
Crate | Description | Documentation |
---|---|---|
object_store_opendal |
Use opendal as object_store backend |
(README) |
There following community maintained crates provide additional functionality for object_store
and are NOT governed by the Apache Software Foundation. We list them below in the hope they may be useful, but they are not official Apache projects or endorsed by the Apache Arrow project.
Crate | Description | Documentation |
---|---|---|
hdfs_native_object_store |
Use HDFS as object_store backend |
(README) |
ic_object_store |
Use ICP blockchain as object_store backend |
(README) |
anda_object_store |
Extends the object_store with metadata management and AES-256-GCM encryption |
(README) |
The object_store
crate follows Semantic Versioning. We aim to release new
versions approximately every 2 months.
Planned Release Schedule
Approximate Date | Version | Notes | Ticket |
---|---|---|---|
Apr 2025 | 0.12.1 |
Minor, NO breaking API changes | #287 |