Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: presign use multi part upload large file #570

Open
sundy-li opened this issue Jan 9, 2025 · 1 comment
Open

feat: presign use multi part upload large file #570

sundy-li opened this issue Jan 9, 2025 · 1 comment

Comments

@sundy-li
Copy link
Member

sundy-li commented Jan 9, 2025

https://aws.amazon.com/cn/blogs/compute/uploading-large-objects-to-amazon-s3-using-multipart-upload-and-transfer-acceleration/

@Xuanwo
Copy link
Member

Xuanwo commented Jan 9, 2025

It can be challenging to implement pre-signing for multipart uploads, as each vendor has its own logic for handling them, making it difficult for users to construct the requests.

It's merely a coincidence that all cloud vendors use PUT to upload files, but they might require different APIs for uploading parts and completing multipart uploads.

Instead of using presign for multipart uploads, perhaps we could explore a way to enable BendSQL to utilize opendal for directly writing to storage services.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants