S3.md

AWS

S3

Rename files in S3

for f in $(aws s3api list-objects --bucket bucket_name --prefix "key/" --delimiter "/" | grep 097 | cut -d : -f 2 | cut -d \" -f 2); do aws s3 mv s3://bucket_name/$f s3://bucket_name/${f/%/.csv.gz}; done

Sync files at two S3 locations

aws s3 sync s3_source s3_target --recursive

Download bucket object from s3

aws s3 cp s3://.. . --recursive