Copy files between buckets in S3 using AWS DataSync
S3
Simple and popular AWS Service for storage. Replicates data by default across multiple facilities. It charges per usage. It is deeply integrated with AWS Services. Buckets are logical storage units. Objects are data added in the bucket. S3 has a storage class on object level which can save money by moving less frequently accessed objects to colder storage class.
AWS DataSync
It is a secure, online service that automates and accelerates the moving of data between on-premises and AWS storage services. DataSync can copy data between the following sources Network File System (NFS) shares, Server Message Block (SMB) shares, Hadoop Distributed File Systems (HDFS), self-managed object storage, AWS Snowcone, Amazon Simple Storage Service (Amazon S3) buckets, Amazon Elastic File System (Amazon EFS) file systems, Amazon FSx for Windows File Server file systems, and Amazon FSx for Lustre file systems.
Demo
Create 2 buckets in S3 and upload a file in source bucket
Now moving to AWS DataSync Console choosing between AWS Storage services and click get strtaed
configuring the source location as follows
Now configuring destination location
Now configuring the tasks
Click on autogenerate for the cloudwatch log
clicking on create task
click on start and then start with defaults and wait until the finished or available status is display on task status
checking the destination bucket and file has been copied successfully
