AWS DataSync moves file and object data over the network between on-premises storage, other clouds and AWS storage services, with encryption and integrity checks built in.
Online data transfer
AWS DataSync copies files and objects over the network, fast and with checks, so you don’t have to script rsync jobs and verify them yourself.
How it works
- For on-premises or other-cloud storage, deploy a DataSync agent near the data and activate it against a public or VPC service endpoint.
- Create a source and a destination location, such as an NFS share and an S3 bucket.
- Create a task with options: what metadata to keep, filters, bandwidth limit, schedule.
- Each task execution scans both sides, copies what changed over TLS, and verifies integrity.
| Need | Service |
|---|---|
| One-time or recurring online copy of files or objects into AWS | AWS DataSync |
| On-premises apps keep using NFS or SMB while data lands in S3 or FSx | AWS Storage Gateway |
| Partners upload with SFTP, FTPS, FTP or AS2 | AWS Transfer Family |
| Database migration with ongoing change capture | AWS DMS |
Exam cues
- If the question says migrate or sync large file shares to S3, EFS or FSx online, on a schedule, with integrity checks, think AWS DataSync.
- If the question says the transfer must not use the public internet, think DataSync with a VPC service endpoint over Direct Connect or VPN.
- If the question says copy between two AWS storage services, think DataSync with no agent.
Remember
- Sources: NFS, SMB, HDFS, object storage, other clouds. Targets: S3, EFS, all FSx types.
- Agent needed for on-premises and other clouds; none between AWS services in one account.
- TLS in transit, integrity verification, incremental runs, schedules, bandwidth limits.
Trap: DataSync is a copy job, not a file share. When on-premises applications must keep reading and writing through NFS or SMB after the move, add Storage Gateway.
Da documentação da AWS (12)
- AWS DataSync is a file transfer service that copies file or object data to, from and between AWS storage services.
- DataSync reads from on-premises NFS, SMB, HDFS and object storage, and from storage in other clouds such as Google Cloud Storage and Azure Blob Storage.
- DataSync writes to Amazon S3, Amazon EFS and every Amazon FSx file system type (Windows File Server, Lustre, OpenZFS and NetApp ONTAP).
- Typical DataSync uses are migrating active datasets, archiving cold data straight into S3 Glacier storage classes, replicating data to a standby file system, and moving data in or out of AWS for processing.
- A DataSync agent is a virtual machine that reads and writes your storage during a transfer; it runs on VMware ESXi, KVM, Nutanix AHV or Hyper-V, or as an EC2 instance for storage in a VPC.
- Transfers between AWS storage services in the same account need no agent, and the data stays on the AWS network even across Regions.
- DataSync encrypts data in transit with TLS and always checks data integrity during a transfer.
- A DataSync task names a source and a destination location plus options such as metadata handling, file filters and a bandwidth limit; each run is a task execution.
- By default a DataSync task compares source and destination and copies only what changed since the last run, and tasks can run on a schedule for recurring transfers.
- With a VPC service endpoint (AWS PrivateLink), traffic between the DataSync agent and the service stays in your VPC instead of crossing the public internet, for example over Direct Connect.
- Copying between Regions with DataSync is billed as data transfer out from the source Region.
- A DataSync task reaches up to 10 Gbps when it uses an agent and up to 5 Gbps without one.
Flashcards
Nada para revisar aqui agora. Escolha outros tópicos ou outro filtro.
·
Todos os 6 flashcards em lista
A company must copy 200 TB from an on-premises NFS server to Amazon EFS over its existing network link, with encryption in transit and integrity checks, and then keep syncing changes nightly. Which service fits?
AWS DataSync with an agent on premises and a scheduled task.
It copies only changed files on each run and verifies integrity.
Which AWS storage targets can AWS DataSync write to?
Amazon S3 (including Glacier storage classes), Amazon EFS and all Amazon FSx file systems.
A team uses AWS DataSync to copy data from an on-premises SMB share to Amazon S3 over AWS Direct Connect and must keep the traffic off the public internet. What should they configure?
A VPC service endpoint for DataSync (AWS PrivateLink), and activate the agent against it.
Does AWS DataSync need an agent to copy data from an S3 bucket to an EFS file system in the same AWS account?
No. Transfers between AWS storage services in the same account are agentless, and the data stays on the AWS network.
A company wants to move rarely used on-premises files directly into S3 Glacier Deep Archive to free local capacity. Which AWS service copies them online?
AWS DataSync, which can write straight to S3 Glacier storage classes.
What does an AWS DataSync agent run on?
A VM on VMware ESXi, KVM, Nutanix AHV or Hyper-V, or an EC2 instance when the storage is in a VPC.