In this video from the Cycle Computing the HPC in the Cloud Educational Series, Jeff Layton, HPC Principal Architect at Amazon Web Services, explains concepts and options around using storage in the AWS Cloud.
“Data has gravity; as datasets grow larger it becomes easier to move the compute closer to the data to reduce latency and increase throughput. With AWS big data storage and database services, such Amazon S3, Amazon Redshift, Amazon DynamoDB, and Amazon RDS, you have the perfect place to host your data for your high performance computing cluster. Furthermore, with Amazon Elastic Block Store (EBS) you can create large scale parallel file systems to meet the high volume, performance, and throughput requirements of your HPC workload.”