Jeff Layton from Amazon presented this talk at the AWS Public Sector Summit. “Learn how to build HPC clusters on the fly, leverage Amazon’s Spot market pricing to minimize the cost of HPC jobs, and scale HPC jobs on a small budget, using all the same tools you use today, and a few new ones too.”
“We are pioneering the area of virtualized clusters, specifically with SR-IOV,” said Philip Papadopoulos, SDSC’s chief technical officer. “This will allow virtual sub-clusters to run applications over InfiniBand at near-native speeds – and that marks a huge step forward in HPC virtualization. In fact, a key part of this is virtualization for customized software stacks, which will lower the entry barrier for a wide range of researchers by letting them project an environment they already know onto Comet.”
Private cloud storage enabled by BlackPearl provides the best option for balancing performance and cost; however, some customer workflows benefit greatly from incorporating a public cloud storage infrastructure,” said Matt Starr, Spectra Logic’s CTO. “Public cloud works best when a disaster recovery copy is needed; when wide data distribution is called for; to create geographic dispersion of data; and when other cloud-based features can be leveraged, such as automatic transcoding. The new Spectra hybrid storage ecosystem means that Spectra customers don’t have to choose between public and private cloud; BlackPearl brings them together seamlessly.”
Cloud computing is growing and replacing many data centers for High Performance Computing (HPC) applications. However, the movement towards using a cloud infrastructure is not without challenges. This whitepaper discusses many of the challenges in moving from an on-premise HPC solution to using an HPC Cloud Solution.
Are you looking at how to deliver HPC services through the Cloud? The CloudLightning Project in Europe is seeking your input on a new survey.
In this video from the Transtec booth at ISC 2016, Piotr Wachowicz from Bright Computing shows how the company’s cluster management software enables customers to configure and monitor OpenStack systems. “Bright Cluster Manager provides a unified enterprise-grade solution for provisioning, scheduling, monitoring and management of HPC and Big Data systems in your data center and in the cloud. Our dynamic cloud provisioning optimizes cloud utilization by automatically creating servers when they’re needed and releasing them when they’re not. Bright OpenStack provides a complete cloud solution that is easy to deploy and manage.”
The Department of Energy’s Energy Sciences Network (ESnet) has published a 3D timeline celebrating thirty years of service. With the launch of an interactive timeline, viewers can explore ESnet’s history and contributions.
In this video, Prof. John Morrison from University College Cork describes the CloudLightning project. CloudLightning’s vision is a European economy that thrives and leads the world in the provision and adoption of high performance cloud computing services. Funded by the European Commission’s Horizon 2020 Program, CloudLightning brings together eight project partners from five countries across Europe.
The University of Melbourne has launched a new HPC service called Spartan that combines traditional HPC with a flexible cloud computing component. “Many research projects demand high speed interconnect,” said Bernard Meade, Head of Research Computer Services at the University of Melbourne. “Spartan can quickly scale into cloud based virtual machines as needed, and expand the HPC system as user needs evolve. Traditional HPC systems are typically tailored for a few specific use cases, but in practice are used for a much wider variety of applications, resulting in less than optimal usage.”
“High performance computing is a $20 billion market dominated by legacy on-premise IT players with minimal cloud penetration today,” said Toshi Otani, Managing Director at TransLink capital. “Rescale’s platform solution addresses the key security and performance challenges that have historically held back enterprises from pushing their HPC data centers into the cloud. As the industry-leading platform solution for enterprise HPC, Rescale has demonstrated to be uniquely well positioned as HPC makes the inevitable transition to the cloud.”