In this video, Matt Herreras and Josh Simons discuss recent developments in virtualization technologies for HPC. Please pay attention, folks. This stuff is going to change how we, as a community, get supercomputing done and it is happening now.
Seagate announced at SC14 a new version of its ClusterStor Engineered Solution for Lustre that adds new features to the Lustre parallel data storage file system used in HPC environments and the ClusterStor Hadoop Workflow Accelerator, a set of Hadoop tools, services and support for HPC environments.
From Wall Street to the Great Wall, enterprises and institutions of all sizes are faced with the benefits – and challenges – promised by ‘Big Data’. But before users can take advantage of the near limitless potential locked within their data, they must have affordable, scalable and powerful software tools to manage the data.
This week we look at various attributes including how easy it is to scale Lustre file systems. The inherent scalability of Lustre aggregates storage capacity across many servers. I/O bandwidth also scales as more storage servers are added, and can be dynamically adjusted as needs change and demands for more storage capacity and bandwidth grow.