ClusterStor Solution for HPC and Big Data

Print Friendly, PDF & Email

The ClusterStor SDA is built on Seagate’s successful ClusterStor family of high performance storage solutions for HPC and Big Data, providing unmatched file system performance, optimized productivity and the HPC industry’s highest levels of efficiency, reliability, availability and serviceability. Taking full advantage of the Lustre file system, Seagate ClusterStor is designed for massive scale-out performance and capacity, with the ability to support from hundreds to tens-of-thousands of client compute nodes delivering data intensive workload throughput from several GB/sec to over 1TB/sec.

This is the final article in a series designed to address the needs of government and business or collaborative and secure information sharing within a Multilevel Security (MLS) framework. Click here for the PDF.

The operating environment is integrated into distributed data storage elements called the Scalable Storage Unit (SSU), which integrates storage, data protection, network and file system components into a single building block that delivers a linear scaling unit in performance and data storage capacity.

As an example, the ClusterStor 6000 provides file system performance up to 42GB/s performance per 42RU height rack. It has a raw file system capacity of 3,444 TB per rack using 6TB SAS HDDs and can have up to 7 SSUs per rack and up to 14 embedded server modules per rack. Client access is via InfiniBand QDR or FDR or Ethernet 10GbE or 40GbE. The file system is Lustre 2.1 with Seagate supported enhancements delivering over 2 billion files and a maximum usable storage capacity per single file system over 25PB.

The Result

The Seagate ClusterStor Secure Data Appliance puts into place the last significant system component required to efficiently and effectively implement a MLS framework. The Seagate ClusterStor SDA represents the industry’s first scale-out secure storage solution for Big Data, HPC and large data sharing applications that consolidates separate standalone systems, programmatically enforces collaborative user access, protects data, and accelerates analysis while enabling dynamic workload and resource allocation.

Overall, this provides vast cost savings in reduced capital equipment as well as reduced operational complexity, floor space, weight, power, and cooling while satisfying today’s requirements for performance, collaborative secure data sharing, and availability.

Conclusion

This paper examines the HPC industry’s first scale-out secure storage system. The Seagate ClusterStor™ Secure Data Appliance is designed to deliver the industry’s first ICD 503 (DCID 6/3 PL4) certified compliant and secure scale-out parallel file system solution, for government and business enterprises who need collaborative and secure information sharing within a Multilevel Security (MLS) framework at Big Data and HPC Scale.

Combining Security-Enhanced Linux (SELinux) with the Lustre® file system, the ClusterStor™ Secure Data Appliance provides the means to implement all the necessary Mandatory Access Control (MAC), explicit audit logging / tracking, encryption and support capabilities to enforce ICD 503 requirements for “least privilege” access control.

Overall, this provides vast cost savings in reduced capital equipment and networks as well as reduced operational complexity, floor space, weight, power, and cooling while satisfying today’s requirements for performance, collaborative secure data sharing, and availability. Click here for a complete copy of this white paper.