This the fifth article in a series from the editors of insideHPC on HPC storage. This week we different approaches to data storage. A different approach to data protection is clearly required if the limitations of hardware-based RAID are to be overcome.
Glenn Lockwood writes that the world of high-throughput sequencing is becoming increasingly dependent on HPC, and many of the problems being solved in genomics and bioinformatics are stressing aspects of system architecture and cyberinfrastructure that haven’t gotten a tremendous amount of exercise from the more traditional scientific domains in computational research.
Scalable Informatics has worked worked for years to develop the FastPath Unison storage appliance, a device that hits the sweet spot for HPC. “Tremendous density is meaningless if you can’t move data in or out at a reasonable data rate. And as you scale up your storage, the definition of a reasonable data rate should scale up as well.”
System availability has become an increasing concern as high capacity drives have come to market in recent years. While availability has not traditionally been a chief concern in HPC, it has now become of paramount importance. Large capacity drives expose systems to multiple-day rebuild times and extended periods of vulnerability to data loss using traditional hardware based RAID.
From Wall Street to the Great Wall, enterprises and institutions of all sizes are faced with the benefits – and challenges – promised by ‘Big Data’. But before users can take advantage of the near limitless potential locked within their data, they must have affordable, scalable and powerful software tools to manage the data.
Today DDN introduced WOS S3, which adds support for the industry standard Amazon S3 API. With this latest release, DDN offers the broadest range of supported interfaces to an object storage platform in the industry, enabling users from Enterprise to Academia and Research to Government, Private and Public Cloud the optimal connectivity choices for their existing datacenters.