This the fifth article in a series from the editors of insideHPC on HPC storage. This week we different approaches to data storage. A different approach to data protection is clearly required if the limitations of hardware-based RAID are to be overcome.
In this video from the HPC Advisory Council Spain Conference, Jose Carreira from Panasas presents: Panasas HPC Storage — Simplicity and Performance. “NAS products for technical enterprise and research environments must deliver fast time to results and efficiently and linearly scale to extremely high levels of aggregate performance. While performance is critical, performance that comes at the expense of manageability can hamper workflows and impact productivity.”
Storage and data management have arguably become the most important HPC “pain points” already, with access densities a particularly troubling issue. Many HPC sites are doubling their storage capacities every two to three years, but adding capacity does not address the access density, data movement, and related storage issues many HPC buyers face. When this happens, your investments in processing, networking, middleware and applications are choked off by bottlenecks in your storage infrastructure. If you’re looking to maximize throughput of your technical computing infrastructure, storage performance often holds the key.
“My story in a nutshell is that as things get larger, if they get larger and we operate them on larger sizes, we actually have pretty good technology for dealing with size. We suffer primarily from scale and the number of components that can fail, and keeping consistency on those. The consistency issue is a serious one for storage systems that are always available.”