In this video from the LAD’15 Conference, Daniel Kobras from science+computing presents: Operational Characteristics of a ZFS-backed Lustre Filesystem.
Hussein Harake from CSCS presented this talk at the HPC Advisory Council Spain Conference. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”
“For High Performance Computing users who leverage open-source Lustre software, a good file system for big data is now getting even better. Building on its substantial contributions to the Lustre community, Intel is rolling out new features that will make the file system more scalable, easier to use, and more accessible to enterprise customers.”
“DMF has been protecting data in some of the industries largest virtualized environments all over the world, enabling them to maintain uninterrupted online access to data for more than 20 years. Some customers have installations with over 100PB online data capacity, and billions of files, which they are able to manage at a fraction of the cost of conventional online architectures.”
“ThroughPuter PaaS is purpose-built for secure, dynamic cloud computing of parallel processing era. ThroughPuter offers unique, realtime application load and type adaptive parallel processing: Get the speed-up from parallel execution cost-efficiently where and when any given program/task benefits most from the parallel processing resources. Addressing the parallel processing challenge takes a full programming-to-execution platform approach.”
“Andreas presents an overview on the features currently under development for the upcoming Lustre 2.8 and 2.9 releases. This includes Layout Enhancement, Progressive File Layouts, Data-on-MDT, and improved single-client metadata and IO performance. In addition, several Lustre-specific ZFS improvements are also under development that will be available in this timeframe.”
“The HP Apollo 8000 supercomputing platform approaches HPC from an entirely new perspective as the system is cooled directly with warm water. This is done through a “dry-disconnect” cooling concept that has been implemented with the simple but efficient use of heat pipes. Unlike cooling fans, which are designed for maximum load, the heat pipes can be optimized by administrators. The approach allows significantly greater performance density, cutting energy consumption in half and creating synergies with other building energy systems, relative to a strictly air-cooled system.”
“NOAA will acquire software engineering support and associated tools to re-architect NOAA’s applications to run efficiently on next generation fine-grain HPC architectures. From a recent procurement document: “Finegrain architecture (FGA) is defined as: a processing unit that supports more than 60 concurrent threads in hardware (e.g. GPU or a large core-count device).”