Video: Current Status of ZFS as Backend File System for Lustre

“Intel supports users, system integrators, and OEMs using ZFS with Intel Lustre. In this presentation, we summarize the results of proof-of-concept (PoC) on a variety of the ZFS configurations. We cover sequential and metadata performance, data Integrity, manageability, availability and reliability. The work identifies the areas where development should be focused in order to fill gap in performance or functionality and encourage system administrator to integrate this technology with the existing high availability framework like Pacemaker/Corosync. We also cover the most important tunables for ZFS in combination with Lustre and the most notable metrics for Lustre and ZFS.”

NCSA’s Merle Giles Publishes New Book on Industrial HPC

“Industrial Applications of High-Performance Computing: Best Global Practices offers a global overview of HPC for industrial applications, along with a discussion of software challenges, business models, access models (e.g., cloud computing), public-private partnerships, simulation and modeling, visualization, big data analysis, and governmental and industrial influence.”

Fault Trees

As datasets and simulations continue to increase in size and complexity, interactivity with the data should be maintained. It is important to understand how SIMD parallelism can be used when evaluating large fault tree expressions on a large volume of input.

Hurry! Enter SC15 Student Cluster Competition by April 17

The clock is ticking down for teams to submit their applications for the SC15 Student Cluster Competition. The deadline to apply for a spot in this year’s competition is Friday, April 17.

Slidecast: Bridging HPC and Big Data Analytics with Software Defined Storage

“IBM Spectrum Scale is a proven, scalable, high-performance data and file management solution (based upon IBM General Parallel File System or GPFS, also formerly known as code name Elastic Storage). IBM Spectrum Scale provides world-class storage management with extreme scalability, flash accelerated performance, and automatic policy-based storage tiering from flash through disk to tape. IBM Spectrum Scale reduces storage costs up to 90% while improving security and management efficiency in cloud, big data & analytics environments.”

Video: NVM Express Introduction and Tutorial

NVM Express is a specification for accessing solid-state drives (SSDs) attached through the PCI Express (PCIe) bus. “NVM” stands as an acronym for non-volatile memory, which is used in SSDs. As a logical device interface, NVM Express has been designed from the ground up, capitalizing on the low latency and parallelism of PCI Express SSDs, and mirroring the parallelism of contemporary CPUs, platforms and applications. By allowing parallelism levels offered by SSDs to be fully utilized by host’s hardware and software, NVM Express brings various performance improvements.

UberCloud Community and Marketplace for Technical Computing

“The UberCloud Community brings together over 3,000 participants to pave the way for the Technical Computing Cloud. UberCloud Experiment teams explore the end-to-end process of accessing remote computing resources in HPC centers and in the Cloud to study and overcome the potential roadblocks for industry applications such as CAE, Bio and Life Sciences.”

StartupHPC Meetup at SC14 Beefs Up Agenda

AMD’s Karl Freund and UberCloud’s Wolfgang Gentzsch will be featured speakers at the StartupHPC Meetup at SC14 in New Orleans.

MVAPICH at Petascale: Experiences in Production on Stampede

Dan Stanzione from TACC presented this keynote at the recent MVAPICH User Group. “The Stampede system began production operations in January 2013. The system was one of the largest ever deployments of MVAPICH, with a 6,400 node FDR Infiniband fabric connecting more than 2PF of Intel Xeon processors. The system also was the first large scale installation of the Intel many core Xeon Phi Co-Processors, which also used MVAPICH for communications. This talk will discuss the experiences over the first 1.5 years of production with MVAPICH and Stampede.”

Virtualized High Performance Computing with Mellanox FDR and RoCE

“The HPC community can realize significant benefits from adopting enterprise-capable IT solutions grounded in proven virtualization and cloud technology. And conversely, as business IT environments become increasingly compute-intensive, lessons learned by the scientists and engineers working with HPC can be transferred to their counterparts in the enterprise. It’s a win-win situation.”