Sign up for our newsletter and get the latest HPC news and analysis.

Video: Lustre + Linux – Putting the House in Order

tux

In this video from LUG 2015 in Denver, James Simmons from ORNL presents: Lustre + Linux – Putting the House in Order. “In the last year great strides have been made to sync up the lustre Intel branch to what is upstream. We present what that current state is as well as what is left for the intel branch to bring this to completion.”

Video: Monitoring a Heterogeneous Lustre Environment with Splunk

lug

“Monitoring a large Lustre site, running multiple generations of Lustre filesystems can be a challenge. Some equipment offer vendor specific monitoring interfaces while others, built on open source Lustre, have minimal monitoring capabilities. This talk will report on our operational experience using a homegrown python module to collect data from each filesystem. We will discuss in detail how the data is visualized centrally in Splunk and cross-referenced with users workload to analyze and troubleshoot our environment.”

Video: Cray’s Peg Williams on How Supercomputing Propels Science

Peg Williams

In this video, Peg Williams from Cray describes how Supercomputing propels science.

Steve Oberlin on How NVLink will Power Coral Supercomputers

Steve_Oberlin-1066-1000px-500x319

NVlink will be the backbone of 150 Petaflop Coral supercomputers coming to ORNL and LLNL. As the world’s first high-speed GPU interconnect, NVLink will let data move between GPUs and CPUs 5-12 times faster than possible today.

Registration Opens for XSEDE15 Conference in St. Louis

xsede

Registration is now open for the 4th annual XSEDE15 conference. The event takes place July 16-20 in St. Louis.

Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices

Hadoop Cluster

In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”

Video: Current Status of ZFS as Backend File System for Lustre

zfs-linux

“Intel supports users, system integrators, and OEMs using ZFS with Intel Lustre. In this presentation, we summarize the results of proof-of-concept (PoC) on a variety of the ZFS configurations. We cover sequential and metadata performance, data Integrity, manageability, availability and reliability. The work identifies the areas where development should be focused in order to fill gap in performance or functionality and encourage system administrator to integrate this technology with the existing high availability framework like Pacemaker/Corosync. We also cover the most important tunables for ZFS in combination with Lustre and the most notable metrics for Lustre and ZFS.”

Intel’s Diane Bryant on Bringing Diversity to the Tech Sector

diane

How does a woman break through the glass ceiling? In this video from the Re/Code Conference, Intel’s Diane Bryant discusses the pathway to diversity in the tech sector.

Video: Lustre Network (LNET) Router Configuration and Tuning

fragalla

“n this session, Seagate covers configuration guidelines and tuning of LNET Routing from InfiniBand to Ethernet using Lustre 2.1 through 2.6 server/clients as well demonstrating performance results by means of a synthetic benchmark called IOR. In addition, this presentation includes the topic of LNET Router failure and recovery during I/O as well as what environments can expect during these failure events.”

Video: Lustre 2.8 and Beyond

lustre

“Andreas Dilger from Intel presents an overview on the features currently under development for the upcoming Lustre 2.8 and 2.9 releases. This includes Layout Enhancement, Progressive File Layouts, Data-on-MDT, and improved single-client metadata and IO performance. In addition, several Lustre-specific ZFS improvements are also under development that will be available in this timeframe.”