Sign up for our newsletter and get the latest HPC news and analysis.

Video: Understanding Hadoop Performance on Lustre

Hadoop Cluster

“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”

Video: Lustre + Linux – Putting the House in Order

tux

In this video from LUG 2015 in Denver, James Simmons from ORNL presents: Lustre + Linux – Putting the House in Order. “In the last year great strides have been made to sync up the lustre Intel branch to what is upstream. We present what that current state is as well as what is left for the intel branch to bring this to completion.”

Video: Monitoring a Heterogeneous Lustre Environment with Splunk

lug

“Monitoring a large Lustre site, running multiple generations of Lustre filesystems can be a challenge. Some equipment offer vendor specific monitoring interfaces while others, built on open source Lustre, have minimal monitoring capabilities. This talk will report on our operational experience using a homegrown python module to collect data from each filesystem. We will discuss in detail how the data is visualized centrally in Splunk and cross-referenced with users workload to analyze and troubleshoot our environment.”

SGI Powers Fionn Supercomputer at ICHEC in Ireland

Niall Wilson

In this video, Niall Wilson describes how ICHEC delivers top-quality technology services and support to universities and enterprises. “Based on the solution’s superior price performance, ICHEC deployed Fionn, a supercomputer built on SGI ICE X hardware running SUSE Linux Enterprise Server. On implementing Fionn, ICHEC was funded by Intel to work on its new many-core technology as an official Intel Parallel Computing Center.”

Video: Cray’s Peg Williams on How Supercomputing Propels Science

Peg Williams

In this video, Peg Williams from Cray describes how Supercomputing propels science.

Steve Oberlin on How NVLink will Power Coral Supercomputers

Steve_Oberlin-1066-1000px-500x319

NVlink will be the backbone of 150 Petaflop Coral supercomputers coming to ORNL and LLNL. As the world’s first high-speed GPU interconnect, NVLink will let data move between GPUs and CPUs 5-12 times faster than possible today.

Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices

Hadoop Cluster

In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”

Video: Current Status of ZFS as Backend File System for Lustre

zfs-linux

“Intel supports users, system integrators, and OEMs using ZFS with Intel Lustre. In this presentation, we summarize the results of proof-of-concept (PoC) on a variety of the ZFS configurations. We cover sequential and metadata performance, data Integrity, manageability, availability and reliability. The work identifies the areas where development should be focused in order to fill gap in performance or functionality and encourage system administrator to integrate this technology with the existing high availability framework like Pacemaker/Corosync. We also cover the most important tunables for ZFS in combination with Lustre and the most notable metrics for Lustre and ZFS.”

Asetek Lands Largest Order Yet for RackCDU with Fujitsu

imgres

Asetek has announced its first production order for its RackCDU Direct-to-Chip data center liquid cooling system under the previously announced OEM purchase agreement with Fujitsu.

Intel’s Diane Bryant on Bringing Diversity to the Tech Sector

diane

How does a woman break through the glass ceiling? In this video from the Re/Code Conference, Intel’s Diane Bryant discusses the pathway to diversity in the tech sector.