“Kerberos is the most famous way to allow safe communications over a non-secure network, by providing authentication and encryption. This presentation will show how far Lustre can go in Kerberos security, and what kind of authentication and encryption we can get to work. We will also take an interest in the impact of various Kerberos flavors over performance.”
Interview: Intel Taking Lustre into New Markets
May 13, 2015 by
“It’s been nearly three years since Intel acquired Whamcloud and its Lustre engineering team. With Intel’s recent announcement that Lustre will power the 2018 Aurora supercomputer at Argonne, we took the opportunity to catch up with Brent Gorda, general manager of Intel High Performance Data Division at Intel Corporation.”
Video: From Lab to Enterprise – Growing the Lustre Ecosystem
May 10, 2015 by
“Lustre’s original feature set targeted the workflows of the leading DOE labs who funded and supported its development. As the Lustre ecosystem grows, the workflows Lustre must support are becoming increasingly diverse, demanding corresponding expansion of its core feature set and the subsystems that operate around it. This talk describes how Lustre is maturing and growing to support the sometimes conflicting demands imposed by this diversity and outlines some significant areas for future development with a view to promoting ongoing discussion in the community.”
Video: Scalability Testing of DNE2 in Lustre 2.7
May 4, 2015 by
In this video from LUG 2015 in Denver, Steve Simms from Indiana University presents: Scalability Testing of DNE2 in Lustre 2.7.
Video: Understanding Hadoop Performance on Lustre
April 27, 2015 by
“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”
Video: Monitoring a Heterogeneous Lustre Environment with Splunk
April 25, 2015 by
“Monitoring a large Lustre site, running multiple generations of Lustre filesystems can be a challenge. Some equipment offer vendor specific monitoring interfaces while others, built on open source Lustre, have minimal monitoring capabilities. This talk will report on our operational experience using a homegrown python module to collect data from each filesystem. We will discuss in detail how the data is visualized centrally in Splunk and cross-referenced with users workload to analyze and troubleshoot our environment.”
Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices
April 24, 2015 by
In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”
Video: Current Status of ZFS as Backend File System for Lustre
April 23, 2015 by
“Intel supports users, system integrators, and OEMs using ZFS with Intel Lustre. In this presentation, we summarize the results of proof-of-concept (PoC) on a variety of the ZFS configurations. We cover sequential and metadata performance, data Integrity, manageability, availability and reliability. The work identifies the areas where development should be focused in order to fill gap in performance or functionality and encourage system administrator to integrate this technology with the existing high availability framework like Pacemaker/Corosync. We also cover the most important tunables for ZFS in combination with Lustre and the most notable metrics for Lustre and ZFS.”
Video: Lustre Network (LNET) Router Configuration and Tuning
April 22, 2015 by
“n this session, Seagate covers configuration guidelines and tuning of LNET Routing from InfiniBand to Ethernet using Lustre 2.1 through 2.6 server/clients as well demonstrating performance results by means of a synthetic benchmark called IOR. In addition, this presentation includes the topic of LNET Router failure and recovery during I/O as well as what environments can expect during these failure events.”
Video: Lustre 2.8 and Beyond
April 21, 2015 by
“Andreas Dilger from Intel presents an overview on the features currently under development for the upcoming Lustre 2.8 and 2.9 releases. This includes Layout Enhancement, Progressive File Layouts, Data-on-MDT, and improved single-client metadata and IO performance. In addition, several Lustre-specific ZFS improvements are also under development that will be available in this timeframe.”
