Sign up for our newsletter and get the latest HPC news and analysis.


Lustre & Kerberos: In Theory and In Practice

lug

“Kerberos is the most famous way to allow safe communications over a non-secure network, by providing authentication and encryption. This presentation will show how far Lustre can go in Kerberos security, and what kind of authentication and encryption we can get to work. We will also take an interest in the impact of various Kerberos flavors over performance.”

Interview: Intel Taking Lustre into New Markets

Brent Gorda, GM, Intel High Performance Data Division

“It’s been nearly three years since Intel acquired Whamcloud and its Lustre engineering team. With Intel’s recent announcement that Lustre will power the 2018 Aurora supercomputer at Argonne, we took the opportunity to catch up with Brent Gorda, general manager of Intel High Performance Data Division at Intel Corporation.”

Video: From Lab to Enterprise – Growing the Lustre Ecosystem

182f1d0

“Lustre’s original feature set targeted the workflows of the leading DOE labs who funded and supported its development. As the Lustre ecosystem grows, the workflows Lustre must support are becoming increasingly diverse, demanding corresponding expansion of its core feature set and the subsystems that operate around it. This talk describes how Lustre is maturing and growing to support the sometimes conflicting demands imposed by this diversity and outlines some significant areas for future development with a view to promoting ongoing discussion in the community.”

Seagate Combines Cloud, HPC, and Electronic Solutions Groups

seagate2015_2c_horizontal_pos

Today Seagate announced that it is combining its Cloud Storage, High Performance Computing, and Electronic Solutions groups to further align the company’s full breadth of enterprise storage hardware capabilities.

Petascale Comet Supercomputer Enters Early Operations

comet

“Comet is really all about providing high-performance computing to a much larger research community – what we call ‘HPC for the 99 percent’ – and serving as a gateway to discovery,” said SDSC Director Michael Norman, the project’s principal investigator. “Comet has been specifically configured to meet the needs of researchers in domains that have not traditionally relied on supercomputers to solve their problems.”

Video: Growth of Lustre Adoption and Intel’s Continued Commitment

Brent Gorda, Intel

“We are now working with over 100 channel partners globally. You can get access to Intel Lustre from almost everyone who sells storage or compute worldwide. We’re expanding this to include software partners, cloud partners. We want to create the best product possible out of this open source technology, and make it available economically to the channel partner, and enable you to go after these hugely expanding markets of cloud and big data, while not giving up on HPC.”

EOFS Elects HP’s Frank Baetke as Chairman

Frank Baetke, HP

Frank Baetke was recently elected by the EOFS Board to serve as the new chairman of the European Open File System organization.

Video: Intelligent Cache Hinting in Lustre

1573196

“Data caching can provide increased performance when using a mix of high and low performance storage, but traditional replacement algorithms like LRU may evict important data in multi-tenant environments, or in situations where the cache is “cold”. By tagging and prioritizing data within the storage system, we can create a more intelligent mechanism that avoids many of the problems inherent to traditional caching. Methods for prioritizing data and passing this information through the filesystem will be discussed, as well as a performance analysis of small file IO in Lustre with cache hinting, and possible future enhancements.”

Video: Understanding Hadoop Performance on Lustre

Hadoop Cluster

“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”