Sign up for our newsletter and get the latest HPC news and analysis.

Video: Understanding Hadoop Performance on Lustre

Hadoop Cluster

“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”

Video: Lustre Network (LNET) Router Configuration and Tuning

fragalla

“n this session, Seagate covers configuration guidelines and tuning of LNET Routing from InfiniBand to Ethernet using Lustre 2.1 through 2.6 server/clients as well demonstrating performance results by means of a synthetic benchmark called IOR. In addition, this presentation includes the topic of LNET Router failure and recovery during I/O as well as what environments can expect during these failure events.”

Introduction to the Lustre File System

lustre-logo2

Although there are a number of truly huge implementations of Lustre today, the community is still far from reaching the maximum configurations that the Lustre architecture is designed for. Inside the Lustre File System describes the basics of how the Lustre File System operates with descriptions of the newest features.

Video: New and Improved Lustre Performance Monitoring Tool

torben

“With the current Lustre Performance Monitoring Tool (LMT) no longer in active development, and the current version incompatible with DNE based Lustre 2.5 deployments, there is a critical need for a new set of tools delivering the same basic Lustre performance metrics with the added ability to work compatibly with contemporary releases of Lustre.”

Seagate Powers 120 Petabytes of HPC Storage with Cray

products_sonexion_photo_01

“The Cray-Seagate partnership is helping expand the boundaries of what’s possible in large-scale, data-intensive computing, far beyond what we could have imagined just 10 years ago. This continued innovation using the Lustre open file system is helping assist data-intense applications critical to advancements in important industries around the world.”

Video: Seagate Lustre Update

bojanic

In this video from LUG 2015 in Denver, Peter Bojanic from Seagate presents: Seagate Lustre Update. “Seagate powers four of the five 1 TB/sec filesystems in the world today.”

Video: Lustre Based Enterprise Storage – Tuning Clients for Optimal Performance

torben

“The architecture of the ClusterStor product line builds on 25 years of experience with storage systems, Seagate (formerly Xyratex) and Lustre on a parallel open source high performance storage system that is commonly used for scalable computing.”

Seagate ClusterStor Secure Data Appliance

Secure Data Appliance

The Seagate ClusterStor Secure Data Appliance (SDA) is the HPC industry’s first scale-out secure storage system officially ICD-503 certified to consolidate multiple previously isolated systems, maintain data security, enforce security access controls, segregate data at different security levels, and provide audit trails, all in a single scale-out file system with proven linear performance and storage scalability.

Inside Lustre Hierarchical Storage Management (HSM)

Hierarchical Storage Management

There is always different levels of importance assigned to various data files in a computer system, specifically a very large system that is storing petabytes of data. In order to maximize the use of the highest speed storage, Hierarchical Storage Management (HSM) was developed to move and store data within easy use of users, yet at the appropriate speed and price.

Developing Multilevel Security (MLS) Framework

Multilevel secure framework

This is the third article in a series designed to address the needs of government and business or collaborative and secure information sharing within a Multilevel Security (MLS) framework. Learn the key elements of a workable Multilevel Security framework.