insideHPC » LUG

Video: SPIDER II – OLCF’s Next-generation Spider File System

Rich Brueckner — Sat, 01 Jun 2013 15:54:05 +0000

In this video from the Lustre User Group 2013, Sarp Oral from ORNL presents: SPIDER II OLCF’s Next-generation Spider File System.

Download the slides (PDF) or check out more Lustre presentations at the LUG Video Gallery.

The post Video: SPIDER II – OLCF’s Next-generation Spider File System appeared first on insideHPC.

Performance & Functionality Testbed for Clustered Filesystems at Bank of Italy

Rich Brueckner — Sat, 11 May 2013 17:48:35 +0000

In this video from the Lustre User Group 2013, Giuseppe Bruno from the Bank of Italy presents: Performance & Functionality Testbed for Clustered Filesystems.

Download the slides (PDF) or check out more Lustre presentations in our LUG 2013 Video Gallery.

The post Performance & Functionality Testbed for Clustered Filesystems at Bank of Italy appeared first on insideHPC.

Video: Managing and Monitoring a Scalable Lustre Infrastructure

Rich Brueckner — Fri, 10 May 2013 16:06:00 +0000

In this video from the Lustre User Group 2013, Makia Minich from Xyratex presents: Managing and Monitoring a Scalable Lustre Infrastructure. Download the slides (PDF) or check out our LUG 2013 Video Gallery.

During his talk, Makia mentions an excellent presentation from John West entitled What’s Missing from HPC.

The post Video: Managing and Monitoring a Scalable Lustre Infrastructure appeared first on insideHPC.

Jeff Layton on Tools for Data Migration

Rich Brueckner — Fri, 10 May 2013 15:37:29 +0000

Over at HPC Admin, Dell’s Jeff Layton writes that with today’s explosive data growth, at some point you will have to migrate data from one set of storage devices to another. To help move things along, he provides an overview of data migration tools.

At some point during this growth spurt, you will have to think about migrating your data from an old storage solution to a new one, but copying the data over isn’t as easy as it sounds. You would like to preserve the attributes of the data during the migration, including xattrs (extended attributes), and losing information such as file ownership or timestamps can cause havoc with projects. Plus, you have to pay attention to the same things for directories; they are just as important as the file themselves (remember that everything is a file in Linux). In this article, I wanted to present some possible tools for helping with data migration, and I covered just a few of them. However, I also wanted to take a few paragraphs to emphasize that you need to plan your data migration if you want to succeed.

As referred to in Layton’s article, this video from the Lustre User Group 2013 features Marc Stearman from LLNL presenting: Sequoia Data Migration Experiences. Download the slides (PDF).

Read the Full Story.

The post Jeff Layton on Tools for Data Migration appeared first on insideHPC.

Video: Aeon Computing Showcases Intelligent Disk Arrays with Lustre and ZFS

Rich Brueckner — Fri, 10 May 2013 11:30:52 +0000

In this video from the Lustre User Group 2013, Doug Johnson from Aeon Computing describes the company’s Hydra storage arrays that marry the speed of Lustre with the HA capabilities of ZFS.

The Hydra60 is a combination Lustre OSS (object storage server) and OST (object storage target) with two active/active failover nodes and shared storage in a single system chassis with an ultra dense 60 drive 6Gb SAS storage infrastructure. With a unified and zonable 6Gb SAS dual-ported backplane and drives the Hydra60 can sustain a remarkable performance while providing high-availability to volumes or object storage. With external interface options including FDR Infiniband, 40/10GbE 1Gb Ethernet and supporting Linux and Lustre releases 2.x the Hydra60 makes an excellent storage platform for Lustre performance with HA operation. The design of Hydra60 provides an affordable, redundant and resilient storage platform by leveraging RAIDZ thereby eliminating the cost of hardware RAID controller technology.”

For more on Lustre, check out our LUG 2013 Video Gallery.

The post Video: Aeon Computing Showcases Intelligent Disk Arrays with Lustre and ZFS appeared first on insideHPC.

Video: Software vs. Hardware RAID and Implications for the Future

Rich Brueckner — Thu, 09 May 2013 11:00:40 +0000

In this video from the Lustre User Group 2013, Alan Poston from Xyratex presents: Software vs. Hardware RAID and Implications for the Future.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: Software vs. Hardware RAID and Implications for the Future appeared first on insideHPC.

Video: HPCS I/O Scenarios Update

Rich Brueckner — Tue, 07 May 2013 16:57:34 +0000

In this video from the Lustre User Group 2013, John Carrier from Cray presents: HPCS I/O Scenarios Update.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: HPCS I/O Scenarios Update appeared first on insideHPC.

Video: European Open Filesystem Update from LUG 2013

Rich Brueckner — Tue, 07 May 2013 14:46:00 +0000

In this video from the Lustre User Group 2013, Hugo Falter from ParTec presents: LUG2013 EOFS Update. As Director of the EOFS Administrative Council, Falter provides an excellent overview on what’s going on with European supercomputing initiatives.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: European Open Filesystem Update from LUG 2013 appeared first on insideHPC.

Video: High Availability in Lustre

Rich Brueckner — Mon, 06 May 2013 14:50:56 +0000

In this video from the Lustre User Group 2013, John Fragalla from Xyratex presents: High Availability in Lustre.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: High Availability in Lustre appeared first on insideHPC.

Video: EIOW Exascale I/O Working Group

Rich Brueckner — Sun, 05 May 2013 15:06:29 +0000

In this video from the Lustre User Group 2013, Meghan McClelland from Xyratex presents: EIOW – Exascale I/O Working Group.

There is a fierce competition on the storage market to offer the best performing devices, with great management at a low price. The EIOW group, from the outset, decided that it would not attempt to offer an end-to-end solution, which would necessarily involve competing instead of working with storage providers. The focus of EIOW is on middleware to provide, for example, schemas describing data structure and layout, novel access methods to data for applications, a uniform data management infrastructure and a framework for the implementation of layered I/O software, similar in spirit to HDF5 as a specialized use of a parallel file system. We decided EIOW should be open, and have interfaces to layer on lower level storage infrastructure such as object stores, databases and file systems as provided by storage providers, to allow their expertise and leadership in this area to continue to benefit the HPC community.

Download the EIOW whitepaper and slides, or check out our LUG 2013 Video Gallery.

The post Video: EIOW Exascale I/O Working Group appeared first on insideHPC.

Video: Details of the Xyratex Acquisition of Lustre Assets

Rich Brueckner — Thu, 02 May 2013 14:23:35 +0000

In this video from the Lustre User Group 2013, Kevin Canady from Xyratex explains the company’s plans for Lustre assets acquired recently from Oracle.

Download the slides (PDF). You can check out more Lustre presentations at our LUG 2013 Video Gallery.

The post Video: Details of the Xyratex Acquisition of Lustre Assets appeared first on insideHPC.

Video: LFSCK – Online Lustre File System Checker

Rich Brueckner — Thu, 02 May 2013 11:00:42 +0000

In this video from the Lustre User Group 2013, Alexey Zhuravlev from Intel presents: LFSCK Online Lustre File System Checker.

Download the slides (PDF). You can check out more Lustre presentations at our LUG 2013 Video Gallery.

The post Video: LFSCK – Online Lustre File System Checker appeared first on insideHPC.

Video: Wireshark for Lustre

Rich Brueckner — Wed, 01 May 2013 13:23:02 +0000

In this video from the Lustre User Group 2013, Doug Oucharek from Intel presents: Wireshark for Lustre.

Download the slides (PDF). You can check out more Lustre presentations at our LUG 2013 Video Gallery.

The post Video: Wireshark for Lustre appeared first on insideHPC.

Video: Lustre DNE – Distributed Name Space Phase 1

Rich Brueckner — Tue, 30 Apr 2013 13:11:02 +0000

In this video from the Lustre User Group 2013 conference, Di Wang from Intel presents: DNE – Distributed Name Space Phase 1.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: Lustre DNE – Distributed Name Space Phase 1 appeared first on insideHPC.

Video: Lustre 2.5 and Beyond

Rich Brueckner — Mon, 29 Apr 2013 11:00:36 +0000

In this video from the Lustre User Group 2013 conference, Andreas Dilger from Intel presents: Lustre 2.5 and Beyond.

Download the slides (PDF) or check out our LUG 2013 Video Gallery.

The post Video: Lustre 2.5 and Beyond appeared first on insideHPC.

Video: Lustre on Amazon Web Services

Rich Brueckner — Wed, 24 Apr 2013 17:13:07 +0000

In this video from the Lustre User Group 2013 conference, Robert Read from Intel presents: Lustre on Amazon Web Services.

Download the slides (PDF). You can check out more Lustre presentations at our LUG 2013 Video Gallery.

The post Video: Lustre on Amazon Web Services appeared first on insideHPC.

Video: Hadoop MapReduce over Lustre

Rich Brueckner — Tue, 23 Apr 2013 11:30:40 +0000

In this video from the Lustre User Group 2013 conference, Omkar Kulkarni from Intel presents: Hadoop MapReduce over Lustre.

Download the slides (PDF).You can check out more Lustre presentations at our LUG 2013 Video Gallery.

The post Video: Hadoop MapReduce over Lustre appeared first on insideHPC.

Video: Warp Mechanics ZFS Array

Rich Brueckner — Mon, 22 Apr 2013 18:12:03 +0000

In this video from the Lustre User Group 2013 conference, Josh Judd from Warp Mechanics presents: Warp Mechanics ZFS Array.

The WARP Mechanics 39830 is a turnkey network-attached non-volatile RAM + SSD system with industry-leading price, performance, and scalability. This system maximizes the IOPs performance for the most demanding application profiles. It is an ultra-dense space and power saving solution. This is optimal for large-scale IO intensive workloads with large live data sets. The 50x high capacity 2TB SSD modules per 4U enclosure are configured into five 10-disk RAID 6 sets to maximize protection and performance. Each RAID set has a two NV-RAM modules serving as write cache. These RAID sets are added to the overall ZFS storage pool and can be allocated to a nearly limitless number of any sized volumes presented to hosts. This yields a flexible 100TB of usable RAID protected SSD storage.

Download the slides (PDF). Check out more Lustre presentation videos at our LUG 2013 Video Gallery.

The post Video: Warp Mechanics ZFS Array appeared first on insideHPC.

Video: Lustre – Fast Forward to Exascale

Rich Brueckner — Mon, 22 Apr 2013 15:49:11 +0000

In this video from the Lustre User Group 2013 conference, Eric Barton from Intel presents: Lustre – Fast Forward to Exascale.

Back in July 2012, Whamcloud was awarded the Storage and I/O Research & Development subcontract for the Department of Energy’s FastForward program. Shortly afterward, the company was acquired by Intel. The two-year contract scope includes key R&D necessary for a new object storage paradigm for HPC exascale computing, and the developed technology will also address next-generation storage mechanisms required by the Big Data market.

The subcontract incorporates application I/O expertise from the HDF Group, system I/O and I/O aggregation expertise from EMC Corporation, object storage expertise from DDN, and scale testing facilities from Cray, teamed with file system, architecture, and project management skills from Whamcloud. All components developed in the project will be open sourced and benefit the entire Lustre community.

Download the slides (PDF). Check out more presentations at our LUG 2013 Video Gallery.

The post Video: Lustre – Fast Forward to Exascale appeared first on insideHPC.

Video: Aeon Computing Lustre Storage at LUG 2013

Rich Brueckner — Mon, 22 Apr 2013 11:00:44 +0000

In this video from LUG 2013, Jeff Johnson from Startup Aeon Computing presents an overview of the company’s innovative Lustre storage solutions.

There are many storage solutions available in the market but not all of them do Lustre well. We set out to design a Lustre platform that was good at Lustre data and I/O profiles. Part of that design, in addition to performance, is that it follows Aeon Computing’s business philosophy in that there is no unnecessary, extraneous bull___t that gets in the way.

Download the slides (PDF). Read the Full Story or check out more presentations at our LUG 2013 Video Gallery.

The post Video: Aeon Computing Lustre Storage at LUG 2013 appeared first on insideHPC.