MailChimp Developer

Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Lustre* Accelerates the Convergence of Big Data and HPC in Financial Services

Across industries, companies are beginning to watch the convergence of High-performance Computing (HPC) and Big Data. Many organizations in the Financial Services Industry (FSI) are running their financial simulations on business analytics systems, some on HPC clusters. But they have a growing problem: integrating analytics of non-structured data from sources like social media with their internal data. Learn how Lustre can help solves these challenges.

Bull Atos Installs Fastest Supercomputer in Croatia

Bull Atos has installed the fastest supercomputer in Croatia at the University in Rijeka. With an expected debut on the TOP500 in November, the 239 Teraflop BURA supercomputer will be used by university researchers in areas including drug discovery and genomics.

OpenSFS to Sponsor Two Lustre BoFs at SC15

OpenSFS is sponsoring two Lustre BoFs at SC15 in Austin. As a nonprofit organization, OpenSFS was founded in 2010 to advance Lustre development, ensuring it remains vendor-neutral, open, and free.

Video: Prologue O/S – Improving the Odds of Job Success

“When looking to buy a used car, you kick the tires, make sure the radio works, check underneath for leaks, etc. You should be just as careful when deciding which nodes to use to run job scripts. At the NASA Advanced Supercomputing Facility (NAS), our prologue and epilogue have grown almost into an extension of the O/S to make sure resources that are nominally capable of running jobs are, in fact, able to run the jobs. This presentation describes the issues and solutions used by the NAS for this purpose.”

Video: DDN Infinite Memory Engine IME

Tommaso Cecchi from DDN presented this talk at the HPCAC Spain Conference. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Lustre Video: Robinhood v3 Policy Engine and Beyond

“The Robinhood Policy Engine is a versatile tool to manage contents of large file systems. It maintains a replicate of filesystem medatada in a database that can be queried at will. It makes it possible to schedule mass action on filesystem entries by defining attribute-based policies.”

Operational Characteristics of a ZFS-backed Lustre Filesystem

In this video from the LAD’15 Conference, Daniel Kobras from science+computing presents: Operational Characteristics of a ZFS-backed Lustre Filesystem.

Video: Infinite Memory Engine (IME) Burst Buffer Experience at CSCS

Hussein Harake from CSCS presented this talk at the HPC Advisory Council Spain Conference. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Video: Intel Commitment to Lustre

“For High Performance Computing users who leverage open-source Lustre software, a good file system for big data is now getting even better. Building on its substantial contributions to the Lustre community, Intel is rolling out new features that will make the file system more scalable, easier to use, and more accessible to enterprise customers.”

Video: Lustre 2.9 and Beyond

“Andreas presents an overview on the features currently under development for the upcoming Lustre 2.8 and 2.9 releases. This includes Layout Enhancement, Progressive File Layouts, Data-on-MDT, and improved single-client metadata and IO performance. In addition, several Lustre-specific ZFS improvements are also under development that will be available in this timeframe.”