Sign up for our newsletter and get the latest HPC news and analysis.


Jeff Layton on How 3D Flash is Changing the Market

Jeff Layton

“For a period of time, it didn’t look like flash drives were going to decrease in price very much. Flash cell technology is limited to around 20nm because of cost and complexity considerations, but manufacturers have found ways around the limitation. Rather than decrease the features size, they now store more bits per cell (TLC) and have started to create 3D flash chips. This combination, plus the growth in flash storage sales, has driven down the price per gigabyte.”

Video: Monitoring a Heterogeneous Lustre Environment with Splunk

lug

“Monitoring a large Lustre site, running multiple generations of Lustre filesystems can be a challenge. Some equipment offer vendor specific monitoring interfaces while others, built on open source Lustre, have minimal monitoring capabilities. This talk will report on our operational experience using a homegrown python module to collect data from each filesystem. We will discuss in detail how the data is visualized centrally in Splunk and cross-referenced with users workload to analyze and troubleshoot our environment.”

Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices

Hadoop Cluster

In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”

SGI Powers Earthquake Research in Japan

imgres

Today SGI announced that the Earthquake and Volcano Information Center of the Earthquake Research Institute (ERI) at the University of Tokyo, has deployed a large-scale parallel computing solution from SGI for leading-edge seismological and volcanological research.

Dell’s GDAP Delivers an Integrated Genomic Processing Infrastructure

Genomics processing

Dell has teamed with Intel to create innovative solutions that can accelerate the research, diagnosis and treatment of diseases through personalized medicine. The combination of leading-edge CPUs from Intel and the systems and storage expertise from Dell create a state-of-the-art solution that is easy to install, manage and expand as required.

The High Performance Data Analytics Market

HPDA

As data analytics becomes more mission critical, hardware and software need to evolve to handle both historical data (batch) and real time streaming data. This combined ability to manage different types of data is critical for a wide range of organizations.

NCI Boosts Storage to 44 Petabytes with Fujitsu & NetApp

logo_nci

NCI in Australia has signed a $2M deal with Fujitsu to work with storage and data management company NetApp to supply and install all-flash storage arrays with a raw storage capacity of 11 petabytes, bringing NCI’s total raw storage capacity from 33 petabytes to 44 petabytes.

Video: New and Improved Lustre Performance Monitoring Tool

torben

“With the current Lustre Performance Monitoring Tool (LMT) no longer in active development, and the current version incompatible with DNE based Lustre 2.5 deployments, there is a critical need for a new set of tools delivering the same basic Lustre performance metrics with the added ability to work compatibly with contemporary releases of Lustre.”

Seagate Powers 120 Petabytes of HPC Storage with Cray

products_sonexion_photo_01

“The Cray-Seagate partnership is helping expand the boundaries of what’s possible in large-scale, data-intensive computing, far beyond what we could have imagined just 10 years ago. This continued innovation using the Lustre open file system is helping assist data-intense applications critical to advancements in important industries around the world.”

Video: Shared File Performance in Lustre – Challenges and Solutions

Patrick Farrell

“Large scale HPC IO is usually done either with a file per process or to a single shared file. Single shared file IO does not scale well in Lustre compared to file per process. This presentation from Cray’s Patrick Farrell will give details, examine the reasons for this, and explore existing and potential solutions. Group locks and a new feature, lock ahead, will be discussed in the context of strided IO.”