Sign up for our newsletter and get the latest HPC news and analysis.

Video: Understanding Hadoop Performance on Lustre

Hadoop Cluster

“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”

Penguin Computing Extends Open Networking with Artica Switches

Penguin-4804ip-network-switch-10

Today Penguin Computing announced the Arctica 4804ip switch and a collaboration with Cumulus Networks.

PBS Pro Becomes Cray’s Preferred Workload Manager

Altair Logo Stacked

Today Altair announced an original equipment manufacturer (OEM) agreement with Cray Inc. PBS Professional is now Cray’s preferred workload manager and job scheduler.

Call for Papers: Novel Mathematical Methods for Exascale

Journal

The Journal of Computational Science is seeking submissions for a special issue on The Route to Exascale: Novel Mathematical Methods, Scalable Algorithms Skills Training.

Video: Lustre + Linux – Putting the House in Order

tux

In this video from LUG 2015 in Denver, James Simmons from ORNL presents: Lustre + Linux – Putting the House in Order. “In the last year great strides have been made to sync up the lustre Intel branch to what is upstream. We present what that current state is as well as what is left for the intel branch to bring this to completion.”

Video: Monitoring a Heterogeneous Lustre Environment with Splunk

lug

“Monitoring a large Lustre site, running multiple generations of Lustre filesystems can be a challenge. Some equipment offer vendor specific monitoring interfaces while others, built on open source Lustre, have minimal monitoring capabilities. This talk will report on our operational experience using a homegrown python module to collect data from each filesystem. We will discuss in detail how the data is visualized centrally in Splunk and cross-referenced with users workload to analyze and troubleshoot our environment.”

Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices

Hadoop Cluster

In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”

SGI Powers Earthquake Research in Japan

imgres

Today SGI announced that the Earthquake and Volcano Information Center of the Earthquake Research Institute (ERI) at the University of Tokyo, has deployed a large-scale parallel computing solution from SGI for leading-edge seismological and volcanological research.

Accelerating the Piz Daint Supercomputer with Allinea

Piz_Daint_left_person_LR

Today Allinea Software released details on partnership that is helping scientists in research and industry to exploit Piz Daint – Europe’s most powerful supercomputer.

Univa Rolls Out Universal Resource Broker

univa

Today Univa announced the Universal Resource Broker, an enterprise-class workload optimization solution for high performance, containerized and shared data centers.