MailChimp Developer

Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Video: Understanding Hadoop Performance on Lustre

Hadoop Cluster

“In this talk, Seagate presents details on its efforts and achievements around improving Hadoop performance on Lustre including a summary on why and how HDFS and Lustre are different and how those differences affect Hadoop performance on Lustre compared to HDFS, Hadoop ecosystem benchmarks and best practices on HDFS and Lustre, Seagate’s open-source efforts to enhance performance of Lustre within “diskless” compute nodes involving core Hadoop source code modification (and the unexpected results), and general takeaways ways on running Hadoop on Lustre more rapidly.”

Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices

Hadoop Cluster

In this video from LUG 2015 in Denver, J.Mario Gallegos from Dell presents: Deploying Hadoop on Lustre Storage: Lessons Learned and Best Practices. “Merging of strengths of both technologies to solve big data problems permits harvesting the power of HPC clusters on very fast storage.”

TACC’s “Wrangler” Uses DSSD Technology for Data-Intensive Computing

article

Today the Texas Advanced Computing Center announced that the Wrangler data analysis and management supercomputing system is now in early operations for the open science community. Supported by a grant from the NSF, Wrangler uses innovative DSSD technology for data-intensive computing.

The High Performance Data Analytics Market

HPDA

As data analytics becomes more mission critical, hardware and software need to evolve to handle both historical data (batch) and real time streaming data. This combined ability to manage different types of data is critical for a wide range of organizations.

ISC Cloud & Big Data Keynote to Focus on IT Transformation at DZ Bank

Dr. Jan Vitt, DZ Bank

Today the ISC Cloud & Big Data Conference announced that Dr. Jan Vitt from DZ Bank will keynote their event in September.

NCDS Takes Action on Big Data

Stan Ahalt, chair of the steering committee for the National Consortium for Data Science

In this special guest feature from Scientific Computing World, Stan Ahalt from the National Consortium for Data Science discusses how and why the organization came into being.

SGI Solutions for Next Generation Sequencing

SGI UV 2000

The SGI UV system allows computational biologists to take a different, far more effective approach to dealing with the huge data sets generated by contemporary Next Generation Sequencing (NGS) and analytic applications.

Video: Accelerating Big Data Processing with Hadoop, Spark and Memcached

DK Panda, Ohio State University

“Using the publicly available software packages in the High-Performance Big Data (HiBD) project, we will provide case studies of the new designs for several Hadoop/Spark/Memcached components and their associated benefits. Through these case studies, we will also examine the interplay between high performance interconnects, storage systems (HDD and SSD), and multi-core platforms to achieve the best solutions for these components.”

Internet of Things & What it Means to Fabrics

Open Fabric Alliance

In this video from the 2015 OFS Developer’s Workshop, Guy Ailee from Intel presents: Internet of Things & What it Means to Fabrics.

Nvidia Showcases Deep Learning Technology

Jen-Hsun Huang and Elon Musk

Nvidia’s GPU Technology Conference (GTC), being held in San Jose California this week, showcased a combination of hardware and software aimed at driving the development of a branch of machine learning called ‘deep learning’.