Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


DDN and IBM Team on 50 TB per Day, Inter-Continental Active Archive Solution

Today DDN announced that Yahoo Japan has deployed an active archive system jointly developed by DDN and IBM Japan. The new system allows Yahoo! JAPAN to cache dozens of petabytes of data from its OpenStack Swift storage solution in a Japan-based data center, and transfer data to a U.S.-based data center at an astonishing rate of 50 TB of data per day – thus enabling energy cost savings of 74 percent due to lower energy rates in the United States versus Japan, while ensuring fast data access regardless of location.

How Researchers Will Benefit from Canada’s National Data Cyberinfrastructure

“Individual institutions or organizations will have opportunities to deploy storage locally and can federate their local repository into the national system,” says Dr. Greg Newby, Compute Canada’s Chief Technology Officer. “This provides enhanced privacy and sharing capabilities on a robust, country-wide solution with improved data security and back-up. This is a great solution to address the data explosion we are currently experiencing in Canada and globally.”

Increasing the Efficiency of Storage Systems

Have you ever wondered why your HPC installation is not performing as you had envisioned ? You ran small simulations. You spec’d out the CPU speed, the network speed and the disk drive speed. You optimized your application and are taking advantage of new architectures. But now as you scale the installation, you realize that the storage system is not performing as expected. Why ? You bought the latest disk drives and expect even better than linear performance from the last time you purchased a storage system. Read how you can get increased efficiency of your storage system.

Video: Behind the Machine at HPE

How is Hewlett Packard Enterprise reinventing the fundamental architecture on which all computers have been built for the past 60 years? In this video, HPC describes the evolution of The Machine research project – one of the largest and most complex research projects in the company’s history – and how HPE demonstrated the world’s first Memory-Driven Computing architecture.

RAID Inc. Steps up with ZFS on Lustre at SC16

In this video from SC16, Brad Merchant from RAID Inc. describes the company’s new Lustre ZFS Building Block. “RAID Inc. offers a suite of building block product families that can be purchased individually or in conjunction with other RAID products to solve customer’s needs in the most demanding data-storage environments. Each product is customized to address customer’s individual requirements of performance, reliability, scalability and price. Each product is put through extensive testing and a burn-in/staging process which ensures customers will receive a solution designed to function as specified in their unique environment.”

DDN IME Burst Buffer Exceeds 1 TB/s for Japan’s Fastest Supercomputer

“Storage performance has been one of the biggest challenges in developing supercomputers. To meet the demands for storage performance, IME was introduced to the Oakforest-PACS on a massive scale, the first such introduction in the world,” said Osamu Tatebe, lead, public relations, JCAHPC / professor, Center for Computational Sciences, University of Tsukuba. “We are very pleased that we could achieve effective I/O performance exceeding 1 TB per second in writing tens of thousands of processes to the same file. With this new storage technology, we believe that we will be able to contribute to society with the further development of computational science, big data analysis and machine learning.”

DDN Re-Energizes HPC Workflows at SC16

“At SC16, DDN demonstrated centralized storage implementations that accelerate financial and scientific analytics by 5x – extracting maximum efficiency, value and ROI in real-world customer environments using DDN products and solutions with open and commercial software including OpenStack and Hadoop. In addition to the demonstrations, DDN also highlighted its customer use cases with other open and commercial software such as Informatica, SAS GRID, R and Ab Initio, among others.”

Huawei Showcases HPC Solutions at SC16

“Huawei has increasingly become more prominent in the HPC market. It has successfully deployed HPC clusters for a large number of global vehicle producers, large-scale supercomputing centers, and research institutions. These show that Huawei’s HPC platforms are optimized for industry applications which can help customers significantly simplify service processes and improve work efficiency, enabling them to focus on product development and research.”

13.7 Petaflop MareNostrum 4 Supercomputer Coming to BSC

Today the Barcelona Supercomputing Center announced plans to MareNostrum 4, a 13.7 Petaflop supercomputer that will be 12.4 times more powerful than the current MareNostrum 3 system. In a contract valued at almost €30 million, IBM will integrate in one sole machine using its own technologies alongside those of Lenovo, Intel, and Fujitsu.

Avere Speeds Hybrid Cloud at SC16

“Avere Hybrid Cloud is a groundbreaking solution that changes the economics and functionality of data storage and computing. Avere Hybrid Cloud enables companies to leverage public and private storage clouds, IaaS, and elastic compute for workloads previously limited to on-premises high-performance (HPC) storage systems. With Avere Systems, you can achieve unlimited performance scaling, eliminate latency and cut storage costs by more than 50%.”