Sign up for our newsletter and get the latest HPC news and analysis.
Send me information from insideHPC:


Top Weather and Climate Sites run on DDN Storage

“DDN’s unique ability to handle tough application I/O profiles at speed and scale gives weather and climate organizations the infrastructure they need for rapid, high-fidelity modeling,” said Laura Shepard, senior director of product marketing, DDN. “These capabilities are essential to DDN’s growing base of weather and climate organizations, which are at the forefront of scientific research and advancements – from whole climate atmospheric and oceanic modeling to hurricane and severe weather emergency preparedness to the use of revolutionary, new, high-resolution satellite imagery in weather forecasting.”

Future Technologies on the Rise for HPC

“2017 will see the introduction of many technologies that will help shape the future of HPC systems. Production-scale ARM supercomputers, advancements in memory and storage technology such as DDN’s Infinite Memory Engine (IME), and much wider adoption of accelerator technologies and from Nvidia, Intel and FPGA manufacturers such as Xilinx and Altera, are all helping to define the supercomputers of tomorrow.”

DDN IME Burst Buffer Exceeds 1 TB/s for Japan’s Fastest Supercomputer

“Storage performance has been one of the biggest challenges in developing supercomputers. To meet the demands for storage performance, IME was introduced to the Oakforest-PACS on a massive scale, the first such introduction in the world,” said Osamu Tatebe, lead, public relations, JCAHPC / professor, Center for Computational Sciences, University of Tsukuba. “We are very pleased that we could achieve effective I/O performance exceeding 1 TB per second in writing tens of thousands of processes to the same file. With this new storage technology, we believe that we will be able to contribute to society with the further development of computational science, big data analysis and machine learning.”

Podcast: Molly Rector from DDN on the Changing Face of HPC Storage

In this Graybeards Podcast, Molly Rector from DDN describes how HPC storage technologies are mainstreaming into the enterprise space. “In HPC there are 1000s of compute cores that are crunching on PB of data. For Oil&Gas companies, it’s seismic and wellhead analysis; with bio-informatics it’s genomic/proteomic analysis; and with financial services, it’s economic modeling/backtesting trading strategies. For today’s enterprises such as retailers, it’s customer activity analytics; for manufacturers, it’s machine sensor/log analysis; and for banks/financial institutions, it’s credit/financial viability assessments. Enterprise IT might not have 1000s of cores at their disposal just yet, but it’s not far off. Molly thinks one way to help enterprise IT is to provide a SuperComputer as a service (ScaaS?) offering, where top 10 supercomputers can be rented out by the hour, sort of like a supercomputing compute/data cloud.”

Video: Meet IME – The World’s First Burst Buffer

“DDN’s IME14K revolutionizes how information is saved and accessed by compute. IME software allows data to reside next to compute in a very fast, shared pool of non-volatile memory (NVM). This new data adjacency significantly reduces latency by allowing IME software’s revolutionary, fast data communication layer to pass data without the file locking contention inherent in today’s parallel file systems.”

Video: Early Evaluation of IME as a Burst Buffer and Application Accelerator

Dirk Pleiter from the Jülich Supercomputing Centre presented this talk at the DDN User Group at SC15. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Video: DDN Infinite Memory Engine IME

Tommaso Cecchi from DDN presented this talk at the HPCAC Spain Conference. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Video: Infinite Memory Engine (IME) Burst Buffer Experience at CSCS

Hussein Harake from CSCS presented this talk at the HPC Advisory Council Spain Conference. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Video: Application Experiences on DDN’s IME Burst Buffer

“The DDN Infinite Memory Engine (IME) unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”

Video: Early IME Experience with an Oil & Gas Code

ICHEC is using DDN’s Infinite Memory Engine (IME) to accelerate Read and Write speeds in order to test ICHEC’s codes used by Tullow Oil, Africa’s leading independent oil company. In this talk, Browne shows how IME accelerated current workflows and reduced run time, opening the door to significantly faster resource discovery.