InfiniCortex and the Renaissance in Polish Supercomputing

“Over the past two years, InfiniCortex has clearly demonstrated that IB can perform over trans-continental distances, exploiting this technology to create a “Galaxy of Supercomputers,” a worldwide IB network spanning sites across Asia, Europe and North America. Initiated and led by A*STAR CRC in Singapore, the project hit its first major breakthrough at SC14, showcasing a first-time-ever 100G IB transcontinental connection from Singapore to the SC14 venue in New Orleans.”

NCAR’s Evolving Infrastructure for Weather and Climate Research

Pamela Hill from NCAR/UCAR presented this talk at the DDN User Group at SC16. “With the game-changing SFA14K, NCAR now has the storage capacity and sustained compute performance to perform sophisticated modeling while substantially reducing workflow bottlenecks. As a result, the organization will be able to quickly process mixed I/O workloads while sharing up to 40 PBs of vital research data with a growing scientific community around the world.”

Oakforest-PACS: Overview of the Fastest Supercomputer in Japan

Prof. Taisuke Boku from the University of Tsukuba & JCAHPC presented this talk at the DDN User Group at SC16. “Thanks to DDN’s IME Burst Buffer, researchers using Oakforest-PACS at the Joint Center for Advanced High Performance Computing (JCAHPC) are able to improve modeling of fundamental physical systems and advance understanding of requirements for Exascale-level systems architectures. With DDN’s advanced technology, JCAHPC has achieved effective I/O performance exceeding 1TB/s in writing tens of thousands of processes to the same file.”

How Researchers Will Benefit from Canada’s National Data Cyberinfrastructure

“Individual institutions or organizations will have opportunities to deploy storage locally and can federate their local repository into the national system,” says Dr. Greg Newby, Compute Canada’s Chief Technology Officer. “This provides enhanced privacy and sharing capabilities on a robust, country-wide solution with improved data security and back-up. This is a great solution to address the data explosion we are currently experiencing in Canada and globally.”

DDN User Group Coming to SC16 Nov. 14

The DDN User Group meeting is returning to Salt Lake City for SC16. The meeting takes place Monday, Nov. 14 from 2pm-6pm at the Radisson Hotel near the convention center.

Video: Profiling Genome Pipeline I/O with DDN and the Sanger Institute

“The data that I presented from the Sanger Institute is typical of the profiles that we come across: a mix of good streaming IO (ie the larger reads), but unexpectedly high numbers of small reads and writes. These small reads and writes are potentially harmful to the file system. We’ve profiled HPC applications in various different life sciences organizations, not just the Sanger Institute, and we’ve found these IO patterns throughout. We’ve also seen similar IO patterns in EDA and oil and gas applications.”

Video: Data Storage Infrastructure at University of Queensland

“Data Science and Information Systems researchers at UQ are tackling the challenges of big data, real-time analytics, data modeling and smart information use. The cutting-edge solutions developed at UQ will lead to user empowerment at an individual, corporate and societal level. Our researchers are making a sustained and influential contribution to the management, modeling, governance, integration, analysis and use of very large quantities of diverse and complex data in an interconnected world.”

Video: End to End Infrastructure Design for Large Scale Genomics

In this video from the DDN User Group at SC15, Kevin Behn from the HudsonAlpha Institute for Biotechnology presents: End to End Infrastructure Design for Large Scale Genomics. “HudsonAlpha has generated major discoveries that impact disease diagnosis and treatment, created intellectual property, fostered biotechnology companies and expanded the number of biosciences-literate people, many of whom will take their place among the future life sciences workforce. Additionally, HudsonAlpha has created one of the world’s first end-to-end genomic medicine programs to diagnose rare disease. Genomic research, educational outreach, clinical genomics and economic development: each of these mission areas advances the quality of life.”

Towards the Convergence of HPC and Big Data — Data-Centric Architecture at TACC

Dan Stanzione from TACC presented this talk at the DDN User Group at SC15. “TACC is an advanced computing research center that provides comprehensive advanced computing resources and support services to researchers in Texas and across the USA. The mission of TACC is to enable discoveries that advance science and society through the application of advanced computing technologies. Specializing in high performance computing, scientific visualization, data analysis & storage systems, software, research & development and portal interfaces, TACC deploys and operates advanced computational infrastructure to enable computational research activities of faculty, staff, and students of UT Austin.”

Video: Early Evaluation of IME as a Burst Buffer and Application Accelerator

Dirk Pleiter from the Jülich Supercomputing Centre presented this talk at the DDN User Group at SC15. “IME unleashes a new I/O provisioning paradigm. This breakthrough, software defined storage application introduces a whole new new tier of transparent, extendable, non-volatile memory (NVM), that provides game-changing latency reduction and greater bandwidth and IOPS performance for the next generation of performance hungry scientific, analytic and big data applications – all while offering significantly greater economic and operational efficiency than today’s traditional disk-based and all flash array storage approaches that are currently used to scale performance.”