With ISC 2016 coming up in June, a number of ancillary events have been scheduled in Frankfurt to take advantage of this annual gathering of over 2500 supercomputing professionals. We’ve compiled a full listing for what looks to be an exciting week in the history of high performance computing.
Today DataDirect Networks announced DDN Flashscale, a new family of all-flash scale-out and scale-up storage solutions, which delivers the highest performance and capacity in a cost-optimized and feature rich platform designed for Enterprise Big Data and Analytics, Web Scale Cloud, and HPC environments. “DDN Flashscale’s fast embedded PCIe fabric delivers full native performance and extreme low latency from 48 NVMe or 72 SAS or any mix of SSDs while offering cost optimized sub $1/GB all-flash storage up to 576TB, 6 Million IOPS and 60GB/s per 4U node.”
In this special guest feature from Scientific Computing World, Shailesh M Shenoy from the Albert Einstein College of Medicine in New York discusses the challenges faced by large medical research organizations in the face of ever-growing volumes of data. “In short, our challenge was that we needed the ability to collaborate within the institution and with colleagues at other institutes – we needed to maintain that fluid conversation that involves data, not just the hypotheses and methods.”
Today DDN announced a year of unprecedented growth in the usage of its advanced WOS object storage platform. In less than a year, use of the company’s object storage solutions have grown by more than 150 percent to 500+ billion objects in production. Fast-paced growth and strong demand for scale-out storage clouds have propelled DDN’s WOS to one of the industry’s top solutions based on the number of objects in production and have fortified DDN’s position as a strong market leader in object storage.
In this special guest feature, Ken Strandberg offers this live report from Day 3 of the Lustre User Group meeting in Portland. “Rick Wagner from San Diego Supercomputing Center presented progress on his team’s replication tool that allows copying large blocks of storage from object storage to their disaster recovery durable storage system. Because rsync is not a tool for moving massive amounts of data, SDSC created recursive worker services running in parallel to have each worker handle a directory or group of files. The tool uses available Lustre clients, a RabbitMQ server, Celery scripts, and bash scripts.”
“Thanks to the arrival of SSDs, the performance of storage systems can be boosted by orders of magnitude. While a considerable amount of software engineering has been invested in the past to circumvent the limitations of rotating media, there is a misbelief than a lightweight software approach may be sufficient for taking advantage of solid state media. Taking the data protection as an example, this talk will present some of the limitations of current storage software stacks. We will then discuss how this unfold to a more radical re-design of the software architecture and ultimately is making a case for an I/O interception layer.”
Today DDN introduced the “industry’s fastest and most flexible” scale-out network attached storage (NAS) solution. As the newest product in the DDN GRIDScaler product family, the GS14K, delivers the speed and scale that data intensive environments need to accelerate analytics, increase reliability and integrate into modern workflows such as Hadoop, OpenStack and scale-out NAS environments. The GS14K is offered as an All Flash Array or Hybrid Storage platform, delivering the advantages of NAS data access with the high performance benefits of parallel files systems to support today’s modern, big data demands in an economical, easy to manage appliance.
Researchers from across University College London are now benefitting from “Grace,” a new 181 Teraflop HPC system named in honor of pioneering computer scientist Grace Hopper. Designed and integrated by OCF in the UK, the Grace cluster integrates Lenovo and DDN technology to provide HPC services alongside UCL’s existing HPC machines, Legion and Emerald.
“DDN’s selection for seven consecutive years as strategic partner and storage vendor of choice by the overwhelming majority of supercomputer centers on the Top500 list is a testament to the continuous innovation and performance leadership we bring to the HPC space,” said Alex Bouzari, CEO and founder, DDN. “From SSD to Persistent Storage and Archive, File Systems to Object Stores and Burst Buffers, DDN’s comprehensive end to end data lifecycle solutions continue to power the most data-intensive workflows in the world – generation after generation.”
In this Graybeards Podcast, Molly Rector from DDN describes how HPC storage technologies are mainstreaming into the enterprise space. “In HPC there are 1000s of compute cores that are crunching on PB of data. For Oil&Gas companies, it’s seismic and wellhead analysis; with bio-informatics it’s genomic/proteomic analysis; and with financial services, it’s economic modeling/backtesting trading strategies. For today’s enterprises such as retailers, it’s customer activity analytics; for manufacturers, it’s machine sensor/log analysis; and for banks/financial institutions, it’s credit/financial viability assessments. Enterprise IT might not have 1000s of cores at their disposal just yet, but it’s not far off. Molly thinks one way to help enterprise IT is to provide a SuperComputer as a service (ScaaS?) offering, where top 10 supercomputers can be rented out by the hour, sort of like a supercomputing compute/data cloud.”