Today DDN announced a year of unprecedented growth in the usage of its advanced WOS object storage platform. In less than a year, use of the company’s object storage solutions have grown by more than 150 percent to 500+ billion objects in production. Fast-paced growth and strong demand for scale-out storage clouds have propelled DDN’s WOS to one of the industry’s top solutions based on the number of objects in production and have fortified DDN’s position as a strong market leader in object storage.
In this special guest feature, Ken Strandberg offers this live report from Day 3 of the Lustre User Group meeting in Portland. “Rick Wagner from San Diego Supercomputing Center presented progress on his team’s replication tool that allows copying large blocks of storage from object storage to their disaster recovery durable storage system. Because rsync is not a tool for moving massive amounts of data, SDSC created recursive worker services running in parallel to have each worker handle a directory or group of files. The tool uses available Lustre clients, a RabbitMQ server, Celery scripts, and bash scripts.”
“Thanks to the arrival of SSDs, the performance of storage systems can be boosted by orders of magnitude. While a considerable amount of software engineering has been invested in the past to circumvent the limitations of rotating media, there is a misbelief than a lightweight software approach may be sufficient for taking advantage of solid state media. Taking the data protection as an example, this talk will present some of the limitations of current storage software stacks. We will then discuss how this unfold to a more radical re-design of the software architecture and ultimately is making a case for an I/O interception layer.”
Today DDN introduced the “industry’s fastest and most flexible” scale-out network attached storage (NAS) solution. As the newest product in the DDN GRIDScaler product family, the GS14K, delivers the speed and scale that data intensive environments need to accelerate analytics, increase reliability and integrate into modern workflows such as Hadoop, OpenStack and scale-out NAS environments. The GS14K is offered as an All Flash Array or Hybrid Storage platform, delivering the advantages of NAS data access with the high performance benefits of parallel files systems to support today’s modern, big data demands in an economical, easy to manage appliance.
Researchers from across University College London are now benefitting from “Grace,” a new 181 Teraflop HPC system named in honor of pioneering computer scientist Grace Hopper. Designed and integrated by OCF in the UK, the Grace cluster integrates Lenovo and DDN technology to provide HPC services alongside UCL’s existing HPC machines, Legion and Emerald.
“DDN’s selection for seven consecutive years as strategic partner and storage vendor of choice by the overwhelming majority of supercomputer centers on the Top500 list is a testament to the continuous innovation and performance leadership we bring to the HPC space,” said Alex Bouzari, CEO and founder, DDN. “From SSD to Persistent Storage and Archive, File Systems to Object Stores and Burst Buffers, DDN’s comprehensive end to end data lifecycle solutions continue to power the most data-intensive workflows in the world – generation after generation.”
In this Graybeards Podcast, Molly Rector from DDN describes how HPC storage technologies are mainstreaming into the enterprise space. “In HPC there are 1000s of compute cores that are crunching on PB of data. For Oil&Gas companies, it’s seismic and wellhead analysis; with bio-informatics it’s genomic/proteomic analysis; and with financial services, it’s economic modeling/backtesting trading strategies. For today’s enterprises such as retailers, it’s customer activity analytics; for manufacturers, it’s machine sensor/log analysis; and for banks/financial institutions, it’s credit/financial viability assessments. Enterprise IT might not have 1000s of cores at their disposal just yet, but it’s not far off. Molly thinks one way to help enterprise IT is to provide a SuperComputer as a service (ScaaS?) offering, where top 10 supercomputers can be rented out by the hour, sort of like a supercomputing compute/data cloud.”
“DDN’s IME14K revolutionizes how information is saved and accessed by compute. IME software allows data to reside next to compute in a very fast, shared pool of non-volatile memory (NVM). This new data adjacency significantly reduces latency by allowing IME software’s revolutionary, fast data communication layer to pass data without the file locking contention inherent in today’s parallel file systems.”
In this video from the DDN booth at SC15, Dr. Erik Deumens of the University of Florida describes why unpredictable and less standard architectures and system configurations are necessary to meet the agility, availability and responsiveness requirements to meet the mission of innovation and exploration. “The University of Florida’s Interdisciplinary Center for Biotechnology Research (ICBR) offers access to cutting-edge technologies designed to enable university faculty, staff and students, as well as research and commercial partners worldwide with the tools and resources needed to advance scientific research.”
Today DDN announced that it fortified its position as the HPC storage market leader during 2015. According to a recently published Intersect360 Research HPC User Site Census report, DDN has largest share of installed systems at surveyed HPC sites.