Olaf Weber from SGI presented this talk at LUG 2016. “In collaboration with Intel, SGI set about creating support for multiple network connections to the Lustre filesystem, with multi-rail support. With Intel Omni-Path and EDR Infiniband driving to 200Gb/s or 25GB/s per connection, this capability will make it possible to start moving data between a single SGI UV node and the Lustre file system at over 100GB/s.”
Today NERSC announced plans to host a new, data-centric event called Data Day. The main event will take place on August 22, followed by a half-day hackathon on August 23. The goal: to bring together researchers who use, or are interested in using, NERSC systems for data-intensive work.
Today Seagate unveiled a first-of-its kind, high-capacity drive that can help data centers more easily accommodate exponential data growth, while still maintaining high levels of computing power and performance. The two terabyte (TB) version of its Nytro XM1440 M.2 non-volatile memory express (NVMe) Solid State Drive (SSD) is the highest-capacity, enterprise-class M.2 NVMe SSD available today, making it well suited for demanding enterprise applications that require fast data access, capacity and processing. “This latest version of the Nytro XM1440 M.2 NVMe SSD is the first of its kind and pushes the boundaries for enterprises, so they don’t have to sacrifice speed for access and availability. They can continue to scale operations in an efficient manner and still get the most value from their data, but without the extra overhead.”
“Memory1 provides the highest-capacity system memory solution on the market, enabling massive increases in server and application capability. Diablo’s JEDEC-compliant, flash-based DIMMs, interface seamlessly with existing server architectures and require no changes to hardware, operating systems, or applications. Memory1 is ideal for environments that require large memory footprints for workloads such as big data analytics, caching, and complex web applications.”
The first Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems (PDSW-DISCS’16) has issued its Call for Papers. As a one day event held in conjunction with SC16, the workshop will combine two overlapping communities to to address some of the most critical challenges for scientific data storage, management, devices, and processing infrastructure. To learn more, we caught up with workshop co-chairs Dean Hildebrand (IBM) and Shane Canon (LBNL).
Today DDN announced that The Scripps Research Institute (TSRI), one of the world’s largest independent organizations focusing on biomedical research, has deployed DDN’s end-to-end data management solutions, including high performance SFA7700X file storage automatically tiered to WOS object storage archive, to support fast analysis and cost-effective retention of research data produced by cryo-electron microscopy (Cryo-EM).
Private cloud storage enabled by BlackPearl provides the best option for balancing performance and cost; however, some customer workflows benefit greatly from incorporating a public cloud storage infrastructure,” said Matt Starr, Spectra Logic’s CTO. “Public cloud works best when a disaster recovery copy is needed; when wide data distribution is called for; to create geographic dispersion of data; and when other cloud-based features can be leveraged, such as automatic transcoding. The new Spectra hybrid storage ecosystem means that Spectra customers don’t have to choose between public and private cloud; BlackPearl brings them together seamlessly.”
Today One Stop Systems (OSS) announced that it has completed a merger with Magma, with OSS as the surviving entity. Both companies are market leaders in PCIe expansion technology used to create high-end compute accelerators and flash storage arrays. Together they become a dominant technology leader of PCIe expansion appliances.
Do you have new technology that could disrupt HPC in the near future? There’s still time to get free exhibit space at SC16 in November. “At the SC16 Emerging Technologies Showcase, we invite submissions from industry, academia, and government researchers.
“The data that I presented from the Sanger Institute is typical of the profiles that we come across: a mix of good streaming IO (ie the larger reads), but unexpectedly high numbers of small reads and writes. These small reads and writes are potentially harmful to the file system. We’ve profiled HPC applications in various different life sciences organizations, not just the Sanger Institute, and we’ve found these IO patterns throughout. We’ve also seen similar IO patterns in EDA and oil and gas applications.”