Over at Intel, Scott Cyphers writes that the company has open-sourced nGraph, a framework-neutral Deep Neural Network (DNN) model compiler that can target a variety of devices. With nGraph, data scientists can focus on data science rather than worrying about how to adapt their DNN models to train and run efficiently on different devices. Continue reading below for highlights of our engineering challenges and design decisions, and see GitHub, our documentation, and our SysML paper for additional details.
Intel Open Sources nGraph Deep Neural Network model for Multiple Devices
April 19, 2018 by Leave a Comment
StorONE and Mellanox Build Wire-Speed TRU Storage Solutions
April 17, 2018 by Leave a Comment
Today StorONE announced that it has partnered with Mellanox Technologies to leverage each other’s technological approaches in order to create powerful, scalable and flexible storage solutions. These solutions achieve the enterprise-class functionality, high performance and high capacity results at the industry’s lowest total cost of ownership. “Modern software-defined storage solutions require high-performance, programmable and intelligent networks,” said Motti Beck, Senior Director Enterprise Market Development, at Mellanox. “Combining StorONE’s TRU STORAGE software with Mellanox Ethernet fabric storage solutions improves the simplicity, cost and efficiency of enterprise storage systems, supports enterprises’ mission critical storage features at wire speed and ensures the best end-user experience available.”
E8 Storage steps up to HPC with InfiniBand Support
April 17, 2018 by Leave a Comment
Today E8 Storage announced availability of InfiniBand support to its high performance, NVMe storage solutions. The move comes as a direct response to HPC customers that wish to take advantage of the high speed, low latency throughput of InfiniBand for their data hungry applications. E8 Storage support for InfiniBand will be seamless for customers who now have the flexibility to connect via Ethernet or InfiniBand when paired with Mellanox ConnectX InfiniBand/VPI adapters. “Today we demonstrate once again that E8 Storage’s architecture can expand, evolve and always extract the full potential of flash performance,” comments Zivan Ori, co-founder and CEO of E8 Storage. “Partnering with market leaders like Mellanox that deliver the very best network connectivity technology ensures we continue to meet and, frequently, exceed the needs of our HPC customers even in their most demanding environments.”
Industry Insights: Download the Results of our AI & HPC Perceptions Survey
April 16, 2018 by Leave a Comment
The results from our HPC & AI peception survey are here. “90 percent of all respondents felt that their business will ultimately be impacted by AI. Although almost all respondents see AI as playing a role in the future of the business, the survey also revealed the top three industries that will see the most impact. Healthcare came in first, followed by life sciences, and finance/transportation tied in third place. The possibilities of AI are seemingly endless. And the shift has already begun.”
DDN Builds New Engineering Facility in Colorado focused on AI, Cloud, and Enterprise Data Challenges
April 16, 2018 by Leave a Comment
Today DDN announced the opening of a new facility in Colorado Springs, Colorado, including a significant expansion of lab, testing and benchmarking facilities. The enhanced capabilities will enable DDN to accelerate development efforts and increase in-house capabilities to mimic customer applications and workflows. “Our Enterprise, AI, HPC and Cloud customers have always relied upon us to develop the world’s leading data storage solutions at-scale, and for our long-term focus and sustained investments in research, technology and innovation,” said Alex Bouzari, chief executive officer, chairman and co-founder of DDN. “We are excited to add our new Colorado Springs facility to the DDN R&D centers worldwide and to expand our team of very talented engineers and technologists who will continue to drive innovation for our customers in the years to come.”
Accelerating Ceph with RDMA and NVMe-oF
April 14, 2018 by Leave a Comment
Haodong Tang from Intel gave this talk at the 2018 Open Fabrics Workshop. “Efficient network messenger is critical for today’s scale-out storage systems. Ceph is one of the most popular distributed storage system providing a scalable and reliable object, block and file storage services. As the explosive growth of Big Data continues, there’re strong demands leveraging Ceph build high performance & ultra-low latency storage solution in the cloud and bigdata environment. The traditional TCP/IP cannot satisfy this requirement, but Remote Direct Memory Access (RDMA) can.”
Amazon and Libfabric: A case study in flexible HPC Infrastructure
April 13, 2018 by Leave a Comment
Brian Barrett from Amazon gave this talk at the 2018 OpenFabrics Workshop. “As network performance becomes a larger bottleneck in application performance, AWS is investing in improving HPC network performance. Our initial investment focused on improving performance in open source MPI implementations, with positive results. Recently, however, we have pivoted to focusing on using libfabric to improve point to point performance.”
New Types of Memory, their support in Linux, and how to use them via RDMA
April 12, 2018 by 1 Comment
Christoph Lameter from Jump Trading LLC gave this talk at the OpenFabrics Workshop. “Recently new types of memory have shown up like HBM (High Bandwidth Memory), Optane, 3DXpoint, NVDIMM, NVME and various “nonvolatile” types memory. This talk gives a brief rundown on what is available and gives some example on how the vendors enable the actual use of this memory in the operating system (f.e. DAX and filesystems) and then show how an application would make use of this memory. In particular then we will be looking at what considerations are important for the use of RDMA to those memory devices.”
Intel FPGAs Goes Mainstream for Enterprise Workloads
April 11, 2018 by Leave a Comment
Today Intel announced top-tier OEM adoption of Intel’s field programmable gate array (FPGA) acceleration in their server lineup. This is the first major use of reprogrammable silicon chips to help speed up mainstream applications for the modern data center. “We are at the horizon of a new era of data center computing as Dell EMC and Fujitsu put the power and flexibility of Intel FPGAs in mainstream server products,” said Reynette Au, vice president of marketing for the Intel Programmable Solutions Group. “We’re enabling our customers and partners to create a rich set of high-performance solutions at scale by delivering the benefits of hardware performance, all in a software development environment.”
Reduce Costs with Adaptive Computing’s NODUS Cloud Bursting Solution
April 11, 2018 by Leave a Comment
“HPC organizations that utilize cloud service providers (AWS, Azure, Google, Oracle, etc.) in conjunction with Adaptive Computing’s NODUS Cloud Bursting Solution can significantly reduce their on-premise cluster sizes and costs by as much as 40-50 percent, and burst the rest of their HPC workload to the cloud, by implementing this hybrid approach.”
