In this video from the 2016 Blue Waters Symposium, GPU Performance Nuggets – Carl Pearson and Simon Garcia De Gonzalo from the University of Illinois present: GPU Performance Nuggets. “In this talk, we introduce a pair of Nvidia performance tools available on Blue Waters. We discuss what the GPU memory hierarchy provides for your application. We then present a case study that explores if memory hierarchy optimization can go too far.”
“Between 2011 and 2016, eight projects, with a total budget of more than €50 Million, were selected for this first push in the direction of the next- generation supercomputer: CRESTA, DEEP and DEEP-ER, EPiGRAM, EXA2CT, Mont- Blanc (I + II) and Numexas. The challenges they addressed in their projects were manifold: innovative approaches to algorithm and application development, system software, energy efficiency, tools and hardware design took centre stage.”
AMD’s motivation for developing these open-source GPU tools is based on an opportunity to remove the added complexity of proprietary programming frameworks to GPU application development. “If successful, these tools – or similar versions – could help to democratize GPU application development, removing the need for proprietary frameworks, which then makes the HPC accelerator market much more competitive for smaller players. For example, HPC users could potentially use these tools to convert CUDA code into C++ and then run it on an Intel Xeon co-processor.”
“We have been working on developing a number of tools that enable users to quantify power and performance in both software and hardware, and then design a more efficient system. We can also utilize the tools to predict the performance of a piece of software on a system that may not be available or does not yet exist – the aim is to take the guesswork away from novel system design.”
“At the Minnesota Supercomputing Institute we are exploring ways to provide the immediacy and flexibility of interactive computing within the batch-scheduled, tightly controlled world of traditional cluster supercomputing. As Jupyter Notebook has gained in popularity, the steps needed to use it within such an environment have proven to be a barrier to entry even as increasingly powerful Python tools have developed to take advantage of large computational resources. JupyterHub to the rescue! Except out of the box, it doesn’t know anything about resource types, job submission, and so on. We developed BatchSpawner and friends as a general JupyterHub backend for batch-scheduled environments. In this talk I will walk through how we have deployed JupyterHub to provide a user-friendly gateway to interactive supercomputing.”
In this video from ISC 2016, Dave Sundstrom from Hewlett Packard Enterprise describes the newly enhanced HPE Software Stack for High Performance Computing. “The HPE Core HPC Software Stack is a complete software set for the creation, optimization, and running of HPC applications. It includes development tools, runtime libraries, a workload scheduler, and cluster management, integrated and validated by Hewlett Packard Enterprise into a single software set. Core HPC Stack uses the included HPC Cluster Setup Tool to simplify and speed the installation of an HPC cluster built with HPE servers.”
In this Intel Chip Chat podcast with Allyson Klein, Cray CTO Steve Scott describes the collaboration between Cray and Intel on the Intel Xeon Phi Processor for supercomputer integration. Steve highlights that Cray chose to implement the new Intel Xeon Phi Processor for its supercomputers because of the potential to support a diverse array of customer needs and deliver the best performance per application. He emphasizes that Cray software tools are key to optimizing Intel Xeon Phi processor performance at the system level.
Today, Allinea announced that the company will be exhibiting at XSEDE16 July 17-21 in Miami. The conference will attract an audience across industry and academia to discuss the key themes of diversity, big data and science at scale. “Our tools are used extensively across the XSEDE user base so we’re delighted to be extending the value they bring by giving practical advice for getting the best out of infrastructure capabilities through software tuning, especially given the addition of support for the full Intel Xeon Phi family in our new v6.1 software release,” said Rob Rick, VP Americas for Allinea.”
The Intel HPC Developer Conference has issued its Call for Proposals. Held in conjunction with SC16, the event takes place Nov. 12-13 in Salt Lake City.
Hadoop has a reputation for being extremely difficult to install and configure, but that seems to be changing. In this video, Bright Cluster Manager for Big Data is used to install Cloudera 5.3.1 with YARN failover in just five minutes.