“At the Minnesota Supercomputing Institute we are exploring ways to provide the immediacy and flexibility of interactive computing within the batch-scheduled, tightly controlled world of traditional cluster supercomputing. As Jupyter Notebook has gained in popularity, the steps needed to use it within such an environment have proven to be a barrier to entry even as increasingly powerful Python tools have developed to take advantage of large computational resources. JupyterHub to the rescue! Except out of the box, it doesn’t know anything about resource types, job submission, and so on. We developed BatchSpawner and friends as a general JupyterHub backend for batch-scheduled environments. In this talk I will walk through how we have deployed JupyterHub to provide a user-friendly gateway to interactive supercomputing.”
In this video from ISC 2016, Dave Sundstrom from Hewlett Packard Enterprise describes the newly enhanced HPE Software Stack for High Performance Computing. “The HPE Core HPC Software Stack is a complete software set for the creation, optimization, and running of HPC applications. It includes development tools, runtime libraries, a workload scheduler, and cluster management, integrated and validated by Hewlett Packard Enterprise into a single software set. Core HPC Stack uses the included HPC Cluster Setup Tool to simplify and speed the installation of an HPC cluster built with HPE servers.”
In this Intel Chip Chat podcast with Allyson Klein, Cray CTO Steve Scott describes the collaboration between Cray and Intel on the Intel Xeon Phi Processor for supercomputer integration. Steve highlights that Cray chose to implement the new Intel Xeon Phi Processor for its supercomputers because of the potential to support a diverse array of customer needs and deliver the best performance per application. He emphasizes that Cray software tools are key to optimizing Intel Xeon Phi processor performance at the system level.
Today, Allinea announced that the company will be exhibiting at XSEDE16 July 17-21 in Miami. The conference will attract an audience across industry and academia to discuss the key themes of diversity, big data and science at scale. “Our tools are used extensively across the XSEDE user base so we’re delighted to be extending the value they bring by giving practical advice for getting the best out of infrastructure capabilities through software tuning, especially given the addition of support for the full Intel Xeon Phi family in our new v6.1 software release,” said Rob Rick, VP Americas for Allinea.”
The Intel HPC Developer Conference has issued its Call for Proposals. Held in conjunction with SC16, the event takes place Nov. 12-13 in Salt Lake City.
Hadoop has a reputation for being extremely difficult to install and configure, but that seems to be changing. In this video, Bright Cluster Manager for Big Data is used to install Cloudera 5.3.1 with YARN failover in just five minutes.
In this video from ISC 2016, Karl Schultz from the OpenHPC Community provides and update on software releases and other milestones. “OpenHPC is a Linux Foundation Collaborative Project whose mission is to provide an integrated collection of HPC-centric components that can be used to provide full-featured reference HPC software stacks. Provided components should range across the entire HPC software ecosystem including provisioning and system administration tools, resource management, I/O services, development tools, numerical libraries, and performance analysis tools.”
In this video from ISC 2016, Onur Celebioglu from Dell describes how the company is working with the OpenHPC Community to ease the deployment of high performance computing solutions. “Community investment in open source frameworks and open standards is the right way to ensure the right capabilities are available to a growing HPC community. The new OpenHPC effort will greatly accelerate HPC adoption, productive usage and innovation. As a long-time leader in democratizing HPC, Dell is proud to be a founding member of this effort.”
With the OpenHPC stack, you can leap forward with a validated, tested and secure infrastructure software stack and get to product in a fraction of the time. This new approach will drive rapid advances in the state of the art and accelerate our progress towards true exascale computing. “SUSE, as a founder and board member of OpenHPC, contributes not just to the Linux OS elements of the project but also to the underlying HPC system building componentry and system tools that can bridge today’s infrastructure development gaps and help move vendors and researchers rapidly towards powerful HPC solution stacks.”
In this video from ISC 2016, Bob Wisniewski from Intel provides an update on OpenHPC community activities. “OpenHPC is a collaborative, community effort that initiated from a desire to aggregate a number of common ingredients required to deploy and manage High Performance Computing (HPC) Linux clusters including provisioning tools, resource management, I/O clients, development tools, and a variety of scientific libraries. Packages provided by OpenHPC have been pre-built with HPC integration in mind with a goal to provide re-usable building blocks for the HPC community. Over time, the community also plans to identify and develop abstraction interfaces between key components to further enhance modularity and interchangeability.”