Sign up for our newsletter and get the latest big data news and analysis.

NASA Ames: Combining Quick-turnaround and Batch Workloads at Scale


In this video, Greg Matthews, Deputy PBS Administrator at NASA presents: Combining Quick-turnaround and Batch Workloads at Scale.

NASA Advanced Supercomputing (NAS) uses PBS Professional to schedule and manage the workload on Pleiades, an 11,000+ node IB cluster. At this scale the user experience for quick-turnaround jobs candegrade, which led NAS initially to set up two separate PBS servers, each dedicated to a particular workload. Recently we have employed PBS hooks andscheduler modifications to merge these workloads together under one PBS server, delivering sub-1-minute start times for the quick-turnaround workload, and enabling dynamic management of the resources set aside for that workload.”

Recorded at the PBS Works User Group meeting in San Jose on Oct. 3, 2012.

Resource Links: