Video: Profiling Genome Pipeline I/O with DDN and the Sanger Institute

“The data that I presented from the Sanger Institute is typical of the profiles that we come across: a mix of good streaming IO (ie the larger reads), but unexpectedly high numbers of small reads and writes. These small reads and writes are potentially harmful to the file system. We’ve profiled HPC applications in various different life sciences organizations, not just the Sanger Institute, and we’ve found these IO patterns throughout. We’ve also seen similar IO patterns in EDA and oil and gas applications.”

Ellexus Launches Mistral Software for Balancing Shared Storage across HPC Clusters

Today Ellexus in the UK announced the release of Mistral, a “ground breaking” product for balancing shared storage across a high performance computing cluster. Developed in collaboration with ARM’s IT department, Mistral monitors application IO and cluster performance so that jobs exceeding the expected IO thresholds can be automatically identified and slowed down through IO throttling.