Sign up for our newsletter and get the latest HPC news and analysis.

OrangeFS: A Scalable, Parallel File System Whose Time Has Come

OrangeFS logo

Many of the major advances in HPC have been the result of collaboration between academia and the big government labs. This has been the case with PVFS (Parallel Virtual File System) and its latest generation, the scale-out file system known as OrangeFS.

Using PBS to Schedule MapReduce Jobs Accessing OrangeFS

Screen Shot 2013-10-04 at 6.58.51 AM

Using PBS Professoinal and a customized version of myHadoop has allowed researchers at Clemson University to submit their own Hadoop MapReduce jobs on the “Palmetto Cluster”. Now, researchers at Clemson can run their own dedicated Hadoop daemons in a PBS scheduled environment as needed.