High performance computing in the cloud just got a lot easier. Omnibond, the South Carolina-based company that provides development and support services for OrangeFS, has released CloudyCluster just in time for SC14. The new solution works in conjunction with OrangeFS to ease the burden of creating and maintaining a cloud-based HPC or Big Data infrastructure.
As the countdown to Exascale continues, Exascale-like storage problems are already showing up in today’s massively parallel, heterogeneous HPC systems. Historically, storage and I/O have kept pace with growing system demands, but, because of the limitations of spinning media and the cost of solid state storage technologies, storage performance improvements have come at a disproportionately higher cost and lower efficiency than their compute counterparts.
OrangeFS, the user-friendly, open source parallel file system for high performance computing, has a lot of endearing qualities. Heading up the list is the fact that it just works – download it to your existing commodity hardware and realize immediate and substantial boosts in the performance of your HPC and storage clusters.
Recent announcements, analyst reports, conferences and anecdotal evidence point to a certain upswing for high performance computing in industry. Many industries have reaped the benefit of HPC for considerable time and are now stepping up a gear with their systems – some even on a par with national facilities, in order to maintain or extend their advantage. Whether in upstream exploration, engine design or aerodynamics – if you can scale up or scale out, you can derive advantage.
“HPC cluster performance is often degraded because more and more data and larger files overwhelm limited hard drive capacity. But if you use Amazon Web Services (AWS), such bottlenecks may be a thing of the past. Intel, in collaboration with AWS, offers a Cloud Edition for Lustre Software that allows customers to use the power of the worlds’ most popular HPC storage system to increase scalability and performance.”
“We all have our objectives for scalability. It may mean hundreds, thousands, or millions of cores to you. But spare a thought for the software teams. We need developers and application analysts in order to scale on that new machine. Do we expect only optimization? In reality, there is a necessary step before this: debugging. What should every application developer know about debugging at scale?”