Oil and gas exploration is always a challenging endeavor, and with today’s large risks and rewards, optimizing the process is of critical importance. A whole range of High Performance Computing (HPC) technologies need to be employed for fast and accurate decision making. This Intersect360 Research whitepaper, Seismic Processing Places High Demand on Storage, is an excellent summary of the challenges and solutions that are being address by storage solutions from Seagate.
Parallel file systems have become the norm for HPC environments. While typically used in high end simulations, these parallel file systems can greatly affect the performance and thus the customer experience when using analytics from leading organizations such as SAS. This whitepaper is an excellent summary of how parallel file systems can enhance the workflow and insight that SAS Analytics gives.
Data accumulation is just one of the challenges facing today weather and climatology researchers and scientists. To understand and predict Earth’s weather and climate, they rely on increasingly complex computer models and simulations based on a constantly growing body of data from around the globe. “It turns out that in today’s HPC technology, the moving of data in and out of the processing units is more demanding in time than the computations performed. To be effective, systems working with weather forecasting and climate modeling require high memory bandwidth and fast interconnect across the system, as well as a robust parallel file system.”
National Center for Supercomputing Applications (NCSA) has a private sector program (PSP) which works with the smaller companies to help them adopt HPC technologies based on the expertise acquired over the past quarter century. By working with these organizations, NCSA can help them to determine the Return on Investment (ROI) of using more computing power to solve real world problems than is possible on smaller, less capable systems.
In many HPC environments, the storage system is an afterthought. While the main focus is on the CPU’s the selection and implementation of the storage hardware and software is critical to an efficient and productive overall HPC environment. Without the ability to move data quickly into and out of the CPU system, the HPC users would not be able to obtain the performance that is expected.
The computational requirements for weather forecasting are driven by the need for higher resolution models for more accurate and extended forecasts. In addition, more physics and chemistry processes are included in the models so we can observe the very fine features of weather behavior. These models operate on 3D grids that encompass the globe. The closer the points on the grid are to each other, the more accurate the results.
Genome sequencing is a technology that can takes advantage of the growing capability of todays ‘ modern HPC systems. Dell is leading the charge in the area of personalized medicine by providing highly tuned systems to perform genomic sequencing and data management. The whitepaper, The InsideHPC Guide to Genomic is a overview of how Dell is providing state-of-the-art solutions to the life science industry.
“We have enabled virtualization for HPC but it’s important to bring the benefits of virtualization to end researchers in a way they can use it, right? So what we have done is we have created the solution plus VMware High-Performance Analytics, which allows researchers to author their own workloads, they can collaborate it, they can clone it, then they can share it with other researchers. And they can modify their workload – they can fine tune it.”
Various industries have adopted or are in the planning and evaluation phase for using the cloud for HPC applications. Within the realm of technical computing, certain workloads are suited to a cloud-based HPC environment. Workloads could be considered either loosely coupled or tightly coupled. In each of the industries discussed in this article, multiple jobs submitted with different input parameters would be loosely coupled and not require a low-latency, high-speed interconnect, while a job that requires the use of multiple systems working in concert would be tightly coupled and need InfiniBand (IB).
In the pantheon of HPC grand challenges, weather forecasting and long term climate simulation rank right up there with the most complex and computationally demanding problems in astrophysics, aeronautics, fusion power, exotic materials, and earthquake prediction, to name just a few. This special reports looks at how HPC takes on the challenge of global weather forecasting and climate research.