Sign up for our newsletter and get the latest big data news and analysis.

Super-expensive Supercomputers: UK Met Office in £1B+ Deal for Microsoft Weather System; $3B System in China on Way

As widely reported in February, the UK Met Office and Microsoft have come to an agreement to provision a £1.2 billion (over 10 years) supercomputer the Met Office said will be the world’s most powerful weather and climate forecasting system. The agreement, announced on Earth Day, will be in the top 25 of the Top500 […]

NOAA Upgrades Global Weather Model Following 2020 HPC Additions

The U.S. National Oceanic and and Atmospheric Administration (NOAA) said today it is upgrading its Global Forecast System (GFS) weather model to improve hurricane genesis forecasting, modeling for snowfall location, heavy rainfall forecasts and overall model performance. In February 2020, NOAA announced it will triple if its weather and climate supercomputing capacity with the addition […]

Let’s Talk Exascale: Forecasting Water Resources and Severe Weather with Greater Confidence

In this episode of Let’s Talk Exascale, Mark Taylor of Sandia National Laboratories talks about using exascale supercomputers for severe weather and water resource forecasting. A sub-project within the US Department of Energy’s (DOE’s) Exascale Computing Project (ECP) called E3SM-MMF is working to improve the ability to simulate the water cycle and the processes around precipitation. Our guest on the latest episode of ECP’s podcast, Let’s Talk Exascale, is Mark Taylor of Sandia National Laboratories, principal investigator of the E3SM-MMF project.

Deep Learning for Predicting Severe Weather

Researchers from Rice University have introduced a data-driven framework that formulates extreme weather prediction as a pattern recognition problem, employing state-of-the-art deep learning techniques. “In this paper, we show that with deep learning you can do analog forecasting with very complicated weather data — there’s a lot of promise in this approach.”

Computational Evaluation of Cloud HPC with a Global Atmospheric Model

Daniel Arevalo from DeVine Consulting gave this talk at the HPC User Forum. “Prompted by DoD priorities for modernization, cost savings, and redundancy, this project compared the performance of the NAVGEM on an in-house Cray system against the follow cloud offerings: AWS c4.8xlarge, Penguin B30 queue, Azure H16r, and AWS c5n.18xlarge.”

Accelerating High-Resolution Weather Models with Deep-Learning Hardware

Sam Hatfield from the University of Oxford gave this talk at the PASC19 conference. “In this paper, we investigate the use of mixed-precision hardware that supports floating-point operations at double-, single- and half-precision. In particular, we investigate the potential use of the NVIDIA Tensor Core, a mixed-precision matrix-matrix multiplier mainly developed for use in deep learning, to accelerate the calculation of the Legendre transforms in the Integrated Forecasting System (IFS), one of the leading global weather forecast models.”

ClimateNet Looks to Machine Learning for Global Climate Science

Pattern recognition tasks such as classification, localization, object detection and segmentation have remained challenging problems in the weather and climate sciences. Now, a team at the Lawrence Berkeley National Laboratory is developing ClimateNet, a project that will bring the power of deep learning methods to identify important weather and climate patterns via expert-labeled, community-sourced open datasets and architectures.

Video: Big Data Assimilation Revolutionizing Weather Prediction

In this video from the HPC User Forum in Tucson, Miyoshi Takemasa from RIKEN presents: Big Data Assimilation Revolutionizing Weather Prediction. “A new project harnessing data from a Japanese satellite called Himawari-8 could improve weather forecasting and allow officials to issue life-saving warnings before natural disasters. The breakthrough is the result of pairing data collected by Japan’s Himawari-8 weather satellite with a program run on a supercomputer at the RIKEN science institute.”

PSSC Labs offers HPC Solutions for Weather Modeling and Wildfire Analysis

PSSC Labs is offering HPC clusters solutions for Weather Modeling and Wildfire Analysis in collaboration with Atmospheric Data Solutions (ADS). “The solutions ADS are developing use a comprehensive blend of predictors that are important to large wildfire potential including dead fuel and live fuel moisture, near-surface atmospheric moisture and temperature, wind speed and gusts.”

Building a GPU-enabled and Performance-portable Global Cloud-resolving Atmospheric Model

Richard Loft from NCAR gave this talk at the NVIDIA booth at SC17. “The objectives of NCAR’s exploration of accelerator architectures for high performance computing in recent years has been to 1) speed up the rate of code optimization and porting and 2) understand how to achieve performance portability on codes in the most economical and affordable way.