Oak Ridge National Lab recently hosted a Materials Imaging Workshop. Entitled “Big, Deep and Smart Data Analytics in Materials Imaging,” the workshop explored research opportunities and challenges arising as imaging and data sciences merge.
Companies already using High-performance Computing (HPC) with a Lustre file system for simulations, such as those in the financial, oil and gas, and manufacturing sectors, want to convert some of their HPC cycles to Big Data analytics. This puts Lustre at the core of the convergence of Big Data and HPC.
“Data centric workloads are growing in importance in high-performance computing and, in an industry that has been dominated by a handful of technologies for several years, this has led users to look for new technologies which better suit such jobs. The demand now is for low power, high memory, and I/O-intensive solutions, so there is a growing niche which can be addressed by solutions which are less focused on Flops performance.”
Today the California Institute for Telecommunications and Information Technology (Calit2) and Australia’s Academic and Research Network (AARNet) announced a partnership to connect Australian researchers to the US Pacific Research Platform (PRP), a next generation data sharing network linking research universities and supercomputing centers at unprecedented speeds.