Barcelona, 16 April 2024 – The eFlows4HPC project announced it has delivered a workflow platform and an additional set of services facilitating the integration of high-performance computing (HPC) simulation and modeling with big data analytics and machine learning techniques.
Significant advancements in defining complex workflows resulted in enhanced workflow efficiency, and increased overall development and deployment productivity. A variety of scientific and industrial domains, including geosciences, climate science, manufacturing, and other initiatives within the European HPC and scientific applications ecosystem, will benefit from this innovative technology, reflecting the wide-reaching and transformative impact of the project.
The two major project outcomes, High-Performance Computing Workflows as a Service (HPCWaaS) and the project software stack, are crucial in supporting the development, deployment and execution of complex workflows. These advancements play a key role in tackling challenges related to natural disasters, climate change and the optimization of manufacturing processes. HPCWaaS helps users and developers to manage complex scientific workflows by simplifying their lifecycle steps and widening the access to HPC for newcomers. Additionally, the project has released as open source the eFlows4HPC software stack, which is versatile and applicable across numerous scientific and industrial applications requiring HPC, AI and big data techniques.
Rosa M. Badia, coordinator of the €7,6M eFlows4HPC project, said that “the achieved results mark a significant milestone, demonstrating the versatility of the eFlows4HPC software stack in leveraging HPC resources. This translates to a notable decrease in time-to-solution for application developers that need to combine traditional HPC with AI or big data in a single workflow.” She thinks that “we are shaping the future of HPC workflows and empowering researchers to tackle emerging challenges that require complex workflows.”
eFlows4HPC consortium, coordinated by the Barcelona Supercomputig Center, has been highly engaged with multiple initiatives in order to ensure broader adoption of the eFlows4HPC methodologies by other scientific and industrial communities. Joint collaboration activities have been organized with other European initiatives and HPC Centers of Excellence (CoEs), such as ESiWACE3 (climate and weather simulations) and PerMedCoE (personalized medicine) communities. The project has also supported ChEESE and ChEESE-2P by developing complex workflows for earthquake impact simulation. eFlows4HPC methodologies will also be used for the development of workflows in DT-GEO, that aims to build a digital twin for geophysical extremes, and the CAELESTIS project. Finally, the SKA Regional Centres, the regional support network for the international initiative providing square-kilometre array telescopes, showed interest in evaluating the HPCWaaS methodology.
Speak Your Mind