Today SGI announced the immediate availability DMF for Lustre. With highly scalable tiered data management capabilities, the new HSM software expands the functional capabilities of Intel Enterprise Edition for Lustre software and enables increased storage efficiency for organizations’ parallel computing needs.
With HPC and Big Data analytics growing at an unprecedented rate, Intel and SGI are working together to leverage targeted software and hardware solutions to drive the industry forward. Building on Intel’s previous collaborations with the French Alternative Energies and Atomic Energy Commission (CEA) around the integration of the Robinhood Policy Engine, the Intel® Enterprise Edition for Lustre integration with SGI DMF for Lustre now delivers a complete hierarchical storage management (HSM) solution, allowing multi-tiered storage to be fully integrated with Lustre.
When paired with secondary storage such as disk or tape backup, HSM enables Lustre to provide near-limitless capacity. SGI DMF directly leverages the HSM capability by providing direct integration with Lustre, and by allowing customers to take advantage of long-term storage while simplifying management activities.
For organizations of all sizes, ensuring efficient and rapid access to data is of paramount importance. Unfortunately, costs associated with this access often proves to be an inhibiting factor in implementing ‘always-on’ storage solutions,” said Jorge Titinger, president and CEO, SGI. “With SGI DMF for Lustre, enterprises can ensure constant access to data while leveraging the significant cost benefits and scalability of tiered storage.”
SGI DMF for Lustre is an integrated solution that adds enormous storage scalability and increased cost management to the Lustre file system environment with no impact to native Lustre file system performance. The platform is based on the most recent releases of Lustre, including the Intel Enterprise Edition for Lustre* software, that feature core file system enhancements for the integration of advanced data management capabilities such as those delivered by SGI DMF for Lustre. Further, the software is supported by SGI’s global support team in conjunction with Intel’s Lustre engineering team to assist organizations to maximize the performance and scalability offered through the partnership.
Building on SGI’s multi-decade strength as a leader in tiered data management solutions and Intel’s enablement of Luster-based HSM, DMF for Lustre allows organizations to expand their use of Lustre file systems to include long-term data storage, in addition to being the file system of choice for high performance data access within cluster compute environments. With SGI DMF, active data is always available on the fastest tier of Lustre storage (OST) while tunable policies allow the SGI solution to automatically migrate data to and from additional tiers of storage that can include lower cost disk, public and private cloud and even robotic tape libraries. The result is a system where all data is always online and accessible, while maintaining minimized storage costs.
HSM has been a highly desirable feature missing from Lustre that we helped the CEA complete,” said Brent Gorda, GM of Intel’s HPDD team. “Working with SGI to enable DMF opens a total solution to a community interested in performance data access with tiering to cheaper, higher capacity systems.”
The SGI DMF for Lustre is now shipping.
Get the insideHPC Guide to Lustre from the editors of insideHPC, courtesy of Intel.
Sign up for our insideHPC Newsletter.
This is awesome news!