In this slidecast, Josh Judd from Warp Mechanics presents: Lustre Over ZFS on Linux.
No single technology solves all problems faced in today’s complex world. WARP Mechanics’ philosophy is to customize the many and varied systems into the exact set of solutions required to address the problems. WARP Mechanics leverages tried–and-true technologies from the most advanced systems and removes the complexity, delivering customized turnkey solutions. Each WARP Mechanics solution is completely integrated and factory tested for known compatibility and performance functionality.
HPC Value of this approach:
- Moves in the “mainstream direction” of open source vs. proprietary
Built-in compression gets 1.7:1 in real-world HPC environments
ZFS RAID layer supports hybrid SSD pools: massive performance benefits for Lustre especially with small random reads
ZFS adds multiple layers of integrity protection: essential at peta-scale
Allows running arbitrary user-provided code directly within the storage array – e.g., CRAM could be implemented inside the controller