Today Penguin Computing and WekaIO announced record performance on the STAC-M3 Benchmark. The STAC-M3 Antuco and Kanaga Benchmark Suites are the industry standard for testing solutions that enable high-speed analytics on time series data, such as tick-by-tick market data.
By combining Penguin Computing Relion servers and FrostByte Storage with the WekaIO File System, the companies have affirmed that this integrated solution is ideal for algorithmic trading and quantitative analysis workloads, common in financial services.
The high-performance analytics workloads were run using Kx kdb+ 3.6 database system distributed on Penguin Computing Tundra Extreme Scale Relion Compute Servers. The record-breaking storage performance was provided by Penguin Computing’s FrostByte Storage Solution, running WekaIO Matrix File System (v3.2.2) Software, utilizing Relion NVMe optimized servers based on an Intel Xeon Scalable Processor, and using Mellanox EDR 100Gb/s Infiniband switch systems.
The tests were run on the baseline benchmark suite Antuco and the scaling suite Kanaga, a test suite with five years of stock market data. The system had a combined performance density of up to 87.5GB/sec available bandwidth to the client nodes, 40.5 GB/sec of actual throughput (STAC-M3.ß1.1T.5YRHIBID), and 2.5M 4K IOPS in 8U, with the ability to fully distribute data, metadata and system services, as well as super low file system latency that leverages high-speed networks and NVMe-optimized storage.
Penguin Computing has the ability to incorporate and optimize different technologies effectively and with greater flexibility than others in the market. The Penguin Computing FrostByte integrated solution featuring the WekaIO File System is designed, engineered and vetted to deliver a high-performance storage solution for Kx kdb+,” said Dr. Kevin Tubbs, Sr. Director of Technology, Advanced Solutions Group at Penguin Computing. “To break eight STAC-M3 performance records is an incredible achievement and a testament to the innovative architecture of the WekaIO File System and leading HPC and AI solutions from Penguin Computing. For IT supporting different applications and Kx kdb+ time-series databases, this platform is an unbeatable combination for performance, scale and ease of management.”
The FrostByte Storage Solution delivered record-breaking performance setting eight STAC-M3 Benchmark world records on the scaling suite Kanaga and delivered the highest throughput ever achieved on STAC-M3 with kdb+.
Traditionally, IT organizations have used block-based storage solutions for their trading databases, rather than compromise performance due to network and file system latencies. The result has been large investments in specialized hardware and software to run different applications,” said David Hiatt, Director of Business Development and Alliances at WekaIO. “Now with the STAC-M3 Benchmark results, we have proven that with the WekaIO File System on Penguin Computing Relion servers and FrostByte storage delivers better application performance for Kx kdb+ by running in distributed mode over a network than with traditional block storage, with the additional benefit of simultaneously supporting other applications on the same platform. That’s a huge leap in application acceleration and in simplifying the storage infrastructure for financial services.”
