Tencent Cloud Breaks World Record for Data Sorting with IBM & Mellanox

Print Friendly, PDF & Email

tencentThe Tencent Cloud has been named the Winner of the Sort Benchmark annual global computing competition for 2016. Using gear from IBM and Mellanox, the Tencent Cloud and the Big Data Collaboration team spent less than 99 seconds (98.8 seconds) finishing sorting 100 terabytes of data in the Indy GraySort category, improving on 2015’s best result, 329 seconds, by a factor of 3.3.

Real-time-analytics and Big Data environments are extremely demanding and the network is critical in linking together the extra high performance IBM POWER based servers and Tencent Cloud’s massive amounts of data,”said Amir Prescher, Sr. Vice President, Business Development, at Mellanox Technologies. “Tencent Cloud developed an optimized hardware/software platform to achieve new computing records, showing that Mellanox’s 100Gb/s Ethernet technology can deliver total infrastructure efficiency and improves application performance, making them ideal for Big Data applications.”

Each year, top global companies and academic institutions participate in the contest to evaluate the capability of their software and hardware system architectures, as well as their research results. Tencent Cloud participated in two of the four competition categories, GraySort and MinuteSort, to benchmark the architecture capabilities and computing efficiencies of large distributed computing systems and real time data analytics. The GraySort and MinuteSort benchmarks are each measured in two sub categories:

  • Indy (special purpose sort)
  • Daytona (general purpose sort)

Tencent Cloud Data Intelligencethe distributed computing platform of Tencent Cloud won each category in both the GraySort and MinuteSort benchmarks, establishing four new world records with its performance, outperforming 2015’s best speeds by two to five times.

In the future, the ability to manage big data will be the foundation of successful Internet businesses,” said Zeus Jiang, Vice President of Tencent Cloud and General manager of Tencent’s Data Platform Department. “Tencent Cloud can provide precise high performance computing to enterprises using minimal time and resources. We will continue to improve the back end technology for our cloud service by optimizing architecture, software and hardware to help global enterprises solve complex business challenges by leveraging hyper-scale computing platforms.”

2016 Sort Benchmark Contest Result

Sort Benchmark Competition

2016 World Records (Tencent Cloud )

2015 World Records

 

2016 Improvement

Daytona GraySort

44.8 TB/min

15.9 TB/min

 

2.8X greater performance

Indy GraySort

60.7 TB/min

18.2 TB/min

 

3.3X greater performance

Daytona MinuteSort

37 TB/min

7.7 TB/min

 

4.8X greater performance

Indy MinuteSort

55 TB/min

11 TB/min

 

5X greater performance

As a non-profit organization, sortbenchmark.org uses the basic sort computing method to evaluate distributed system software architectural capabilities such as storage, task scheduling, node communication, and data exchange. It also evaluates hardware architectural capabilities, including server selection and match, network architecture optimization, and the ability to build Internet Data Centers. The ultimate test is on the comprehensive capabilities of large scale computing of a company or an organization. In this sort contest, Tencent Cloud used 512 IBM OpenPOWER servers and Mellanox’100Gb interconnect technology, improving the performance of Tencent Cloud big data products with the infrastructure.

Industry leaders like Tencent are helping IBM and our OpenPOWER partners push performance boundaries for a cognitive era defined by big data and advanced analytics,” said Tom Rosamilia, Senior Vice President, IBM Systems. “The computing record achieved by Tencent Cloud on OpenPOWER is an important milestone for the industry.”

Sign up for our insideHPC Newsletter