FMS: MemVerge Enables Tencent Cloud to Accelerate Data Warehousing

MemVerge, Inc., in Memory-Converged Infrastructure (MCI), announced at FMS that customer Tencent Holdings Limited is accelerating its data warehousing with the help of its technology.

Alongside Intel, MemVerge is working with Tencent to apply persistent memory technology to accelerate the Tencent Sparkling Data Warehouse Suite, a petabyte-level solution allowing for enterprise-grade distributed cloud data warehouse.

“The memory-speed processing power of MemVerge’s Memory-Converged Infrastructure has proven unique value in accelerating speed of OLAP services and combined with the fact that we can store data on the same system,” said Long Wang, VP, Tencent cloud and GM of big data and AI services. “MemVerge’s technology has huge potential to be a compelling part of the foundation for our next-generation cloud-based data warehouse to provide our services to customers more effectively well into the future.“

Tencent is an Internet-based technology and cultural enterprise headquartered in Shenzhen, China. Founded in 1998, its mission is to improve the quality of life through Internet value-added services. This will be done via the delivery of integrated internet solutions to billions of netizens through its user oriented business philosophy.

Tencent Cloud runs an elastic cloud-native Spark application built on Tencent Cloud Sparkling Data Warehouse Suite service, and Intel’s non-volatile memory technology provides end users with speed and flexibility. MemVerge’s Distributed Memory Objects (DMO) software layer builds a performing Spark solution with a non-volatile, memory-based converged infrastructure platform.

In terms of the Tencent network topology, the fused memory platform is the host of the Spark data IO. It is deployed on a separate host cluster and separately from the Spark compute cluster, and is interconnected. Data is exchanged with the Spark compute cluster through a high-speed general-purpose Ethernet network. MemVerge DMO technology helps to increase performance and makes the Spark cluster more elastic, as well as enhances Sparkling to decommission nodes by decoupling shuffle data to the MemVerge system with the goal of accelerating the data warehousing processes.

“Performance, ease of use and the ability to provide seamless integration is part of the distributed memory objects software layer that MemVerge can provide,” Charles Fan, MemVerge CEO and founder said. “Our collaboration with Tencent is proving successful because our goals to overcome crippling barriers and eliminate troublesome data bottlenecks are well aligned.“

MemVerge’s MCI system offers a new architecture for the enterprise, offering higher capacity computing memory and faster storage at the same time. It offers a long-lasting system design that provides greater data center reliability and tackles memory, storage and IO bottlenecks to help massive and complex applications operate smoothly, at memory speed.