What are you looking for ?
Infinidat
Articles_top

OpenIO Object Storage Solution Unveils Record Performance With Criteo

Writing up to 1Tb/s

OpenIO announced a record performance achievement with Criteo, the advertising platform for the open Internet.

Click to enlarge

Openio Scheme

The company demonstrated the performance and scalability of their object storage solution by deploying their technology on a cluster of more than 350 physical servers provided by Criteo.

The benchmark made it possible to cross the symbolic threshold of writing up to 1Tb/s, and even to exceed it since the useful throughput observed is 1.372Tb/s. This is the equivalent of digitally transferring the 22 million books from the world’s largest library, the Library of the U.S. Congress, in under one minute. The firm’s performance is a record because no other object storage technology has so far claimed and demonstrated such a and on such a large scale.

Since the creation of OpenIO, we have placed the issue of performance at the very center of what we do,” explains Laurent Denel, CEO and co-founder, OpenIO. “Once we solved the problem of hyper-scalability, it became clear that data would be manipulated more intensively than in the past. This is why we designed an efficient solution, capable of being used as primary storage for video streaming (as is the case with our customer Dailymotion), or to serve increasingly large datasets for big data use cases.

In recent years, due to the growth in the volume of data collected by companies, their choices of storage technologies have often been guided by two criteria: the price per gigabyte and scalability – the ability to increase the capacity of a storage platform to create its ‘data lake’ without creating data silos.

It is possible to extract value from this data, and this extraction is becoming one of the main growth drivers for many companies. Also, the concern today is less to optimize the cost of archiving data than to make their processing possible by ML and deep learning algorithms. After the era of ‘Data Archiving and Data Sharing’, we are entering the era of ‘Data Processing’.

The performance that the company achieved on Criteo machines under production conditions, confirms the design of the firm’s object storage software for new data uses, in particular the massive exploitation of data by AI algorithms on big data/HPC clusters. Inaugurating the #TbpsChallenge with this record, the company invites other market players to put their technology to the test (on commodity servers and tuned for production!).

Criteo is pleased to have been a part of this benchmark, which gave OpenIO the opportunity to demonstrate how their technology can maintain consistent high performance while adding new nodes to scale massively” said Stuart Pook, senior site reliability engineer, Criteo. “They were able to achieve a write rate close to the theoretical limits of the hardware we made available.

Criteo handles large volumes of data and has built a big data platform with several thousand nodes. It’s team of engineers provided more than 350 machines from its infrastructure, recently racked in one of their datacenters, but not yet put into their production. An opportunity for OpenIO, because this cluster made up of commodity storage servers allows them to reach an order of magnitude that is truly ‘hyper-scale’.

Read also:
French OpenIO Recognized by Zimbra as Independent Software Vendor    
Providing object storage for Zimbra collaboration platform
June 13, 2019 | Press Release
OpenIO SDS V19.04 Storage Software     
Brings performance and ergonomic improvements, as well as consolidation of compatibility with S3 standard API for object storage.
June 7, 2019 | Press Release

Articles_bottom
AIC
ATTO
OPEN-E