Japan Riken Center of Computational Sciences Opts for Raidix Multi-Petabyte Storage System and Core Micro Systems

With its storage solutions, consolidated efforts of Raidix Corporation and Core Micro Systems Inc. add more potential to computing environment giving more opportunities to knowledge intensive industries.

So far the largest Raidix based storage (Core Micro Systems Integrated Storage Appliance/HyperSTOR Flex) consists out of 11 HA clusters. Total volume of the project is outstanding: 65PB, including 51.4PB of usable volume relying on 6.512 drives, 10TB capacity each.

The storage system is loaded with data originated by HPC Infrastructure, implemented as part of massive Japanese project named Academic Cloud accelerating countrywide exchange of academic data.

Active phase of the project took about 12 months of hard work by Core Micro Systems specialists and Raidix team – the project was developed throughout a year followed by thorough supervision on the matter of stability for another year. Results obtained matched targeted values and the company might report this project successful and present team victory.

RIKEN Center for Computational Science storage was considered to have not less than 50PB of usable storage due to hyper productivity of computing landscape. Severe requirements to storage access speed were established in order to ensure effective joint access to HPCI environment.

The actual deployment of the system ran smoothly and was divided into two stages. Core Micro Systems engineers carried out each stage of testing very carefully and accurately, gradually increasing system scale. First phase of deployment was completed in August 2017: that time the system volume reached 18PB. Second phase was implemented the same year in October with the system volume increasing up to record 51PB.

Raidix based storage was integrated with Gfarm file system that hosts HPC Infrastructure. It creates virtual file system using resources of multiple storage servers and basically unifies disparate storage clusters into single name space for joint access. Not only the developing team managed to build scalable storage in conjunction with Gfarm but also expand other functional characteristics of the software. Thus, it was crucial to develop and implement technology of automatic write-through as soon as possible in order to meet requirements of technical specifications.

Raidix demonstrates performance that was proved by long tests, inspections and modifications. Success in implementation of such long and laborious project was feasible by collaborative work with Core Micro Systems team and close interaction of all participants of the project.

About the project
HPCI is powered by SINET (The Science Information Network) which is the baseline network for exchanging scientific data between Japanese universities and research centers. Currently SINET brings together about 850 colleges and universities, creating opportunities for information exchange in the fields of nuclear physics, astronomy, surveying, seismology and computer science. It aligns with the concept of united information space, where HPC professionals from different research centers have access to HPC resources, used for fundamental, theoretical and applied tasks.