DDN Installs 30 Series Storage Devices as Second-Tier Storage System for HPC Fugaku
Supporting 150PB storage and 1.5TB/s throughput with Fujitsu FEFS file system
This is a Press Release edited by StorageNewsletter.com on November 25, 2020 at 2:15 pmDDN (DataDirect Networks, Inc.) announced that its SFA18K Series has been adopted as the second-tier storage system for the HPC Fugaku.
A four-time award-winning HPC, including the ≠1 ranking in the TOP500 list in June 2020, Fugaku is in joint development with Riken Center for Computational Science and Fujitsu Limited, aiming to start operation in 2021.
The SFA18K Series is DDN’s latest platform featuring high throughput, high density and low power consumption. Fugaku’s second-tier storage system requires a total effective capacity of at least 150PB, with a minimum effective throughput of 1.5TB/s. Joint testing between DDN Japan and Fujitsu confirmed that a configuration of 5 SFA18KE and 25 SFA18KXE devices, mounted with Fujitsu’s FEFS file system, met these requirements.
Robert Triendl, GM, DDN Japan, commented: “We are a leader in storage for HPC, with our systems in HPCs all over the world, and now in these HPCs in Japan. I am proud that we have been selected as the chosen provider for Fugaku, a national project said to be the pinnacle of Japan’s technological capabilities. We look forward to collaborating closely with RIKEN and Fujitsu ahead of the launch of Fugaku’s operations, and supporting smooth operations thereafter.“
SFA18K Series Overview
In Fugaku’s second-tier storage, the SFA18KE and SFA18KXE will be used as compute nodes for OSS (object storage servers), which serve as a gateway to storage units. The E in SFA18KE and SFA18KXE stands for embedded, with OSS implemented on a VM on the storage controller; HDDs in expansion disk enclosures are utilized as OSTs (object storage targets), used for storage.
Main features of the SFA18K Series are:
- Optimized internal PCIe fabric and a 12Gb back-end SAS fabric ensure high-speed, low-latency data access
- Density enables use of an unmatched number of flash devices (NVMe/SAS) and HDDs in minimal physical space, making it for HPC environments requiring extended capacity
- Scalable, declustered RAID enables quick rebuild times of new high-capacity drives, higher data availability and data protection, as well as the striping of data across a much larger set of physical disks than was previously possible with traditional RAID, improving the parallelism of drive rebuilds
- Aggregated hardware reduces cost and complexity, and with fewer ports, cables, and network devices, administrative costs can be reduced by as much as 70%
“The storage of the HPC Fugaku isn’t simply about capacity; it faces requirements related to extremely advanced performance, costs and usage methods for a variety of I/O. This is brought about from many ultra-large-scale and highly-demanding applications that run on Fugaku to support Society 5.0. With the 16PB of flash memory built into Fugaku’s nodes, DDN’s SFA18KE hardware with Fujitsu’s FEFS file system will integrate to provide control. And, with DDN’s suite of I/O and management software, computing performance could reach Fugaku’s own world-class level and will likely set a new standard not only for HPCs, but also for cloud infrastructures driving advanced AI going forward,” said Satoshi Matsuoka, director, Riken.
“Alongside Riken, Fujitsu has pursued storage to meet Fugaku’s goals of high performance and versatility. Fugaku’s storage consists of highly-reliable, high-capacity second-tier storage (FEFS) and high-performance first-tier storage (LLIO). For this second-tier storage, we concluded that DDN’s SFA18K series would be optimal given its capacity, performance and reliability, as well as the ease of installation, low administrative costs and their long track record in HPC applications. By linking these devices to our FEFS filesystem, we will be able to support Fugaku’s stable operation, contributing to the realization of a sustainable society through innovation, which is the purpose of our company,” said Naoki Shinjo, corporate executive officer, head of platform development unit, Fujitsu.
Major DDN Implementations in Japanese HPCs: