Fujitsu HPC at University of Tokyo

Fujitsu Limited has completed construction of the new supercomputer, nicknamed Oakleaf-FX, for the Supercomputing Division of the University of Tokyo’s Information Technology Center (SCD/ITC). The new system just began operations.

The Oakleaf-FX system, which employs Fujitsu’s PRIMEHPC FX10 supercomputer, is one of the few petaflops-class systems in the world and achieves high energy efficiency, as low as 1.4MW for overall system power consumption.

Oakleaf-FX has been installed at the Second Research Complex, Kashiwa Campus, The University of Tokyo, located in Kashiwa, Chiba Prefecture. In addition to contributing to SCD/ITC’s research in a range of scientific and technological fields, the new system will be used in HPC) education at both the undergraduate and graduate levels. As a result, it is expected to help train the next generation of leaders in the field of computational science.

Background to the Deployment
of the New Supercomputer
SCD/ITC was established in 1965 as a large-scale computer center for shared use by researchers in Japan, and has been operating under its current name since 1999. The center has been contributing to advanced research using supercomputers in science and technology, and is used by more than 1,500 researchers inside and outside of the university. To meet the needs of an increasing number of diverse users and to handle large-scale applications, the University of Tokyo selected PRIMEHPC FX10 for its compatibility with the K computer supercomputer. Moreover, as the need is higher than ever for superior energy efficiency that can keep up with today’s energy requirements, the PRIMEHPC FX10 is unique in its energy-efficiency performance, which was able to meet SCD/ITC’s requirement for system-wide power consumption of 1.4MW or less.

Overview of the New Oakleaf-FX System
The calculation nodes of the new Oakleaf-FX system use a PRIMEHPC FX10 configuration comprised of 4,800 nodes (50 racks).

Combining high performance, scalability, and reliability with energy efficiency, PRIMEHPC FX10 further enhances Fujitsu’s technology used in the K computer, which has achieved the world’s top-ranked performance.

For the supercomputer’s peripheral systems, 74 PRIMERGY x86 servers, 234 ETERNUS storage systems, Technical Computing Suite, which is HPC middleware for peta-scale systems, and FEFS, a high-performance, highly reliable distributed file system that is a component of the Technical Computing Suite, have been deployed.

Oakleaf-FX is slated to be used in a range of scientific and technological areas, including earth science, astrophysics, seismology, weather modeling, materials science, energy, biology, hydrodynamics, and solid-state physics.

Oakleaf-FX Specifications of PRIMEHPC FX10

Compute Nodes

• Number of racks: 50
• Nodes: 4,800
• Theoretical Peak Performance: 1.13 petaflops
• Memory Capacity: 150TB
• Interconnect: Tofu Interconnect (6D Mesh/Torus)

Log-in Nodes Management Servers

• 16 PRIMERGY RX200S6 servers
• 58 PRIMERGY RX300S6 servers

Local Files

• 150 ETERNUS DX80S2 storage units, 1.1 petabytes (RAID-5) 

Shared Files                      

• 80 ETERNUS DX410S2 storage units, 2.1 petabytes (RAID-6) 

Software

• File System: FEFS
• Compiler: Fortran/C/C++
• Numerical Computation Library: SSL II (Scientific Subroutine Library II), C-SSL II, SSL II/MPI

Through Oakleaf-FX, SCD/ITC will pursue a variety of advanced research and development initiatives led by researchers inside and outside of the university, as well as promote the training of the next generation of leaders in the field of computational science.

As a core facility of Japan’s HPC industry, in addition to advancing SCD/ITC’s efforts, the system will be used to develop application software and enhance user services in anticipation of future exascale computing systems.

With the new system, Fujitsu will also play a role in SCD/ITC’s activities, while leveraging the company’s product lineup, robust service framework, and over thirty years of HPC support know-how to provide support in all areas of R&D and analysis work.

Comment from Kengo Nakajima, Ph.D., Director, Supercomputing Division, Information Technology Center, The University of Tokyo: "The PRIMEHPC FX10 supercomputer system (Oakleaf-FX) will contribute to advancements in various types of research and development activities by users from both academia and industry. Oakleaf-FX will be used for the HPC education program in the Graduate School of the University of Tokyo for future computational scientists. Oakleaf-FX will be operated so that priority is given to larger-scale jobs. Furthermore, a new project, called Large-Scale HPC Challenge is also starting. Members of a group whose proposal has been accepted can occupy all computing nodes (4,800 nodes, 1.13 PFLOPS) of the FX10 system for 24 hours. One proposal is selected per month."