New Supercomputer System Begins Operations at the University of Tokyo's Information Technology Center

The new Oakleaf-FX system, which employs Fujitsu's PRIMEHPC FX10 supercomputer, is one of the few petaflops-class systems in the world and achieves high energy efficiency, as low as 1.4MW for overall system power consumption.

Oakleaf-FX has been installed at the Second Research Complex, Kashiwa Campus, The University of Tokyo, located in Kashiwa, Chiba Prefecture. In addition to contributing to SCD/ITC's cutting-edge research in a wide range of scientific and technological fields, the new system will be used in High-Performance Computing (HPC) education at both the undergraduate and graduate levels. As a result, it is expected to help train the next generation of leaders in the field of computational science.

Background to the Deployment of the New Supercomputer

SCD/ITC was established in 1965 as a large-scale computer center for shared use by researchers in Japan, and has been operating under its current name since 1999. The center has been contributing to advanced research using supercomputers in science and technology, and is used by more than 1,500 researchers inside and outside of the university. To meet the needs of an increasing number of diverse users and to handle large-scale applications, the University of Tokyo selected PRIMEHPC FX10 for its high compatibility with the K computer supercomputer. Moreover, as the need is higher than ever for superior energy efficiency that can keep up with today's energy requirements, the PRIMEHPC FX10 is unique in its energy-efficiency performance, which was able to successfully meet SCD/ITC's requirement for system-wide power consumption of 1.4MW or less.

Overview of the New Oakleaf-FX System

The calculation nodes of the new Oakleaf-FX system use a PRIMEHPC FX10 configuration comprised of 4,800 nodes (50 racks).

Combining high performance, scalability, and reliability with superior energy efficiency, PRIMEHPC FX10 further enhances Fujitsu's technology used in the K computer, which has achieved the world's top-ranked performance.

For the supercomputer's peripheral systems, 74 PRIMERGY x86 servers, 234 ETERNUS storage systems, Technical Computing Suite, which is HPC middleware for peta-scale systems, and FEFS, a high-performance, highly reliable distributed file system that is a component of the Technical Computing Suite, have been deployed.

Oakleaf-FX is slated to be used in a wide range of scientific and technological areas, including earth science, astrophysics, seismology, weather modeling, materials science, energy, biology, hydrodynamics, and solid-state physics.

Oakleaf-FX Specifications

PRIMEHPC FX10
Compute Nodes
- Number of racks 50
- Nodes 4,800
- Theoretical Peak Performance 1.13 petaflops
- Memory Capacity 150TB
- Interconnect Tofu Interconnect (6D Mesh/Torus)

Log-in Nodes Management Servers 16 PRIMERGY RX200S6 servers
58 PRIMERGY RX300S6 servers

Local Files 150 ETERNUS DX80S2 storage units
1.1 petabytes (RAID5)

Shared Files 80 ETERNUS DX410S2 storage units
2.1 petabytes (RAID6)

Software Technical Computing Suite
- File System FEFS
- Compiler Fortran/C/C++
- Numerical Computation SSL II (Scientific Subroutine Library II)
Library C-SSL II, SSL II/MPI
Future Prospects

Through Oakleaf-FX, SCD/ITC will pursue a variety of advanced research and development initiatives led by researchers inside and outside of the university, as well as promote the training of the next generation of leaders in the field of computational science.

As a core facility of Japan's HPC industry, in addition to advancing SCD/ITC's efforts, the system will be used to develop application software and enhance user services in anticipation of future exascale computing systems.

With the new system, Fujitsu will also play a role in SCD/ITC's activities, while leveraging the company's extensive product lineup, robust service framework, and over thirty years of HPC support know-how to provide comprehensive support in all areas of R&D and analysis work.

Comment from Kengo Nakajima, Ph.D., Director, Supercomputing Division, Information Technology Center, The University of Tokyo

The PRIMEHPC FX10 supercomputer system (Oakleaf-FX) will contribute to advancements in various types of research and development activities by users from both academia and industry. Oakleaf-FX will be used for the HPC education program in the Graduate School of the University of Tokyo for future computational scientists. Oakleaf-FX will be operated so that priority is given to larger-scale jobs. Furthermore, a new project, called Large-Scale HPC Challenge is also starting. Members of a group whose proposal has been accepted can occupy all computing nodes (4,800 nodes, 1.13 PFLOPS) of the FX10 system for 24 hours. One proposal is selected per month.