Datadobi

Extended HPC Service at Durham University in UK Helps Space Science

With 4.3PB DDN storage running Exascaler and Intel Enterprise Lustre
This is a Press Release edited by StorageNewsletter.com on 2017.08.10

AddThis Social Bookmark Button
  • STFC funded project enhances COSMA 6 HPC service
  • Hardware previously used at the Hartree Centre, Daresbury
  • 4.3PB DDN storage running DDN Exascaler and Intel Enterprise Lustre
  • Cabling, rewiring and software installation completed by OCF
  • COSMA6 part of national DiRAC 2.5 HPC service

Researchers specialising in astrophysics and cosmology, particle physics and nuclear physics at Durham University and from across the UK can take advantage of an extended HPC service.

The DiRAC  Data Centric HPC system installed at Durham University has been enhanced by the deployment of COSMA 6, a machine with 8,000 Intel Sandy Bridge cores and 4.3PB of storage 'upcycled' from another system previously located at the Hartree Centre in Daresbury.

This additional resource was needed to maintain the international competitiveness of the research community served by DiRAC for the next 12 months. In recognition of this, DiRAC was able to secure funding from the Science and Technology Facilities Council (STFC) to make use of the generous gift from Hartree and transfer and re-install the system at Durham University.

COSMA6 enables researchers to extend large-scale structure simulations of the evolution of the universe, analyse data from gravitational wave detectors, and simulate the Sun and planets in the solar system. It is live and operational from April 2017.

The University's COSMA 6 service, combined with its existing COSMA 5 service, contributes over 14,000 cores to the national computing facility, DiRAC 2.5. DiRAC is a facility for theoretical modelling and HPC-based research in particle physics, nuclear physics, astronomy and cosmology, areas in which the UK is particularly renowned

Since its launch in 2010 DiRAC has received £29 million in funding from the government.

The upcycled cores of COSMA6 added to the DiRAC Data Centric system installed at Durham University began life as a HPC machine at The Hartree Centre, Daresbury in 2012, but, as a consequence of  upgrades, the Centre no longer had space to house the machine in its data centre. The staff of the Institute for Computational Cosmology (ICC) at Durham University worked with HPC, storage and data analytics integrator OCF plc, and the specialist server relocation and data centre migration specialist Technimove Ltd to dismantle, transport, and rebuild the HPC machine at its new home.

"We had a very similar setup to The Hartree Centre; we had an IBM machine as did they; both of our older systems arrived in the UK within a day of each other in April 2012; we have a new machine room in Durham so we had the space, cooling and power and we also needed the cores to help boost our contribution to the national DiRAC system," explains Lydia Heck, technical director, Institute for Computational Cosmology.

The rebuilding of the machine and its integration into the current DiRAC systems was an excellent example of collaboration between the customer and the IT partners. As half of the storage runs on DDN's own Lustre parallel filesystem, Exascaler, and the other half on Intel's Enteprise Lustre, the storage elements had to be installed in three racks that were re-cabled by OCF (and supported by DDN), and three re-cabled, and supported by the University. This complex integration of the different storage elements has been successful and the users see a good storage service.

Heck continues: "While it was quite an effort to bring it to its current state, as it is the same architecture and the same network layout as our previous system, we expect this to run very well." 

"The new HPC system at Durham University  is a testament to the skills of all involved in the project who were able to re-install a second hand cluster, add to it new RAM memory and design a solution that will prove invaluable to the research community," comments Julian Fielden, MD, OCF. "We have a long history of working with Durham University so we're really pleased to have been involved in such a unique project."

Articles_bottom