HPC

Europe's most powerful supercomputer is an all-AMD beast

First of Europe's pre-exascale systems inaugurated, hits top 3 even without GPU partition fully installed


HPE has scored another supercomputing win with the inauguration of the LUMI system at the IT Center for Science, Finland, which as of this month is ranked as Europe's most powerful supercomputer.

Picture from LUMI data center construction site at CSC's data center in Kajaani, Finland, 05/2020. Image: Esa Heiskanen, CSC (JPEG 4.40 MB)

Picture from LUMI data center construction site at CSC's data center in Kajaani, Finland. Image: Esa Heiskanen, CSC

LUMI - Finnish word for snow - is the first pre-exascale system under the EuroHPC Joint Undertaking and is based on HPE's Cray EX hardware architecture. The project is installed at the IT Center for Science (CSC) datacenter in Kajaani.

It is owned by the EuroHPC Joint Undertaking (JU) of the EU, and half the total €202 million ($210 million) budget for the beast comes from EU, with a quarter coming from Finland and the rest from the remaining members of the consortium of 10 countries involved.

Furthering research

The system is intended to serve as a platform for international research cooperation and for the development of artificial intelligence and quantum technology, according to the CSC. It is also expected to be used for the usual mix of scientific projects such as climate change simulations and medical research, but 20 percent of its capacity is intended to be available for industrial research and development activities, including small to medium enterprises (SMEs).

"LUMI will help solve societal challenges," said CSC managing director Kimmo Koski, "including climate, life sciences, medical, and there are of course many others."

He added that the system will be used for applications involving high performance computing (HPC), AI and data analytics, but also "where these meet and merge", which has been a common thread among HPC projects for the past several years.

As of 30 May, LUMI has already taken the third spot on the current Top500 list of world's fastest supercomputers, achieving a High-Performance Linpack (HPL) rating of 151.9 petaflops in benchmarks that were disclosed at the recent ISC22 conference in Hamburg.

However, not all the cabinets have been filled yet, with LUMI's GPU partition not yet fully installed, after which its performance is expected to grow to about 375 petaflops, with a peak performance potentially exceeding 550 petaflops.

A second pilot phase for selected users is scheduled to start in August, with the complete system expected to be generally available for users in late September.

As well as being intended for research to help tackle climate change, LUMI is also claimed to have green credentials by being run entirely from hydroelectric power, while the waste heat generated by the system contributes to heating nearby homes in the Kajaani area.

The Finnish permanent secretary for Education and Culture Anita Lehikoinen said that LUMI would be hugely beneficial for the volume of scientific research done in the country.

"It is important for Finland to be seen as an attractive destination for science and research," she said, adding that the country planned to increase spending on research and innovation to 4 percent of GDP by 2030, calling it "a worthwhile investment."

The HPE Cray EX architecture [PDF] that LUMI is built from is a blade-based, high-density design built with multiple units of a liquid cooled datacenter cabinet. Each cabinet holds eight compute chassis, with each chassis fitting eight blades for up to 64 compute blades and up to 512 processors per cabinet.

Each cabinet can also hold up to eight switch chassis fitted with HPE Slingshot interconnect switch blades.

According to CSC, the CPU-only partition comprises 1,536 dual-socket CPU nodes, each featuring AMD "Milan" Epyc processors and between 256GB and 1,024GB memory.

The GPU partition has 2,560 nodes, each featuring a single custom AMD "Trento" Epyc chip and four AMD MI250X GPUs.

LUMI also has 64 Nvidia A40 GPUs installed for visualization workloads, and sports a partition with large memory nodes with 32TB of memory between them.

The storage layer of LUMI is based on the Cray Clusterstor E1000 system and the Lustre file system, with 8 petabytes of flash and 80 petabytes of hard disk space. LUMI also has 30 petabytes of Ceph-based object storage.

According to CSC, the entire LUMI installation occupies nearly 300 square meters (c 3,229 square feet) of space, about the same area as two tennis courts.

HPE was recently involved in the Venado supercomputer project for the Los Alamos National Laboratory, and is working with European microprocessor designer SiPearl to jointly develop a supercomputer using SiPearl's Arm-based Rhea processor.

Last month, HPE and Cerebras Systems unveiled a new AI supercomputer in Munich, Germany, using HPE's Superdome Flex, while HPE itself inaugurated the Champollion supercomputer at HPE's Center of Excellence in Grenoble, France, using AMD-based Apollo computer nodes and Nvidia GPUs. ®

Broader topics


Other stories you might like

  • HPE thinks your next GreenLake deploy will be a private cloud
    Plus: IT giant expands relationship with Red Hat and SUSE, tackles hybrid data fabrics

    Extending a public-cloud-like experience to on-prem datacenters has long been a promise of HPE's GreenLake anything-as-a-service (XaaS) platform. At HPE Discover this week, the company made good on that promise with the launch of GreenLake for Private Cloud.

    The platform enables customers "to have a cloud in their premises wherever the data is, whether it's at the edge, it's at a colo datacenter, or is at any other location," Vishal Lall, SVP and GM for HPE GreenLake cloud services solutions, said during a press briefing ahead of Discovery.

    Most private clouds up to this point have been custom-built environments strapped together with some automation, he said. "It was somewhat of an improvement over the DIY infrastructure, but it really wasn't private cloud."

    Continue reading
  • HPE Q2 revenue growth held back by supply constraints
    'However, enterprise demand continues to persist across our entire portfolio,' says CEO

    Amid a delayed HPC contract and industry-wide supply limitations compounded by the lockdown in Shanghai, Hewlett Packard Enterprise reported year-on-year sales growth of $13 million for its Q2.

    That equated to revenue expansion of 1.5 percent to $6.713 billion for the quarter ended 30 April. Wall Street had forecast HPE to generate $6.81 billion in sales for the period and didn't look too kindly on the shortfall.

    "This quarter," said CEO and president Antonio Neri, "through a combination of supply constraints, limiting our ability to fulfill orders as well as some areas where we could have executed better, we did not fully translate the strong customer orders into higher revenue growth."

    Continue reading
  • HPE ordered to pay Oracle $30m for Solaris IP infringement
    Years long case closes after three-week jury trial, HPE considering next step

    Hewlett Packard Enterprise must pay Oracle $30 million for copyright infringement after a jury found it guilty of providing customers with Solaris software updates without Big Red's permission.

    The decision, which HPE may contest, is the culmination of a three-week trial in Oakland, California. However, the case was first raised years back when Oracle claimed HPE had offered illegal updates under a scheme devised by software support provider Terix, which settled its case in 2015 for almost $58 million.

    In proceedings at the start of this week, Oracle’s lawyer, Christopher Yeates of Latham & Watkins LLP, pressed the eight-person jury to award his client $72 million for HPE using software not covered by a support contract, and for pinching clients, including Comcast.

    Continue reading
  • Will Lenovo ever think beyond hardware?
    Then again, why develop your own software à la HPE GreenLake when you can use someone else's?

    Analysis Lenovo fancies its TruScale anything-as-a-service (XaaS) platform as a more flexible competitor to HPE GreenLake or Dell Apex. Unlike its rivals, Lenovo doesn't believe it needs to mimic all aspects of the cloud to be successful.

    While subscription services are nothing new for Lenovo, the company only recently consolidated its offerings into a unified XaaS service called TruScale.

    On the surface TruScale ticks most of the XaaS boxes — cloud-like consumption model, subscription pricing — and it works just like you'd expect. Sign up for a certain amount of compute capacity and a short time later a rack full of pre-plumbed compute, storage, and network boxes are delivered to your place of choosing, whether that's a private datacenter, colo, or edge location.

    Continue reading

Biting the hand that feeds IT © 1998–2022