HPC

Appro wins 6 petaflops contract from DOE nuke labs

Largest deal in company history


Niche supercomputer supplier Appro International has bagged the largest deal in its history, having won a massive contract from the US Department of Energy to supply up to 6 petaflops of raw computing power to three of its nuke labs for the next several years.

Appro was not allowed to divulge the price tag on the clusters that Tri-Labs will be installing, but John Lee, vice president of advanced technology solutions at the company, said the deal with the three nuke labs – Lawrence Livermore, Los Alamos, and Sandia National Laboratories, often called Tri-Labs – represented the largest procurement it had ever done both in terms of money and aggregate number-crunching power.

Lee added that the bidding for the Tri-Labs procurement was intense, with around a dozen suppliers contending for the work, in his estimation. The bidding at DOE is super secret, so the exact roll of vendors and systems that Appro beat out to win the deal is not known.

"Everybody including your grandmother wanted to bid on this thing," Lee says with a laugh. Companies did presentations to the DOE in early 2010 for the Tri-Labs procurement and the request for proposals went out earlier this year.

The Tri-Labs procurement is based on a future generation of Appro's GreenBlade blade servers, which will be based on two-socket blade servers using Intel's future "Sandy Bridge" Xeon E5 processors, due around the third quarter of this year, if the rumors are right. The blades will be configured with 32 DDR3 memory slots running at 1.6GHz, but Appro was not at liberty to discuss the feeds and speeds of the Xeon processors.

What the company could say is that it was creating pods of computing elements, what it calls "scalable units", that are pre-integrated with QLogic InfiniBand switches running at 40Gb/sec (Quad Data Rate, or QDR) at the Appro factory and then shipped off to the three labs to be assembled using a bi-directional fat tree configuration into a large cluster weighing in at just over 1 petaflops per lab. Brocade Communications is being tapped for management and storage switches as well.

"When all of the options are exercised, we expect that to double to over 6 petaflops," says Lee.

The Tri-Labs deal will consume a big portion of Appro's production capacity, and the DOE facilities will be getting all of the initial production for the future GreenBlade servers using Intel's Xeon E5 processors, according to Lee. The new GreenBlade design will be able to accommodate Intel's future "Knights" family of X64-based coprocessors that will plug into PCI-Express slots, due sometime in the future on Intel's 22 nanometer Tri-Gate production processes. Tri-Labs is not putting these Many Integrated Core, or MIC, coprocessors into the new supercomputer clusters, but one of the labs – Lee would not say which one – has requested that a subset of the GreenBlade nodes be equipped with M2090 fanless GPU coprocessors from Nvidia.

The initial delivery of the supercomputers will begin in the third quarter of this year, and by the first quarter of 2012 the 3 petaflops of aggregate oomph will be up and running across the three labs. By the third quarter of 2012, Lee expects the Tri-Labs systems to be stretched to the full 6 petaflops. The first phase of the procurement, the DOE confirmed, is worth $39m, and the second phase brings the total 6 petaflops machine up to $89m. That's under $15,000 per teraflops – about a third of what it cost a two years ago for petaflops-class machines.

The machines, which will be networked together across the three labs, will be running the Tri-Labs Operating System, a variant of Red Hat Enterprise Linux cooked up by the nuke labs, and Windows HPC Server 2008 R2 is not going to be an option on them. And that means to make it run Crysis, you need to add the WINE runtime environment on top of the Tri-Labs Linux variant.

The Appro machines are designated by the DOE as "capacity computing" resources, which means they do the grunt work for all of the weapons design, physics, and chemistry research done at the labs by many researchers. As such, the capacity machines are designed to be as balanced as they can be for supporting multiple workloads and many users. This is distinct from the DOE's "capability computing" machines, which are usually custom-made boxes with special features aimed at testing a new architecture for a very precise workload or handful of workloads. ®

Broader topics


Other stories you might like

  • Florida's content-moderation law kept on ice, likely unconstitutional, court says
    So cool you're into free speech because that includes taking down misinformation

    While the US Supreme Court considers an emergency petition to reinstate a preliminary injunction against Texas' social media law HB 20, the US Eleventh Circuit Court of Appeals on Monday partially upheld a similar injunction against Florida's social media law, SB 7072.

    Both Florida and Texas last year passed laws that impose content moderation restrictions, editorial disclosure obligations, and user-data access requirements on large online social networks. The Republican governors of both states justified the laws by claiming that social media sites have been trying to censor conservative voices, an allegation that has not been supported by evidence.

    Multiple studies addressing this issue say right-wing folk aren't being censored. They have found that social media sites try to take down or block misinformation, which researchers say is more common from right-leaning sources.

    Continue reading
  • US-APAC trade deal leaves out Taiwan, military defense not ruled out
    All fun and games until the chip factories are in the crosshairs

    US President Joe Biden has heralded an Indo-Pacific trade deal signed by several nations that do not include Taiwan. At the same time, Biden warned China that America would help defend Taiwan from attack; it is home to a critical slice of the global chip industry, after all. 

    The agreement, known as the Indo-Pacific Economic Framework (IPEF), is still in its infancy, with today's announcement enabling the United States and the other 12 participating countries to begin negotiating "rules of the road that ensure [US businesses] can compete in the Indo-Pacific," the White House said. 

    Along with America, other IPEF signatories are Australia, Brunei, India, Indonesia, Japan, South Korea, Malaysia, New Zealand, the Philippines, Singapore, Thailand and Vietnam. Combined, the White House said, the 13 countries participating in the IPEF make up 40 percent of the global economy. 

    Continue reading
  • 381,000-plus Kubernetes API servers 'exposed to internet'
    Firewall isn't a made-up word from the Hackers movie, people

    A large number of servers running the Kubernetes API have been left exposed to the internet, which is not great: they're potentially vulnerable to abuse.

    Nonprofit security organization The Shadowserver Foundation recently scanned 454,729 systems hosting the popular open-source platform for managing and orchestrating containers, finding that more than 381,645 – or about 84 percent – are accessible via the internet to varying degrees thus providing a cracked door into a corporate network.

    "While this does not mean that these instances are fully open or vulnerable to an attack, it is likely that this level of access was not intended and these instances are an unnecessarily exposed attack surface," Shadowserver's team stressed in a write-up. "They also allow for information leakage on version and build."

    Continue reading
  • A peek into Gigabyte's GPU Arm for AI, HPC shops
    High-performance platform choices are going beyond the ubiquitous x86 standard

    Arm-based servers continue to gain momentum with Gigabyte Technology introducing a system based on Ampere's Altra processors paired with Nvidia A100 GPUs, aimed at demanding workloads such as AI training and high-performance compute (HPC) applications.

    The G492-PD0 runs either an Ampere Altra or Altra Max processor, the latter delivering 128 64-bit cores that are compatible with the Armv8.2 architecture.

    It supports 16 DDR4 DIMM slots, which would be enough space for up to 4TB of memory if all slots were filled with 256GB memory modules. The chassis also has space for no fewer than eight Nvidia A100 GPUs, which would make for a costly but very powerful system for those workloads that benefit from GPU acceleration.

    Continue reading
  • GitLab version 15 goes big on visibility and observability
    GitOps fans can take a spin on the free tier for pull-based deployment

    One-stop DevOps shop GitLab has announced version 15 of its platform, hot on the heels of pull-based GitOps turning up on the platform's free tier.

    Version 15.0 marks the arrival of GitLab's next major iteration and attention this time around has turned to visibility and observability – hardly surprising considering the acquisition of OpsTrace as 2021 drew to a close, as well as workflow automation, security and compliance.

    GitLab puts out monthly releases –  hitting 15.1 on June 22 –  and we spoke to the company's senior director of Product, Kenny Johnston, at the recent Kubecon EU event, about what will be added to version 15 as time goes by. During a chat with the company's senior director of Product, Kenny Johnston, at the recent Kubecon EU event, The Register was told that this was more where dollars were being invested into the product.

    Continue reading
  • To multicloud, or not: Former PayPal head of engineering weighs in
    Not everyone needs it, but those who do need to consider 3 things, says Asim Razzaq

    The push is on to get every enterprise thinking they're missing out on the next big thing if they don't adopt a multicloud strategy.

    That shove in the multicloud direction appears to be working. More than 75 percent of businesses are now using multiple cloud providers, according to Gartner. That includes some big companies, like Boeing, which recently chose to spread its bets across AWS, Google Cloud and Azure as it continues to eliminate old legacy systems. 

    There are plenty of reasons to choose to go with multiple cloud providers, but Asim Razzaq, CEO and founder at cloud cost management company Yotascale, told The Register that choosing whether or not to invest in a multicloud architecture all comes down to three things: How many different compute needs a business has, budget, and the need for redundancy. 

    Continue reading

Biting the hand that feeds IT © 1998–2022