Inspur jacks up huge heat sink-sporting beast

New GPU’riffic box vies for dominance

HPC Blog At trade shows, I’m always attracted by the sight of huge heat sinks bunched together on a system board. Big and powerful hardware is a weakness of mine. The sight of them pulls me to the booth like a giant tractor beam.

That’s exactly what happened when I wondered by the Inspur booth at GTC17. Its new AGK-2 server is quite the system. On a single 2U server, it has packed in 8 GPUs, dual CPUs, and 16 DIMM slots. Now that’ll run your Crysis for you…

Better yet, the GPUs are attached to the system board via the newest NVLink 2.0 interface. For the uninitiated, NVLink 1.0 was collaboration between IBM and NVIDIA, with the goal of providing a high-speed direct and dedicated CPU-GPU and GPU-GPU connection.

The first version of NVLink offered up 80GB/s of bandwidth, more than double the 35GB/s that you’d get from attaching the GPUs to PCIe. The newest NVLink, the aptly named NVLink 2.0, provides a mind blowing 300GB/s bandwidth between CPUs and GPUs and from GPU to GPU.

The AGX-2 offers up two M.2 PCIe drive slots on the motherboard, which provide close to 4x the speed of SATA 3. Users can also host up to 8 2.5” drives in the 2U chassis.

Inspur is touting this box for extreme AI deep learning and HPC applications. It’s certainly the most powerful single server your correspondent saw at GTC17, with the possible exception of NVIDIA’s own DGX-2.

The AGX-2 has both air-only cooling and an air/liquid hybrid cooling options for the GPUs (which generate the most heat). This box has some super powerful fans, meaning that with either cooling option you can run the box flat out and not be slowed by thermal limitations.

There was no pricing info available.

Similar topics

Narrower topics

Other stories you might like

  • Twitter founder Dorsey beats a hasty retweet from the board
    We'll see you around the Block

    Twitter has officially entered the post-Dorsey age: its founder and two-time CEO's board term expired Wednesday, marking the first time the social media company hasn't had him around in some capacity.

    Jack Dorsey announced his resignation as Twitter chief exec in November 2021, and passed the baton to Parag Agrawal while remaining on the board. Now that board term has ended, and Dorsey has stepped down as expected. Agrawal has taken Dorsey's board seat; Salesforce co-CEO Bret Taylor has assumed the role of Twitter's board chair. 

    In his resignation announcement, Dorsey – who co-founded and is CEO of Block (formerly Square) – said having founders leading the companies they created can be severely limiting for an organization and can serve as a single point of failure. "I believe it's critical a company can stand on its own, free of its founder's influence or direction," Dorsey said. He didn't respond to a request for further comment today. 

    Continue reading
  • Snowflake stock drops as some top customers cut usage
    You might say its valuation is melting away

    IPO darling Snowflake's share price took a beating in an already bearish market for tech stocks after filing weaker than expected financial guidance amid a slowdown in orders from some of its largest customers.

    For its first quarter of fiscal 2023, ended April 30, Snowflake's revenue grew 85 percent year-on-year to $422.4 million. The company made an operating loss of $188.8 million, albeit down from $205.6 million a year ago.

    Although surpassing revenue expectations, the cloud-based data warehousing business saw its valuation tumble 16 percent in extended trading on Wednesday. Its stock price dived from $133 apiece to $117 in after-hours trading, and today is cruising back at $127. That stumble arrived amid a general tech stock sell-off some observers said was overdue.

    Continue reading
  • Amazon investors nuke proposed ethics overhaul and say yes to $212m CEO pay
    Workplace safety, labor organizing, sustainability and, um, wage 'fairness' all struck down in vote

    Amazon CEO Andy Jassy's first shareholder meeting was a rousing success for Amazon leadership and Jassy's bank account. But for activist investors intent on making Amazon more open and transparent, it was nothing short of a disaster.

    While actual voting results haven't been released yet, Amazon general counsel David Zapolsky told Reuters that stock owners voted down fifteen shareholder resolutions addressing topics including workplace safety, labor organizing, sustainability, and pay fairness. Amazon's board recommended voting no on all of the proposals.

    Jassy and the board scored additional victories in the form of shareholder approval for board appointments, executive compensation and a 20-for-1 stock split. Jassy's executive compensation package, which is tied to Amazon stock price and mostly delivered as stock awards over a multi-year period, was $212 million in 2021. 

    Continue reading

Biting the hand that feeds IT © 1998–2022