Nvidia says microservices will drive a SmartNIC into every server

Posts sharp Q3 data centre growth and nice gaming numbers but has nothing to say about Arm

Nvidia believes another wave of growth lies ahead of it as microservices create demand for faster data centre networks and therefore a need to offload security and networking chores from hard-pressed CPUs.

The company’s numbers are already surging: today’s Q3 results announcement revealed record revenue of $4.73 billion, a 57 percent jump year-on-year. Net income of $1.34bn was up 49 percent year-on-year.

Data centre revenue reached a record $1.9 billion, up eight percent from the previous quarter and up 162 percent from a year earlier. That leap reflects the acquisition of Mellanox which contributed 13 percent of overall revenue.


Six months after A100 super-GPU's debut, Nvidia doubles memory, ups bandwidth


“Mellanox had another record quarter with double-digit sequential growth well ahead of our expectations,” said CFO Colette Kress. But that result included a sale to a large Chinese OEM that Kress warned would not be repeated in Q4.

But CEO Jensen Huang wasn’t the slightest bit worried about that because he thinks data centres need what Nvidia’s offering on the network and servers.

“The vast majority of the world’s data centre is still built for the traditional hyper-converged architecture, which is all moving over to microservices-based, software-defined disaggregated architectures,” he said. That change will create demand for faster east-west traffic.

“Imagine building firewalls into every single server,” Huang said. “And imagine every single transaction, every single transmission inside the data centre to be high speed and fully encrypted. A pretty amazing amount of computation is going to have to be installed into future data centres.”

Huang thinks a lot of that computation will happen inside data processing units (DPUs), the combination of network card, GPU and SoC that has become de rigeur in hyperscale clouds and recently demanded more mainstream attention when VMware ported its hypervisor to the devices and promised to make them capable of running firewalls.

DPUs will be needed, he said, because between 20 and 40 percent of server capacity can be consumed by networking and security services. “And that’s what the DPUs intended – were designed to do,” Huang said. “We’re going to offload that.”

Hyundai announces its own OS for Nvidia-powered smart-ish cars


“And I believe therefore that every single server in the world will have a DPU inside someday, just because we care so much about security and just because we care so much about throughput and TCO. And it’s really the most cost-effective way of building a data centre. And so, I expect our DPU business to be quite large.”

Is Huang correct? His track record suggests he can pick a market and Q3 offered more evidence of that with gaming-related GPU revenue jumping 37 percent. While automotive revenue fell in the quarter, the former was attributed to a pandemic-related dip and Nvidia has just won a seven-million-units-a-year deal with Hyundai.

Professional visualisation revenue was $236 million, down 27 percent year-on-year but a 16 percent jump from Q2. The business unit outperformed expectations thanks to growing mobile workstation sales that are doing well as the pandemic sends users of such machines home to work and buyers therefore become less likely to replace desktop machines. The decline of desktop workstations drove the year-on-year dip and the mobile machines helped the quarterly jump.

I believe that every single server in the world will have a DPU inside someday

Huang thinks demand for the machines will persist as demand for augmented and virtual reality content grows.

The CEO also mentioned sub-$499 GPUs as an untapped growth market, teased advances to the Triton inference server and suggested plenty of upside in AI.

Earnings calls feature financial analysts who gently and amicably probe senior execs for any signs of weakness that might change the advice they offer to investors. On this call they chose to probe supply chain matters to understand whether Mellanox’s expected dip is a result of not being allowed to sell to Huawei. Huang satisfied them on the former and dodged the latter, saying only that one Chinese customer won’t be back.

None of the analysts asked about Arm. And Huang had nothing to say about it other than that the deal means Nvidia “will create the computing company for the age of AI, with computing extending from the cloud to trillions of devices.” ®

Similar topics

Other stories you might like

  • UK science suffers as lawmakers continue to dither over Brexit negotiations

    Horizons Europe carrot dangled amid protocol wrangling

    A report from the UK House of Commons' European Scrutiny Committee has blamed delays in Brussels for choking off revenue streams to British institutions and businesses.

    The UK departed the European Union following a 2016 referendum. One of the results was that UK businesses were no longer able to tender for lucrative contracts within the bloc.

    The Brexit Divorce Bill uncomfortably laid out the facts back in 2018. The satellite navigation system Galileo was one victim despite substantial involvement from the UK in its development. Another was the Copernicus Earth monitoring programme; the UK was infamously snubbed when the European Space Agency (ESA) handed out six juicy contracts to institutions from the Continent.

    Continue reading
  • Warehouse belonging to Chinese payment terminal manufacturer raided by FBI

    PAX Technology devices allegedly infected with malware

    US feds were spotted raiding a warehouse belonging to Chinese payment terminal manufacturer PAX Technology in Jacksonville, Florida, on Tuesday, with speculation abounding that the machines contained preinstalled malware.

    PAX Technology is headquartered in Shenzhen, China, and is one of the largest electronic payment providers in the world. It operates around 60 million point-of-sale (PoS) payment terminals in more than 120 countries.

    Local Jacksonville news anchor Courtney Cole tweeted photos of the scene.

    Continue reading
  • Everything you wanted to know about modern network congestion control but were perhaps too afraid to ask

    In which a little unfairness can be quite beneficial

    Systems Approach It’s hard not to be amazed by the amount of active research on congestion control over the past 30-plus years. From theory to practice, and with more than its fair share of flame wars, the question of how to manage congestion in the network is a technical challenge that resists an optimal solution while offering countless options for incremental improvement.

    This seems like a good time to take stock of where we are, and ask ourselves what might happen next.

    Congestion control is fundamentally an issue of resource allocation — trying to meet the competing demands that applications have for resources (in a network, these are primarily link bandwidth and router buffers), which ultimately reduces to deciding when to say no and to whom. The best framing of the problem I know traces back to a paper [PDF] by Frank Kelly in 1997, when he characterized congestion control as “a distributed algorithm to share network resources among competing sources, where the goal is to choose source rate so as to maximize aggregate source utility subject to capacity constraints.”

    Continue reading
  • How business makes streaming faster and cheaper with CDN and HESP support

    Ensure a high video streaming transmission rate

    Paid Post Here is everything about how the HESP integration helps CDN and the streaming platform by G-Core Labs ensure a high video streaming transmission rate for e-sports and gaming, efficient scalability for e-learning and telemedicine and high quality and minimum latencies for online streams, media and TV broadcasters.

    HESP (High Efficiency Stream Protocol) is a brand new adaptive video streaming protocol. It allows delivery of content with latencies of up to 2 seconds without compromising video quality and broadcasting stability. Unlike comparable solutions, this protocol requires less bandwidth for streaming, which allows businesses to save a lot of money on delivery of content to a large audience.

    Since HESP is based on HTTP, it is suitable for video transmission over CDNs. G-Core Labs was among the world’s first companies to have embedded this protocol in its CDN. With 120 points of presence across 5 continents and over 6,000 peer-to-peer partners, this allows a service provider to deliver videos to millions of viewers, to any devices, anywhere in the world without compromising even 8K video quality. And all this comes at a minimum streaming cost.

    Continue reading
  • Cisco deprecates Microsoft management integrations for UCS servers

    Working on Azure integration – but not there yet

    Cisco has deprecated support for some third-party management integrations for its UCS servers, and emerged unable to play nice with Microsoft's most recent offerings.

    Late last week the server contender slipped out an end-of-life notice [PDF] for integrations with Microsoft System Center's Configuration Manager, Operations Manager, and Virtual Machine Manager. Support for plugins to VMware vCenter Orchestrator and vRealize Orchestrator have also been taken out behind an empty rack with a shotgun.

    The Register inquired about the deprecations, and has good news and bad news.

    Continue reading
  • Protonmail celebrates Swiss court victory exempting it from telco data retention laws

    Doesn't stop local courts' surveillance orders, though

    Encrypted email provider Protonmail has hailed a recent Swiss legal ruling as a "victory for privacy," after winning a lawsuit that sees it exempted from data retention laws in the mountainous realm.

    Referring to a previous ruling that exempted instant messaging services from data capture and storage laws, the Protonmail team said this week: "Together, these two rulings are a victory for privacy in Switzerland as many Swiss companies are now exempted from handing over certain user information in response to Swiss legal orders."

    Switzerland's Federal Administrative Court ruled on October 22 that email providers in Switzerland are not considered telecommunications providers under Swiss law, thereby removing them from the scope of data retention requirements imposed on telcos.

    Continue reading
  • Japan picks AWS and Google for first gov cloud push

    Local players passed over for Digital Agency’s first project

    Japan's Digital Agency has picked Amazon Web Services and Google Cloud for its first big reform push.

    The Agency started operations in September 2021, years after efforts like the UK's Government Digital Service (GDS) or Australia's Digital Transformation Agency (DTA). The body was a signature reform initiated by Prime Minister Yoshihide Suga, who spent his year-long stint in the top job trying to curb Japan's reliance on paper documents, manual processes, and faxes. Japan's many government agencies also operated their websites independently of each other, most with their own design and interface.

    The new Agency therefore has a remit to "cut across all ministries" and "provide services that are driven not toward ministries, agency, laws, or systems, but toward users and to improve user-experience".

    Continue reading
  • Singaporean minister touts internet 'kill switch' that finds kids reading net nasties and cuts 'em off ASAP

    Fancies a real-time crowdsourced content rating scheme too

    A Minister in the Singapore government has suggested the creation of an internet kill switch that would prevent minors from reading questionable material online – perhaps using ratings of content created in real time by crowdsourced contributors.

    "The post-COVID world will bring new challenges globally, including to us in the security arena," said Minister for Defence Dr Ng Eng Hen at a Tuesday ceremony to award the city-state's 2021 Defense Technology Prize.

    "For operations, the SAF (Singapore Armed Force) has to expand its capabilities in the digital domain. Whether for administrative or operational purposes, I think that we will need to leverage technology to the maximum," he declared.

    Continue reading

Biting the hand that feeds IT © 1998–2021