Nvidia open to third parties making custom silicon tuned for CUDA applications

Who's going to be the first to bite? Hint, you may need to be the size of Facebook or Google


Software is a top priority for Nvidia, the chip designer has made clear at this week's ongoing GPU Technology conference, and that this continues to influence its hardware development.

The Silicon Valley giant is open to the idea of non-Nvidia processors tuned for native execution of software built using its CUDA development toolkit, Nvidia CEO Jensen Huang told The Register during a press conference. CUDA is Nvidia's proprietary programming platform and interface for applications to harness the computing power of the company's GPUs. CUDA is helping Nvidia sell more of these accelerators into enterprises.

The company has no plans to open-source its CUDA development environment, though if companies want to build or optimize their own chips for CUDA-built applications, the company is not necessarily against that effort, Huang told us.

"Underneath CUDA is Nvidia's hardware," Huang said. "There's really nothing to open source. If somebody would like to build an application for CUDA or to build another chip for CUDA, we're not not fundamentally against it, and nobody has ever asked."

The alternative would be for Nvidia to open-source its GPUs for others to use in their system-on-chips with CUDA-built applications running on top, which just isn't going to happen, Huang said. CUDA is often considered light-years ahead of similar frameworks for other architectures, and Nvidia isn't going to open up the software, nor the underlying hardware, to rivals.

To successfully produce a CUDA-compatible accelerator that can take full advantage of the framework, you will likely need Nvidia's input, and that's only going to happen if it makes commercial sense all round.

If a large player with lots of money to spend wants to develop custom silicon for the programming framework, that would grab Nvidia's interest, said Jim McGregor, principal analyst at Tirias Research.

"If it's a huge customer like Facebook, [Nvidia] will do whatever they need to," McGregor said. Top cloud providers like Amazon and Google are customizing chips for specific workloads, and Nvidia may lose out if it chooses not to collaborate in this area, plus CUDA's relevance could be diluted, he opined.

Google has its family of homegrown TPUs to accelerate machine-learning software, for instance, we note.

Nvidia is positioning itself as a software company around CUDA, which is more of a means to sell more GPUs. The company sees itself as the software and hardware provider for the metaverse, a parallel 3D universe championed by Facebook (now Meta) as a borderless digital world in which avatars can work, play, and interact.

CUDA is central to Nvidia's metaverse hardware and software platform called Omniverse. Meanwhile, companies are using CUDA to bring their applications to virtual worlds.

Nvidia has 150 software development kits available for building tools and whatnot on CUDA, with some new applications being ReOpt for supply chain optimization and cuQuantum for simulation of quantum computing on a GPU. CUDA is also being used to write software for autonomous cars equipped with Nvidia hardware.

Nvidia is balancing on a tightrope of projecting itself as an "open" company, while also recruiting organizations into its closed hardware and software ecosystem.

"Our strategy is not to be a bespoke, not to be a proprietary computer, but be an open computer," Huang said during the press conference, "but be an open computer that allows the world to build software upon it. And whenever the software doesn't exist, we go and create it."

While Nvidia holds on tight to CUDA, its crown jewels, rival tools are trying to fill the gap. Nvidia's GPUs are compliant with OpenCL, a parallel programming framework backed by AMD and Intel. AMD offers a hardware-acceleration software suite and CUDA wannabe called ROCm, and Intel has its whole oneAPI offering.

OpenAI in July announced an AI-specific framework called Triton, which provides a Python-like programming environment in which researchers with no CUDA experience can write efficient code for execution on Nvidia GPUs.

A project called Vortex is looking to bring the execution of CUDA applications to GPUs within RISC-V devices.

Back in 2013, Nvidia said it would license its GPU IP to third parties. The company did not respond when we asked if it is still doing so. AMD has licensed its GPU architecture to Samsung, which the company plans to use in its mobile chips. ®

Similar topics

Broader topics


Other stories you might like

  • Prisons transcribe private phone calls with inmates using speech-to-text AI

    Plus: A drug designed by machine learning algorithms to treat liver disease reaches human clinical trials and more

    In brief Prisons around the US are installing AI speech-to-text models to automatically transcribe conversations with inmates during their phone calls.

    A series of contracts and emails from eight different states revealed how Verus, an AI application developed by LEO Technologies and based on a speech-to-text system offered by Amazon, was used to eavesdrop on prisoners’ phone calls.

    In a sales pitch, LEO’s CEO James Sexton told officials working for a jail in Cook County, Illinois, that one of its customers in Calhoun County, Alabama, uses the software to protect prisons from getting sued, according to an investigation by the Thomson Reuters Foundation.

    Continue reading
  • Battlefield 2042: Please don't be the death knell of the franchise, please don't be the death knell of the franchise

    Another terrible launch, but DICE is already working on improvements

    The RPG Greetings, traveller, and welcome back to The Register Plays Games, our monthly gaming column. Since the last edition on New World, we hit level cap and the "endgame". Around this time, item duping exploits became rife and every attempt Amazon Games made to fix it just broke something else. The post-level 60 "watermark" system for gear drops is also infuriating and tedious, but not something we were able to address in the column. So bear these things in mind if you were ever tempted. On that note, it's time to look at another newly released shit show – Battlefield 2042.

    I wanted to love Battlefield 2042, I really did. After the bum note of the first-person shooter (FPS) franchise's return to Second World War theatres with Battlefield V (2018), I stupidly assumed the next entry from EA-owned Swedish developer DICE would be a return to form. I was wrong.

    The multiplayer military FPS market is dominated by two forces: Activision's Call of Duty (COD) series and EA's Battlefield. Fans of each franchise are loyal to the point of zealotry with little crossover between player bases. Here's where I stand: COD jumped the shark with Modern Warfare 2 in 2009. It's flip-flopped from WW2 to present-day combat and back again, tried sci-fi, and even the Battle Royale trend with the free-to-play Call of Duty: Warzone (2020), which has been thoroughly ruined by hackers and developer inaction.

    Continue reading
  • American diplomats' iPhones reportedly compromised by NSO Group intrusion software

    Reuters claims nine State Department employees outside the US had their devices hacked

    The Apple iPhones of at least nine US State Department officials were compromised by an unidentified entity using NSO Group's Pegasus spyware, according to a report published Friday by Reuters.

    NSO Group in an email to The Register said it has blocked an unnamed customers' access to its system upon receiving an inquiry about the incident but has yet to confirm whether its software was involved.

    "Once the inquiry was received, and before any investigation under our compliance policy, we have decided to immediately terminate relevant customers’ access to the system, due to the severity of the allegations," an NSO spokesperson told The Register in an email. "To this point, we haven’t received any information nor the phone numbers, nor any indication that NSO’s tools were used in this case."

    Continue reading

Biting the hand that feeds IT © 1998–2021