Nvidia unveils $59 Nvidia Jetson Nano 2GB mini AI board, machine learning that slashes vid-chat data by 90%, and new super for Britain
We sat through the full day so you didn't have to
GTC 2020 Nvidia on Monday launched its first ever virtual GPU Technology Conference, taking place online over the course of this week across multiple timezones.
The coronavirus pandemic forced the graphics processor giant to cancel its in-person tech event normally held in Silicon Valley. Although the location of the conference this year is, well, wherever you're watching it, its focus on Nvidia-powered AI and machine learning is still the same.
CEO Jensen Huang said, “AI requires a whole reinvention of computing – full-stack rethinking – from chips, to systems, algorithms, tools, the ecosystem,” during the keynote.
If you missed previous announcements streamed from his kitchen, Huang introduced Nvidia’s most powerful Ampere architecture and a new range of GPUs for servers and supercomputers back in May, and a set of real-time ray-tracing cards for gamers last month. Now, for the virtual GTC, Huang on Monday introduced two less powerful Ampere-based GPUs for the cloud systems and workstations.
On top of that, there are several other bits of news that we’ve rounded up here just in case you’ve missed it.
New Jetson Nano mini AI computer
The Jetson Nano 2GB Developer Kit, announced this week, is a single-board computer – like the Raspberry Pi – though geared towards machine learning rather than general computing. If you like the idea of simple AI projects running on a dedicated board, such as building your own mini self-driving car or an object-recognition system for your home, this one might be for you.
Nvidia touts another two spanking new GPUs to join its list of Ampere architecture based goodiesREAD MORE
It runs Nvidia CUDA code and provides a Linux-based environment. At only $59 a pop, it’s pretty cheap and a nifty bit of hardware if you’re just dipping your toes in deep learning. As its name suggests, it has 2GB of RAM, plus four Arm Cortex-A57 CPU cores clocked at 1.43GHz and a 128-core Nvidia Maxwell GPU. There are other bits and pieces like gigabit Ethernet, HDMI output, a microSD slot for storage, USB interfaces, GPIO and UART pins, Wi-Fi depending on you region, and more.
“While today’s students and engineers are programming computers, in the near future they’ll be interacting with, and imparting AI to, robots,” said Deepu Talla, vice president and general manager of Edge Computing at Nvidia. “The new Jetson Nano is the ultimate starter AI computer that allows hands-on learning and experimentation at an incredibly affordable price.”
The Jetson Nano 2GB Developer Kit will be available from the end of the month.
AI video conferencing
Nvidia is well-known for its research in generative adversarial networks (GANs), and now it has applied some of that know-how to improve video calls online.
Its engineers have developed a software platform known as Nvidia Maxine aimed at teleconferencing companies. The idea is that Nvidia provides video-chat app makers a GAN model that’s capable of cutting the bandwidth of a video call by as much as 90 per cent.
The model does this by automatically constructing and animating your face at the other end of the call, which saves you having to send all those pixels – even when compressed – each frame, reducing the overall data transferred. Here's the blurb:
The Nvidia Maxine platform dramatically reduces how much bandwidth is required for video calls. Instead of streaming the entire screen of pixels, the AI software analyzes the key facial points of each person on a call and then intelligently re-animates the face in the video on the other side. This makes it possible to stream video with far less data flowing back and forth across the internet.
Using this new AI-based video compression technology running on Nvidia GPUs, developers can reduce video bandwidth consumption down to one-tenth of the requirements of the H.264 streaming video compression standard. This cuts costs for providers and delivers a smoother video conferencing experience for end users, who can enjoy more AI-powered services while streaming less data on their computers, tablets and phones.
And here's the tech in action, in this Nvidia-made demo:
Developers or startups interested in implementing such software into their own products or services can apply to early access to the platform now.
AI autocomplete but for grammar on Microsoft Word
Nvidia has paired up with Microsoft to roll out an AI-based grammar editor for people typing in Microsoft Word. The software analyses your prose, and makes suggestions to improve the grammar of a particular sentence. It can be turned on and off via the Editor tab in Word. Nvidia is the brains behind the system, which uses Nv's Triton Inference Server and ONNX Runtime, a set of tools that speeds up models running on its GPUs.
It has helped Microsoft handle up to 450 grammar queries per second using a single V100 GPU in real time, we're told.
Nvidia DGX SuperPODs are now shipping
The largest AI supercomputers Nvidia offers – its DGX SuperPODs – have now been delivered to some of its early customers, including Naver, Korea’s largest search engine company; Linköping University in Sweden; and to the Indian government’s Centre for Development of Advanced Computing.
DGX SuperPODs can be made from 20 to 140 DGX A100 systems, each one containing eight A100 GPUs. Considering a single DGX A100 sets you back $199,000, building a SuperPOD is not for the faint-hearted. The most powerful SuperPOD configuration can reach up to 700 petaflops, it is claimed.
The next SuperPOD project is the Cambridge-1 behemoth, planned to be Britain's most powerful publicly known supercomuter and will be focused on healthcare. It will be based on 80 DGX A100 systems connected by Nvidia’s Mellanox InfiniBand networking, capable of delivering more than 400 petaflops of AI compute performance, and eight petaflops of Linpack benchmark performance. If switched on right now, it would fit in at number 29 in the world's top 500 most powerful publicly known supers, Nvidia said.
Researchers from GSK and AstraZeneca as well as folks from Guy’s and St Thomas’s NHS Foundation Trust, King’s College London and Oxford Nanopore Technologies plan to use the system to design new drugs for public use. Nvidia said it will pour £40m ($51.7m) into Cambridge-1. ®