Off-Prem

SaaS

AWS adopts home-brewed KVM as new hypervisor

Out with Xen, in with 'core KVM technology' for new C5 instances and future VMs too


AWS has revealed it has created a new hypervisor based on KVM, not the Xen hypervisor on which it has relied for years.

The new hypervisor was unveiled as a virtual footnote in news of new EC2 instance type called the "C5" powered by Intel's Skylake Xeons. AWS's FAQ about the new instances notes "C5 instances use a new EC2 hypervisor that is based on core KVM technology."

That's explosive news, because AWS has long-championed the Xen hypervisor. The Xen Project has drawn strength from the fact the mightiest public cloud uses its open-source wares. Citrix makes much of its Xen Server running a close cousin of AWS's hypervisor.

More interesting still is AWS's news that “going forward, we’ll use this hypervisor to power other instance types.” The internet giant's post teases us with plans to “share additional technical details in a set of AWS re:Invent sessions.”

Which sounds a lot like AWS is giving Xen the flick.

The new hypervisor goes a long way towards explaining why AWS is the last of the big clouds to run Intel's new Skylake Xeon CPUs, because AWS has also revealed the new C5 instances run on what it describes as “a custom processor, optimized for EC2.”

Intel and AWS both say this is a custom 3.0 GHz Xeon Platinum 8000-series processor. Chipzilla has offered a few press-release-grade details of the CPU, saying it worked with AWS on "optimized AI/deep learning engines with the latest version of the Intel Math Kernel Library" and that "MXNet and other deep learning frameworks are highly optimized to run on Amazon EC2 C5 instances."

Intel's done custom Xeons before, offering them to Oracle, among others. AWS buys CPUs by the boatload so it is no surprise Intel's done so again.

The move to KVM is more surprising, but AWS does whatever is needed to tune its cloud for optimal performance. If that means building a hypervisor and making sure it hooks into custom Xeons, so be it.

Whatever it reveals in three weeks, AWS is now saying the C5 instances and their new hypervisor are all about faster throughput, as the new VMs beat its previous best for network and bandwidth connecting to the cloudy concern's elastic block store (EBS).

Here's what AWS has to say in the FAQ:

The new hypervisor for Amazon EC2, introduced with the launch of C5 instances, is a component that primarily provides CPU and memory isolation for C5 instances. VPC networking and EBS storage resources are implemented by dedicated hardware components that are part of all current generation EC2 instance families.

It is built on core Linux Kernel-based Virtual Machine (KVM) technology, but does not include general purpose operating system components.

In other words, network and storage is done elsewhere, rather than in the hypervisor, which concentrates on carving up CPU and memory resources:

The new EC2 hypervisor provides consistent performance and increased compute and memory resources for EC2 virtualized instances by removing host system software components ... This hardware enables the new hypervisor to be very small and uninvolved in data processing tasks for networking and storage.

Eventually all new instance types will use the new EC2 hypervisor, but in the near term, some new instance types will use Xen depending on the requirements of the platform.

Instances running on the new EC2 hypervisor support a maximum of 27 additional PCI devices for EBS volumes and VPC ENIs. Each EBS volume or VPC ENI uses a PCI device. For example, if you attach 3 additional network interfaces to an instance that uses the new EC2 hypervisor, you can attach up to 24 EBS volumes to that instance.

All the public facing APIs for interacting with EC2 instances that run using the new EC2 hypervisor will remain the same. For example, the “hypervisor” field of the DescribeInstances response, which will continue to report “xen” for all EC2 instances, even those running under the new hypervisor. This field may be removed in a future revision of the EC2 API.

You should check the FAQ for the full impact of AWS moving to its new hypervisor. Here's the stats-fest for the new KVM-based C5 instances:

Instance Name vCPUs RAM in GiB EBS* Bandwidth Network Bandwidth
c5.large 2 4 Up to 2.25 Gbps Up to 10 Gbps
c5.xlarge 4 8 Up to 2.25 Gbps Up to 10 Gbps
c5.2xlarge 8 16 Up to 2.25 Gbps Up to 10 Gbps
c5.4xlarge 16 32 2.25 Gbps Up to 10 Gbps
c5.9xlarge 36 72 4.5 Gbps 10 Gbps
c5.18xlarge 72 144 9 Gbps 25 Gbps

Each vCPU is a single thread on the physical CPU Amazon's acquired.

C5 instances are available now in AWS's US East, US West (Oregon), and EU regions, as on-demand or spot servers. The biz promises additional regions will offer them soon. ®

Send us news
10 Comments

AWS plays with Fire TV Cube, turns it into a thin client for cloudy desktops

$195 a pop, delivered, pre-provisioned ready to stream desktops or apps

Sumo Logic wrestles with security breach, pins down customer data

Compromised AWS account led to fears that user info could have been exposed to cybercriminals

AWS staffer shows off the workplace that used to be a prison

Panopticon design gains new meaning for the all powerful cloud platform

Amazon's Project Kuiper satellites nail online orders from orbit

Late-stage capitalism ... in spaaace

Desperately seeking GPUs? AWS will let you reserve instances in advance – no refunds

Better make sure you really need it on the day. Paid upfront and no modifications to orders allowed

Cryptojackers steal AWS credentials from GitHub in 5 minutes

Researchers just scratching surface of their understanding of campaign dating back to 2020

AWS says it wants in on the European sovereign cloud game

Appealing to growing crowd that wants data outside US jurisdiction

AWS CEO talks up AI to focus minds of Wall Street types

Q3 sales below forecasts, profits up, and conversation centers on LLMs and GenAI

Imagine a world without egress fees or cloud software license disparities

UK regulator lists series of potential remedies for anti-competitive practices early on in probe

UK IaaS market: Deeper probe by competition regulator lands soon

Ofcom to refer findings to CMA – which insiders say will home in on egress fees, interoperability and licensing

HTTP/2 'Rapid Reset' zero-day exploited in biggest DDoS deluge seen yet

Botnet storm drowned last record with 398 million requests per second

AWS stirs the MadPot – busting bot baddies and eastern espionage

Security exec Mark Ryland spills the tea on hush-hush threat intel tool