Amazon reveals 'Nitro'... Custom ASICs and boxes that do grunt work so EC2 hosts can just run instances

Also bare metal EC2, that KVM-based hv, and entry to the security biz

AWS re:Invent Amazon Web Services has revealed that it spent four years working on a new architecture that offloads networking, storage and management tasks from EC2 host servers to dedicated hardware.

Speaking at the company's re:Invent conference, the company's veep for global infrastructure Peter Desantis, said the company first put the idea into production with 2013's C3 instances. The reason for doing so, he said, was a desire to have EC2 instances offer as close as possible to a bare metal experience and performance. Achieving that was made difficult by the fact that AWS' first architecture ran customers' instances, networking services, storage services and management services on the same host.

Offloading networking to the “Nitro System”, as the new architecture is called, quickly reduced latency. C4 instances, launched a year later, offloaded storage services too thanks to ASICs created by a company called Annapurna Labs.

Climbing Annapurna

But Desantis said AWS then hit a wall: its early Nitro efforts used commercial-off-the-shelf silicon, which left the company feeling it was paying for generic functions and also paying for features it did not need, which drove up the overall cost of its hardware.

AWS therefore decided it made sense to invest in custom silicon, so acquired Annapurna to do so.

Since 2015 the two have worked on custom ASICs that debuted within the third-generation Nitro box. This underpins the new C5 instance type that AWS originally said ran on a new KVM-based hypervisor.

The Register inquired about that hypervisor as soon as we read AWS' early November 2017 posts which proclaimed it would power all future instance types. Desantis today explained that the hypervisor – dubbed the “Nitro Hypervisor” - is based on the subset of KVM found in the Linux kernel and is optimised for the Nitro System. The hypervisor is also optimised to run in the Nitro architecture, and Desantis said it provides better isolation for workloads and therefore better security.

As of the C5 and third-generation Nitro system, AWS hosts now offload networking, storage and general management chores. According to Desantis, doing so means “nearly 100 per cent of host resources can be allocated to customer instances. We can do instances that are nearly indistinguishable from EC2 hosts, which now achieve performance that might even be better than bare metal.”

Take that, Oracle

Desantis said AWS has commenced tests of a bare metal EC2 service that will run either non-virtualized applications or the hypervisor of your choice. The veep pitched this option as suitable for speed freaks or to run applications with “customer-hostile licensing” that are otherwise hard to run in the cloud.

It's hard not to think that's a swipe at Oracle, which in January 207 effectively doubled licence fees to run its wares in AWS by counting a vCPU in AWS as a full core.

Bare metal EC2 will first be offered on i3 instances, but Desanti said other instance types will offer the option in the future.

“This story does not end tonight,” Desantis added. He then produced an ASIC from his pocket and declared it was among the first sample from a next-generation ASIC for future EC2 instances.

Desantis also announced a new “hyperplane” load balancer that has powered AWS' operations and helps it to scale and enhance reliability, and has now become part of the “Network Load Balancer” and “AWS PrivateLink", new AWS products that balance loads and allow private networks within AWS respectively. The use case for the latter is to help AWS partners provide in-cloud services to AWS users.

Security? They've productised it!

The company also revealed a new security service that productises its own threat intelligence and remediation services. Dubbed "GuardDuty", the service was promised to have no overhead, to identify anomalies in users AWS rigs, and to monitor usage of the cloud to prevent things like a user with credentials spinning up unusual instance types in regions you never use.

The company said its own version of the new tool means it has just one security worker on duty at any given time, on six-hour shifts that follow the sun. If things go pear-shaped, plenty of others are on-call. ®

Similar topics

Narrower topics

Other stories you might like

  • Stolen university credentials up for sale by Russian crooks, FBI warns
    Forget dark-web souks, thousands of these are already being traded on public bazaars

    Russian crooks are selling network credentials and virtual private network access for a "multitude" of US universities and colleges on criminal marketplaces, according to the FBI.

    According to a warning issued on Thursday, these stolen credentials sell for thousands of dollars on both dark web and public internet forums, and could lead to subsequent cyberattacks against individual employees or the schools themselves.

    "The exposure of usernames and passwords can lead to brute force credential stuffing computer network attacks, whereby attackers attempt logins across various internet sites or exploit them for subsequent cyber attacks as criminal actors take advantage of users recycling the same credentials across multiple accounts, internet sites, and services," the Feds' alert [PDF] said.

    Continue reading
  • Big Tech loves talking up privacy – while trying to kill privacy legislation
    Study claims Amazon, Apple, Google, Meta, Microsoft work to derail data rules

    Amazon, Apple, Google, Meta, and Microsoft often support privacy in public statements, but behind the scenes they've been working through some common organizations to weaken or kill privacy legislation in US states.

    That's according to a report this week from news non-profit The Markup, which said the corporations hire lobbyists from the same few groups and law firms to defang or drown state privacy bills.

    The report examined 31 states when state legislatures were considering privacy legislation and identified 445 lobbyists and lobbying firms working on behalf of Amazon, Apple, Google, Meta, and Microsoft, along with industry groups like TechNet and the State Privacy and Security Coalition.

    Continue reading
  • SEC probes Musk for not properly disclosing Twitter stake
    Meanwhile, social network's board rejects resignation of one its directors

    America's financial watchdog is investigating whether Elon Musk adequately disclosed his purchase of Twitter shares last month, just as his bid to take over the social media company hangs in the balance. 

    A letter [PDF] from the SEC addressed to the tech billionaire said he "[did] not appear" to have filed the proper form detailing his 9.2 percent stake in Twitter "required 10 days from the date of acquisition," and asked him to provide more information. Musk's shares made him one of Twitter's largest shareholders. The letter is dated April 4, and was shared this week by the regulator.

    Musk quickly moved to try and buy the whole company outright in a deal initially worth over $44 billion. Musk sold a chunk of his shares in Tesla worth $8.4 billion and bagged another $7.14 billion from investors to help finance the $21 billion he promised to put forward for the deal. The remaining $25.5 billion bill was secured via debt financing by Morgan Stanley, Bank of America, Barclays, and others. But the takeover is not going smoothly.

    Continue reading

Biting the hand that feeds IT © 1998–2022