OpenStack Pike release bites hard on microservices and scale

Project tries to move on to lifecycle management rather than initial setup


With the release of OpenStack Pike, the OpenStack Foundation has focussed on making the foundational software-defined networking environment look more digestible and better-suited to the world of microservices that's grown up around it.

Speaking to The Register about the release, OpenStack Foundation executive director Jonathan Bryce says users have grown accustomed to thinking of OpenStack as a single creature.

If that were true once, it is no longer: OpenStack is “made up of a number of different services providing access to compute, storage, networking, bare metal, data centre functions”, he explained.

In parallel with OpenStack's development, Bryce added, technologies like Kubernetes, Docker, OpenFlow and TensorFlow have emerged and matured, and Bryce said users want to tie-in their OpenStack environments with those kinds of technologies.

Hence the “composability” that the foundation has given prominence in the Pike release: it's a way to make it easier to use those services.

The Ironic bare metal service is easier to integrate with Cinder block storage and Neutron networking. Cinder can now be broken out as a standalone storage service for virtual machines, bare metal systems, or Docker/Kubernetes containers.

Ironic now plugs directly into Neutron networking, which the foundation says is important for multi-tenant cloud offerings.

Cinder block storage is enhanced with a “revert to snapshot” feature for better data recovery; and storage volumes can be expanded without admins having to shut down VMs.

The second “big theme” Bryce said influenced Pike reflects a more mature attitude to deployment. “The focus has shifted from 'how do you install OpenStack to build your initial cloud?' to 'how do you run your cloud over its lifetime?'”

Users are now more concerned with lifecycle issues – “how you scale it out, upgrade it, manage failures – things that happen in the lifecycle of a cloud”.

Treating OpenStack as a collection of microservices, Bryce said, lets users create their cloud more efficiently; and when it comes time to upgrade, the microservice model lets the admin run rolling updates with A/B testing.

The two key tools for wrangling OpenStack containers are Kolla and Helm.

Kolla became more popular among developers contributing to the Pike release, with 19 per cent more contributors compared to the OpenStack Octata release. Helm (a package management utility for Kubernetes) now ranks as a “complete lifecycle technology for OpenStack services”, Bryce said.

Goodbye, Python 2

The OpenStack development community also has its eye on the coming deprecation of the Python 2.x language series. While that's still some way off (it's due in 2020), there's a lot of code to replace.

Bryce praised the ability of OpenStack's thousands of developers to get Pike ready for Python 3.5, telling El Reg “users know they're not going to have a massive technical debt, running processes that depend on a deprecated language."

“That's most important to users in regulated industries, they have to prove what they're doing is secure, manageable, and using the proper standards.”

Other high points of the Pike release include enhancements to Nova Cells v2; the rollout of etcd v3 as OpenStack's distributed lock management solution; and its Swift object storage now supports globally distributed erasure codes, to allow individual regions to function if a multi-region network is down, and to ensure failures in one region can recover using a remote region.

Bryce noted that Cells v2 is an ongoing work-in-progress, because big clouds aren't static. The continuing challenge for OpenStack's largest users are how to scale clouds to very large sizes – “hundreds or thousands of physical servers”.

“The questions change with every release cycle”, he explained.

“Cells v2 is a fundamental re-architecture of how you scale a virtualization environment.

“You can never build a single, massive virtualized environment that will be as big as everybody needs, so you need to scale it in reasonable chunks.”

And not everyone looks at those chunks the same way – for one network it might be about how many IP addresses are in the environment, for another it's about physical machines, for another it's the number of VMs.

The idea in Cells v2, Bryce said, is that the user can segment their virtual environments, and each segment is aware of the others so they can “talk to each other intelligently”.

“That's been in progress for about a year and a half, and there's probably … years to come.”

Pike's focus, Bryce said, is to expose functionality for horizontal scaling: “Every OpenStack Nova instance starts from the beginning as a Nova Cell, and you have the ability to add additional Nova cells into that environment, scaling horizontally and balancing across it”.

That's been a huge effort in the OpenStack community, he said. ®


Other stories you might like

  • How business makes streaming faster and cheaper with CDN and HESP support

    Ensure a high video streaming transmission rate

    Paid Post Here is everything about how the HESP integration helps CDN and the streaming platform by G-Core Labs ensure a high video streaming transmission rate for e-sports and gaming, efficient scalability for e-learning and telemedicine and high quality and minimum latencies for online streams, media and TV broadcasters.

    HESP (High Efficiency Stream Protocol) is a brand new adaptive video streaming protocol. It allows delivery of content with latencies of up to 2 seconds without compromising video quality and broadcasting stability. Unlike comparable solutions, this protocol requires less bandwidth for streaming, which allows businesses to save a lot of money on delivery of content to a large audience.

    Since HESP is based on HTTP, it is suitable for video transmission over CDNs. G-Core Labs was among the world’s first companies to have embedded this protocol in its CDN. With 120 points of presence across 5 continents and over 6,000 peer-to-peer partners, this allows a service provider to deliver videos to millions of viewers, to any devices, anywhere in the world without compromising even 8K video quality. And all this comes at a minimum streaming cost.

    Continue reading
  • Cisco deprecates Microsoft management integrations for UCS servers

    Working on Azure integration – but not there yet

    Cisco has deprecated support for some third-party management integrations for its UCS servers, and emerged unable to play nice with Microsoft's most recent offerings.

    Late last week the server contender slipped out an end-of-life notice [PDF] for integrations with Microsoft System Center's Configuration Manager, Operations Manager, and Virtual Machine Manager. Support for plugins to VMware vCenter Orchestrator and vRealize Orchestrator have also been taken out behind an empty rack with a shotgun.

    The Register inquired about the deprecations, and has good news and bad news.

    Continue reading
  • Protonmail celebrates Swiss court victory exempting it from telco data retention laws

    Doesn't stop local courts' surveillance orders, though

    Encrypted email provider Protonmail has hailed a recent Swiss legal ruling as a "victory for privacy," after winning a lawsuit that sees it exempted from data retention laws in the mountainous realm.

    Referring to a previous ruling that exempted instant messaging services from data capture and storage laws, the Protonmail team said this week: "Together, these two rulings are a victory for privacy in Switzerland as many Swiss companies are now exempted from handing over certain user information in response to Swiss legal orders."

    Switzerland's Federal Administrative Court ruled on October 22 that email providers in Switzerland are not considered telecommunications providers under Swiss law, thereby removing them from the scope of data retention requirements imposed on telcos.

    Continue reading
  • Japan picks AWS and Google for first gov cloud push

    Local players passed over for Digital Agency’s first project

    Japan's Digital Agency has picked Amazon Web Services and Google Cloud for its first big reform push.

    The Agency started operations in September 2021, years after efforts like the UK's Government Digital Service (GDS) or Australia's Digital Transformation Agency (DTA). The body was a signature reform initiated by Prime Minister Yoshihide Suga, who spent his year-long stint in the top job trying to curb Japan's reliance on paper documents, manual processes, and faxes. Japan's many government agencies also operated their websites independently of each other, most with their own design and interface.

    The new Agency therefore has a remit to "cut across all ministries" and "provide services that are driven not toward ministries, agency, laws, or systems, but toward users and to improve user-experience".

    Continue reading
  • Singaporean minister touts internet 'kill switch' that finds kids reading net nasties and cuts 'em off ASAP

    Fancies a real-time crowdsourced content rating scheme too

    A Minister in the Singapore government has suggested the creation of an internet kill switch that would prevent minors from reading questionable material online – perhaps using ratings of content created in real time by crowdsourced contributors.

    "The post-COVID world will bring new challenges globally, including to us in the security arena," said Minister for Defence Dr Ng Eng Hen at a Tuesday ceremony to award the city-state's 2021 Defense Technology Prize.

    "For operations, the SAF (Singapore Armed Force) has to expand its capabilities in the digital domain. Whether for administrative or operational purposes, I think that we will need to leverage technology to the maximum," he declared.

    Continue reading
  • China Telecom booted out of USA as Feds worry it could disrupt or spy on local networks

    FCC urges more action against Huawei and DJI, too

    The US Federal Communications Commission (FCC) has terminated China Telecom's authority to provide communications services in the USA.

    In its announcement of the termination, the government agency explained the decision is necessary because the national security environment has changed in the years since 2002. That was when China Telecom was first allowed to operate in the USA.

    The FCC now believes – partly based on classified advice from national security agencies – that China Telecom can "access, store, disrupt, and/or misroute US communications, which in turn allow them to engage in espionage and other harmful activities against the United States." And because China Telecom is state-controlled, China's government can compel the carrier to act as it sees fit, without judicial review or oversight.

    Continue reading
  • Qualcomm gets news of modest Snapdragons out of the way before next month's big chip launch

    A little more oomph coming for cheaper smartphones

    Budget smartphones these days do OK with 5G though lack performance in other areas, and so Qualcomm has promised some system-on-chips to give these modest devices some more oomph.

    The processors, announced on Tuesday for entry and mid-range 5G smartphones, also clears the deck for big chip announcements Qualcomm is expected to make at its Snapdragon Tech Summit starting at the end of next month.

    The 6nm Snapdragon 695 5G, unveiled this week, is a successor to the 8nm 690 5G used in the OnePlus Nord N10 5G, which is priced under $300, and various other handhelds.

    Continue reading
  • Raising the price of in-demand processors really helps the bottom line, says AMD

    You don't double operating income by giving silicon away

    AMD, which is raking in cash from its CPUs and GPUs, said higher price tags on its components helped bolster its financial results for the third quarter of this year.

    Its CPU and GPU average selling prices were higher compared to the previous quarter and year, which helped grow revenue. This increase was "driven by a richer mix of Ryzen processor sales," and "by high-end Radeon graphics product sales and AMD Instinct data center GPU sales," the business stated.

    "AMD had another record quarter as revenue grew 54 per cent and operating income doubled year-over-year," said AMD president and CEO Dr Lisa Su.

    Continue reading

Biting the hand that feeds IT © 1998–2021