CAST AI puts out report on extent of enterprises cloud resource overspend

Tool relies on platform getting everything right in real time, cautions analyst


A report from cloud startup CAST AI claims companies running cloud-native applications typically spend three times as much as they need on resources because of over-provisioning.

The startup, which hopes to convince users to consider its platform as a way to control the problem, said the overspending sometimes occurs due to an over-cautious approach from the customer, but is often because of the difficulty in knowing exactly how much resource is needed.

A report by CAST lifts data it generated while running infrastructure utilization reports for more than 400 organizations using the three major cloud providers, thanks to its AI-based platform that compares the resources that an application is using with those that it actually requires.

It found that, on average, organizations are spending three times more than they need to. The majority of this can be attributed to CPUs and memory being provisioned but not used, often through users selecting virtual machine instances that are not the optimal match for the requirements of the workload.

According to CAST AI co-founder and chief product officer Laurent Gil, part of the problem is that users often hedge their bets and err on the side of caution against unexpected spikes in demand when provisioning resources.

"The number one job of DevOps is that the application must work all the time 24x7, so what do they do, they look at the worst case scenario over a week, and they tend to provision resources based on that worst case," he said.

Gil cited an example of a customer using M5 instances on AWS for an application, in which the CAST AI engine was able to recommend savings by another instance called C6a that costs less.

"The biggest difference between these two is that C6a is AMD, which is slightly less expensive on Amazon. And C means it's compute optimized so it has less memory per core, and the application didn't need all that memory," Gil explained.

The key, however, is that this change meant lower cost without impacting application performance.

Provisioning is still a significant challenge for organizations of all sizes, according to CAST AI, as the major cloud providers have a bewildering array of instance types to choose from, making it a difficult and time-consuming task to pick the right instance for the workload, not to mention ensuring that the cloud-hosted infrastructure is continuously right-sized. The issue is that DevOps professionals would need to continually monitor cloud resources to achieve this.

If you're a DevOps, your number one priority is to make sure the app works. If it doesn't have enough resources you are in trouble, so I think this is a tendency of over provisioning... They're not evil, right?

The company is hoping customers will buy its platform to solve this, of course. The service is free to try out so users can see how much they are over-provisioning on resources, but if organizations sign up as a paying customer, they can allow the platform to take control of their cloud resource provisioning and let it automate the matching of workloads to the optimum machine instances for the job.

CAST AI works across the three major cloud platforms – AWS, Google Cloud, and Microsoft Azure – and is focused on cloud-native workloads running in containers and using Kubernetes. The firm claims that customers can see savings of 50-75 percent on cloud resources for running their applications.

The startup cited one customer, a French e-commerce startup called La Fourche, which it said was using fifteen t3.2xlarge and two t3.xlarge instances on AWS at a cost of $4,349.95 at the time of analysis. Its platform moved the workloads to five c5a.2xlarge instances instead, which resulted in a cost of $1,310.40, a saving of nearly 70 percent.

According to Gil, other savings can be made from using spot instances, which make use of spare resources that are available at much less cost than the standard on-demand price for the same machine instance.

"Cloud providers have to over provision resources because they have to be elastic. So some machines are not being used all of the time, and what they don't sell at a given time they typically discount by 60-70 percent," Gil said.

The drawback to this is that if AWS needs the machine back, they give you a two-minute warning before reclaiming it, which is likely to deter many from using these highly discounted instances in case they disappear at short notice.

"For us it's a benefit, because we can automatically detect that a spot instance is about to go down, and immediately replace it by another one. So there is never any outage in our case, because we replace the machine when we see it's going down, and if there are no more spot instances, we will select on demand," Gil told us.

The CAST AI engine can identify which of a customer's containers are "spot friendly," according to Gil, such that if a container is running a DNS server, for example, that would not be allocated to a spot instance. Customers can toggle on or off the option to use spot instances.

The co-founder said the statistics CAST AI has gathered on over-provisioning do not differ significantly across the three major cloud providers, indicating that the situation is not due to any particular cloud making it difficult for customers to manage costs.

"I think it's because of human behavior. Like, if you're a DevOps, your number one priority is to make sure the app works. If it doesn't have enough resources you are in trouble, so I think this is a tendency of over provisioning," he said. "They're not evil, right? They're not making you pay more for their service; it's just very hard for humans to consume something when they have so many choices."

Independent analyst Clive Longbottom told us that a monitoring and automated management system such as CAST AI makes a great deal of sense. However, he cautioned that customers are relying on the platform getting everything right in real time.

"Overall, my take would be go for it: carry out the financial calculations to make sure that the costs saved are greater than the cost of subscription to CAST AI, but make sure that you have a Plan B in place should CAST suddenly disappear one day." ®


Other stories you might like

  • Drone ship carrying yet more drones launches in China
    Zhuhai Cloud will carry 50 flying and diving machines it can control with minimal human assistance

    Chinese academics have christened an ocean research vessel that has a twist: it will sail the seas with a complement of aerial and ocean-going drones and no human crew.

    The Zhu Hai Yun, or Zhuhai Cloud, launched in Guangzhou after a year of construction. The 290-foot-long mothership can hit a top speed of 18 knots (about 20 miles per hour) and will carry 50 flying, surface, and submersible drones that launch and self-recover autonomously. 

    According to this blurb from the shipbuilder behind its construction, the Cloud will also be equipped with a variety of additional observational instruments "which can be deployed in batches in the target sea area, and carry out task-oriented adaptive networking to achieve three-dimensional view of specific targets." Most of the ship is an open deck where flying drones can land and be stored. The ship is also equipped with launch and recovery equipment for its aquatic craft. 

    Continue reading
  • Experts: AI should be recognized as inventors in patent law
    Plus: Police release deepfake of murdered teen in cold case, and more

    In-brief Governments around the world should pass intellectual property laws that grant rights to AI systems, two academics at the University of New South Wales in Australia argued.

    Alexandra George, and Toby Walsh, professors of law and AI, respectively, believe failing to recognize machines as inventors could have long-lasting impacts on economies and societies. 

    "If courts and governments decide that AI-made inventions cannot be patented, the implications could be huge," they wrote in a comment article published in Nature. "Funders and businesses would be less incentivized to pursue useful research using AI inventors when a return on their investment could be limited. Society could miss out on the development of worthwhile and life-saving inventions."

    Continue reading
  • Declassified and released: More secret files on US govt's emergency doomsday powers
    Nuke incoming? Quick break out the plans for rationing, censorship, property seizures, and more

    More papers describing the orders and messages the US President can issue in the event of apocalyptic crises, such as a devastating nuclear attack, have been declassified and released for all to see.

    These government files are part of a larger collection of records that discuss the nature, reach, and use of secret Presidential Emergency Action Documents: these are executive orders, announcements, and statements to Congress that are all ready to sign and send out as soon as a doomsday scenario occurs. PEADs are supposed to give America's commander-in-chief immediate extraordinary powers to overcome extraordinary events.

    PEADs have never been declassified or revealed before. They remain hush-hush, and their exact details are not publicly known.

    Continue reading
  • Stolen university credentials up for sale by Russian crooks, FBI warns
    Forget dark-web souks, thousands of these are already being traded on public bazaars

    Russian crooks are selling network credentials and virtual private network access for a "multitude" of US universities and colleges on criminal marketplaces, according to the FBI.

    According to a warning issued on Thursday, these stolen credentials sell for thousands of dollars on both dark web and public internet forums, and could lead to subsequent cyberattacks against individual employees or the schools themselves.

    "The exposure of usernames and passwords can lead to brute force credential stuffing computer network attacks, whereby attackers attempt logins across various internet sites or exploit them for subsequent cyber attacks as criminal actors take advantage of users recycling the same credentials across multiple accounts, internet sites, and services," the Feds' alert [PDF] said.

    Continue reading
  • Big Tech loves talking up privacy – while trying to kill privacy legislation
    Study claims Amazon, Apple, Google, Meta, Microsoft work to derail data rules

    Amazon, Apple, Google, Meta, and Microsoft often support privacy in public statements, but behind the scenes they've been working through some common organizations to weaken or kill privacy legislation in US states.

    That's according to a report this week from news non-profit The Markup, which said the corporations hire lobbyists from the same few groups and law firms to defang or drown state privacy bills.

    The report examined 31 states when state legislatures were considering privacy legislation and identified 445 lobbyists and lobbying firms working on behalf of Amazon, Apple, Google, Meta, and Microsoft, along with industry groups like TechNet and the State Privacy and Security Coalition.

    Continue reading
  • SEC probes Musk for not properly disclosing Twitter stake
    Meanwhile, social network's board rejects resignation of one its directors

    America's financial watchdog is investigating whether Elon Musk adequately disclosed his purchase of Twitter shares last month, just as his bid to take over the social media company hangs in the balance. 

    A letter [PDF] from the SEC addressed to the tech billionaire said he "[did] not appear" to have filed the proper form detailing his 9.2 percent stake in Twitter "required 10 days from the date of acquisition," and asked him to provide more information. Musk's shares made him one of Twitter's largest shareholders. The letter is dated April 4, and was shared this week by the regulator.

    Musk quickly moved to try and buy the whole company outright in a deal initially worth over $44 billion. Musk sold a chunk of his shares in Tesla worth $8.4 billion and bagged another $7.14 billion from investors to help finance the $21 billion he promised to put forward for the deal. The remaining $25.5 billion bill was secured via debt financing by Morgan Stanley, Bank of America, Barclays, and others. But the takeover is not going smoothly.

    Continue reading

Biting the hand that feeds IT © 1998–2022