Fool me OnePlus, shame on me: Chinese phone firm fingered for fiddling with performance figures – again

Company caught throttling everyday apps but leaving benchmarks, selected games alone


Chinese smartphone maker OnePlus has had the shine taken off its latest launches with tests that indicate it is once again trying to fiddle the figures on benchmark results, throttling real-world performance considerably compared to synthetic workloads.

OnePlus hit the market in 2014 with the launch of the OnePlus One, under the tagline "Never Settle". Designed to be a flagship phone priced as a mid-range device, the handset was the first to launch with third-party Android fork CyanogenMod as standard.

Sales have been strong, no thanks to supply issues and an initial but since-abandoned invite-only purchase model, and the success gave the company cause to abandon CyanogenMod in favour of building its own Android fork, dubbed OxygenOS.

Its second handset had a hyped launch but proved disappointing – though that didn't stop the company releasing device after device after device after device.

OnePlus is now up to the OnePlus 9, and its more expensive OnePlus 9 Pro stablemate, but members of the company's faithful congregation don't seem to be getting what they were promised: the company has been fiddling benchmark results, making the handsets seem more powerful than they are in daily use.

First spotted by AnandTech, the problem lies in how the handsets balance performance and power draw. As with most mobile devices, the OnePlus 9 family adjust the voltage and clock speed of their processors in order to maximise battery life. When you're not doing much, the processor is down-clocked to save power; fire up a game or other demanding application and the processor roars into life.

At least, that's how it's supposed to work. What OnePlus has allegedly been doing, it transpires, is hard-coding a variety of applications into its throttling logic – having them run at a lower-than-usual performance level while excluding common benchmarking apps in order to provide a false but impressive-sounding readout of the handsets' day-to-day speeds.

Testing has found that the majority of apps have their performance limited on the handsets, including web browsers – with the top-end OnePlus 9 Pro pushing around a quarter of the performance of its rival ZenFone 8 in an in-browser benchmark. Dedicated benchmarking apps, alongside selected games, appear exempt from the throttling – giving an overinflated impression of how fast the phone will be in general use.

"It's disappointing to see OnePlus handsets making performance decisions based on application identifiers rather than application behaviour. We view this as a form of benchmark manipulation," benchmarking site Geekbench announced via Twitter following the discovery. "We've delisted the OnePlus 9 and OnePlus 9 Pro from our Android Benchmark chart.

"We will also test the other OnePlus handsets in our performance lab to see if these handsets also manipulate performance in the same way. If they do, we will delist them from the Android Benchmark chart."

The problem even extends to screen refresh rates. The company's latest handsets come with the promise of a 120Hz display, but the majority of Android browsers are artificially limited to a 60Hz refresh rate – unless the user is willing to fiddle around with hidden settings to unlock the promised performance.

The really embarrassing thing for OnePlus: this isn't even the first time it's been caught doing exactly the same thing. The company was first found to be cheating benchmarks back in 2017 on its OnePlus 3 and OnePlus 5 devices.

At the time, OnePlus co-founder Cal Pei defended the move. "When users run benchmark apps – which I agree aren't a useful proxy for real-life performance – we believe that they want to see the full potential of their device without interference from tampering," Pei claimed without a trace of irony. "That's what we've unlocked."

The company's customers have had other cause for complaint, too. Concerns were raised with about the amount of data gathered and siphoned off to OnePlus's native China, the discovery of a backdoor to root on its handsets, a clipboard app which phoned home, a breach of its website responsible for the theft of 40,000 credit card details, and a camera that could see through clothes – though the fix for the last likely left a fair few pervs sorely disappointed.

OnePlus did not respond to a request for comment from El Reg, but did provide one to mobile-centric site XDA which skirts the issue – claiming the differences spotted by reviewers is down to a post-launch firmware update designed to "improve the devices' battery life and heat management." The behaviour's confirmed presence on launch-day hardware, though, brings that claim into question. ®


Other stories you might like

  • Stolen university credentials up for sale by Russian crooks, FBI warns
    Forget dark-web souks, thousands of these are already being traded on public bazaars

    Russian crooks are selling network credentials and virtual private network access for a "multitude" of US universities and colleges on criminal marketplaces, according to the FBI.

    According to a warning issued on Thursday, these stolen credentials sell for thousands of dollars on both dark web and public internet forums, and could lead to subsequent cyberattacks against individual employees or the schools themselves.

    "The exposure of usernames and passwords can lead to brute force credential stuffing computer network attacks, whereby attackers attempt logins across various internet sites or exploit them for subsequent cyber attacks as criminal actors take advantage of users recycling the same credentials across multiple accounts, internet sites, and services," the Feds' alert [PDF] said.

    Continue reading
  • Big Tech loves talking up privacy – while trying to kill privacy legislation
    Study claims Amazon, Apple, Google, Meta, Microsoft work to derail data rules

    Amazon, Apple, Google, Meta, and Microsoft often support privacy in public statements, but behind the scenes they've been working through some common organizations to weaken or kill privacy legislation in US states.

    That's according to a report this week from news non-profit The Markup, which said the corporations hire lobbyists from the same few groups and law firms to defang or drown state privacy bills.

    The report examined 31 states when state legislatures were considering privacy legislation and identified 445 lobbyists and lobbying firms working on behalf of Amazon, Apple, Google, Meta, and Microsoft, along with industry groups like TechNet and the State Privacy and Security Coalition.

    Continue reading
  • SEC probes Musk for not properly disclosing Twitter stake
    Meanwhile, social network's board rejects resignation of one its directors

    America's financial watchdog is investigating whether Elon Musk adequately disclosed his purchase of Twitter shares last month, just as his bid to take over the social media company hangs in the balance. 

    A letter [PDF] from the SEC addressed to the tech billionaire said he "[did] not appear" to have filed the proper form detailing his 9.2 percent stake in Twitter "required 10 days from the date of acquisition," and asked him to provide more information. Musk's shares made him one of Twitter's largest shareholders. The letter is dated April 4, and was shared this week by the regulator.

    Musk quickly moved to try and buy the whole company outright in a deal initially worth over $44 billion. Musk sold a chunk of his shares in Tesla worth $8.4 billion and bagged another $7.14 billion from investors to help finance the $21 billion he promised to put forward for the deal. The remaining $25.5 billion bill was secured via debt financing by Morgan Stanley, Bank of America, Barclays, and others. But the takeover is not going smoothly.

    Continue reading

Biting the hand that feeds IT © 1998–2022