FIGHT! Intel disputes ARM's claims of Android superiority

Chipzilla rep: 'Someone's gotta be the truth squad around here'


Last month, The Reg published test results performed by ARM that the UK chip designers said show that mobile processors based on its technology have significant advantages over Intel's chips when running Android apps. Intel would beg to differ.

"Someone's gotta be the truth squad around here, right?" Intel corporate communications manager Bill Calder told The Reg.

Specifically, ARM senior technical marketing engineer Rod Watt had said at his company's 2014 Tech Day in Austin, Texas, that if apps haven't been recompiled to run natively on Intel-based Android devices and therefore have to be converted at runtime from native ARM code into native Intel x86 code using "binary translation" (aka "bridge technology"), the conversion caused "a huge impact to the user and to the performance of the system."

Watt also said that the number of Android apps that required such translation was 42 per cent in July 2013 and 44 per cent in January 2014, basing those results on testing 100 apps each time: the top 25 free and paid apps and the top 25 free and paid games in the Google Play online app store.

What's more, Watt said that in July 2013, 6 per cent of those apps simply didn't work at all on x86-based Android devices, and that by January 2014, that number had risen to 9 per cent.

Watt added that binary translation exacted a heavy penalty on Android systems, in terms of performance hits caused by processing overhead, as well as raising overall battery suckage.

"We look at some of this stuff," Calder told us, "and went, 'Okay, well, that might be true, or that might be twisted, this one's way off, that's way off'." So Calder hooked us up with Intel Principal Engineer Dan Lavery of Chipzilla's Software and Services Group to get Intel's take on ARM's numbers.

"We don't think that ARM's presentation is a reflection of [Intel Architecture (IA)] device compatibility and performance – an accurate reflection," Lavery politely countered.

Regarding Watt's January 2014 compatibility numbers, Lavery took issue with the assertion that only 91 per cent of apps will run on a Samsung Galaxy Tab 3 10.1 with a dual-core Intel Atom Z2560 – that 91 per cent being the total of 44 per cent translated, 23 per cent x86-native, 21 per cent running in the Dalvik virtual machine, and 3 per cent unknown.

"On all the devices that we've tested recently, both ARM and IA, including the Galaxy Tab 3," Lavery said, "we're getting a pass rate between 97 and 99 per cent."

Intel refutes ARM: app compatibility charts

Nobody's perfect, but Intel says it's perfecter than ARM wants you to believe (click to enlarge)

In head-to-head testing of top-100 app compatibility running on a Samsung Galaxy Tab 3 10.1 – albeit with January 2014 top 100 Google Play apps in ARM's case and February 2014 top 100 apps in Intel's case – ARM's numbers and Lavery's numbers differed.

Lavery also tested four devices, based on a much larger set of apps from a marginally different time period: the top 400 apps on Google Play this February, 100 each from free and paid apps and games. Of the devices tested, two were IA-based and two were ARM – and although the Google Nexus 7 powered by a Qualcomm Snapdragon S4 Pro with a quad-core ARM-based Krait CPU was the most compatible, the differences among the four were minimal.

"Even some of the ARM stuff is not perfect," Calder pointed out.

Lavery agreed with ARM's Watt that a "large percentage" of apps in Google Play only have an ARM-native version. "This is true," he said, "but almost all these apps run with good user experiences on Intel devices."

When pressed to define what he meant by good user experiences – which he upgraded to "great" when asked – Lavery discusses his testing of 21 games to determine the frames-per-second effect of the overhead of binary translation – what Intel calls bridge technology – by comparing the performance of translated ARM-native games with that of a native-x86 version of the same game.

Intel refutes ARM: bridge technology overhead chart

Still playing Angry Birds? If so, Intel says it'll run just fine on an x86 Android device (click to enlarge)

"The overhead here is really not visible to the user for the vast majority of apps out there," Lavery said. "We're not saying we're perfect here – there are a handful of apps that do have a user-visible difference." Among the top 2,000 apps, he said, there are a few – "literally a handful" – of Adobe AIR–based apps that do have a visible difference, but these will also soon be able to be ported, seeing as how Adobe has announced support for AIR on x86 for Android "due to developer demand."

"Just for full disclosure," he said, "some of the CPU benchmarks do have significant visible difference, but of course benchmarks are ported as well."

Lavery also took issue with ARM's claims that binary translation has a heavy impact upon energy consumption. "We actually think that – not think that, but know that – the effect of the bridge technology on battery life is negligible," he said.

As proof of this assertion, he shared the results of his power-consumption tests of 35 apps in the Google Play top 200 for which he had both ARM-native and x86-native versions.

Intel refutes ARM: battery-life chart

Intel's Calder: 'Negligible is an important word' in the message of these battery-life results (click to enlarge)

According to Lavery, the geometric mean of the increase in current required for binary translation of the apps he tested, measured in milliamps, was 2.4 per cent. In a hypothetical 10-hour battery life usage scenario during which a device was used half the time, with half of that usage running ARM-native and half running x86-native apps, the impact on battery life would be about 3.6 minutes.

As Calder put it, ARM was right about binary translation requiring more power – but not much. "We agree – but guess what? It's like less than four minutes out of 10 hours."

Although there are still a goodly number of apps in Google Play that have yet to be ported into x86-native versions, Intel's goal is to get that number up to 80 per cent – although neither Calder nor Lavery could provide a timeline for that effort.

Their argument is that the fact that many apps have yet to be ported to x86 is a non-issue. "All the IA devices can run [ARM-native apps] well," said Calder.

"You can always make a corner case for this particular app or that particular app," he argued, "but if the vast majority of apps that are in the store work well, does it matter?"

Does it matter to you, dear Reg reader? And, for that matter, which company does your experience lead you to believe, ARM or Intel? Let us know in Comments. ®


Other stories you might like

  • Will this be one of the world's first RISC-V laptops?
    A sneak peek at a notebook that could be revealed this year

    Pic As Apple and Qualcomm push for more Arm adoption in the notebook space, we have come across a photo of what could become one of the world's first laptops to use the open-source RISC-V instruction set architecture.

    In an interview with The Register, Calista Redmond, CEO of RISC-V International, signaled we will see a RISC-V laptop revealed sometime this year as the ISA's governing body works to garner more financial and development support from large companies.

    It turns out Philipp Tomsich, chair of RISC-V International's software committee, dangled a photo of what could likely be the laptop in question earlier this month in front of RISC-V Week attendees in Paris.

    Continue reading
  • Did ID.me hoodwink Americans with IRS facial-recognition tech, senators ask
    Biz tells us: Won't someone please think of the ... fraud we've stopped

    Democrat senators want the FTC to investigate "evidence of deceptive statements" made by ID.me regarding the facial-recognition technology it controversially built for Uncle Sam.

    ID.me made headlines this year when the IRS said US taxpayers would have to enroll in the startup's facial-recognition system to access their tax records in the future. After a public backlash, the IRS reconsidered its plans, and said taxpayers could choose non-biometric methods to verify their identity with the agency online.

    Just before the IRS controversy, ID.me said it uses one-to-one face comparisons. "Our one-to-one face match is comparable to taking a selfie to unlock a smartphone. ID.me does not use one-to-many facial recognition, which is more complex and problematic. Further, privacy is core to our mission and we do not sell the personal information of our users," it said in January.

    Continue reading
  • Meet Wizard Spider, the multimillion-dollar gang behind Conti, Ryuk malware
    Russia-linked crime-as-a-service crew is rich, professional – and investing in R&D

    Analysis Wizard Spider, the Russia-linked crew behind high-profile malware Conti, Ryuk and Trickbot, has grown over the past five years into a multimillion-dollar organization that has built a corporate-like operating model, a year-long study has found.

    In a technical report this week, the folks at Prodaft, which has been tracking the cybercrime gang since 2021, outlined its own findings on Wizard Spider, supplemented by info that leaked about the Conti operation in February after the crooks publicly sided with Russia during the illegal invasion of Ukraine.

    What Prodaft found was a gang sitting on assets worth hundreds of millions of dollars funneled from multiple sophisticated malware variants. Wizard Spider, we're told, runs as a business with a complex network of subgroups and teams that target specific types of software, and has associations with other well-known miscreants, including those behind REvil and Qbot (also known as Qakbot or Pinkslipbot).

    Continue reading

Biting the hand that feeds IT © 1998–2022