Xamarin sics army of 1,000 test devices on hapless mobile apps

Cloud-based testing service puts code through virtual wringer


Mobile app-dev specialists Xamarin have launched the Xamarin Test Cloud, an automated, internet-based service that lets developers test their code on more than 1,000 devices.

"With Xamarin Test Cloud, you can create your own test scripts using our powerful testing framework, run them locally against emulators or devices, and then press a button to run the same tests on as many devices as you would like in the cloud," Xamarin CEO Nat Friedman said in a blog post.

The service works with an automation framework called Calabash, which was originally developed by LessPainful, a startup Xamarin acquired in 2013.

Developers write their test scripts in either C# or Ruby, but the service can be used to test any hybrid or native Android or iOS app written in any language.

Although they're automated, the tests can involve practically anything you might do when holding a device in your hand, short of dropping it on the ground. They can simulate tapping and swiping the screen, rotating the device, changing the GPS location, pressing physical buttons, activating the camera, and more.

They can also simulate varying mobile network conditions, from EDGE to 4G and everything in between, including lost connections.

Developers can select devices to test against from a library of over 1,000 models, filtering by such factors as manufacturer, operating system, or form factor.

Screenshot of Xamarin Test Cloud

Xamarin's trove of mobes includes current and older phone and slab models (click to enlarge)

The service provides detailed reports on the outcomes of each test, including full-resolution screenshots of each step. Developers can access CPU, memory, test duration, and other performance data, in addition to such debugging information as stack traces and device logs.

Because Xamarin wants to see mobile developers test their apps more frequently and thoroughly, the service also works with continuous integration tools such as Jenkins, Team Foundation Server, and TeamCity.

"We believe that testing is not something you should do at the end of the development cycle, just before submitting to the app store," Friedman said. "Instead, your app should be continuously tested during development in an automated, scalable way."

As powerful as Xamarin's cloud-based service is, however, it will cost you. Xamarin Test Cloud starts at $12,000 per year for the Basic version, which lets you test two apps for a total of 200 device-hours per month, with email support only.

On the high end, the Enterprise version of the service costs $144,000 per year, which gets you license to test 20 apps for 2,400 device-hours per month, in addition to a number of gold-plated service and support benefits. The not-quite-as-plush Professional and Business service levels offer varying levels of service and go for $60,000 and $96,000 per year, respectively. ®

Similar topics


Other stories you might like

  • Ransomware encrypts files, demands three good deeds to restore data
    Shut up and take ... poor kids to KFC?

    In what is either a creepy, weird spin on Robin Hood or something from a Black Mirror episode, we're told a ransomware gang is encrypting data and then forcing each victim to perform three good deeds before they can download a decryption tool.

    The so-called GoodWill ransomware group, first identified by CloudSEK's threat intel team, doesn't appear to be motivated by money. Instead, it is claimed, they require victims to do things such as donate blankets to homeless people, or take needy kids to Pizza Hut, and then document these activities on social media in photos or videos.

    "As the threat group's name suggests, the operators are allegedly interested in promoting social justice rather than conventional financial reasons," according to a CloudSEK analysis of the gang. 

    Continue reading
  • Microsoft Azure to spin up AMD MI200 GPU clusters for 'large scale' AI training
    Windows giant carries a PyTorch for chip designer and its rival Nvidia

    Microsoft Build Microsoft Azure on Thursday revealed it will use AMD's top-tier MI200 Instinct GPUs to perform “large-scale” AI training in the cloud.

    “Azure will be the first public cloud to deploy clusters of AMD's flagship MI200 GPUs for large-scale AI training,” Microsoft CTO Kevin Scott said during the company’s Build conference this week. “We've already started testing these clusters using some of our own AI workloads with great performance.”

    AMD launched its MI200-series GPUs at its Accelerated Datacenter event last fall. The GPUs are based on AMD’s CDNA2 architecture and pack 58 billion transistors and up to 128GB of high-bandwidth memory into a dual-die package.

    Continue reading
  • New York City rips out last city-owned public payphones
    Y'know, those large cellphones fixed in place that you share with everyone and have to put coins in. Y'know, those metal disks representing...

    New York City this week ripped out its last municipally-owned payphones from Times Square to make room for Wi-Fi kiosks from city infrastructure project LinkNYC.

    "NYC's last free-standing payphones were removed today; they'll be replaced with a Link, boosting accessibility and connectivity across the city," LinkNYC said via Twitter.

    Manhattan Borough President Mark Levine said, "Truly the end of an era but also, hopefully, the start of a new one with more equity in technology access!"

    Continue reading
  • Cheers ransomware hits VMware ESXi systems
    Now we can say extortionware has jumped the shark

    Another ransomware strain is targeting VMware ESXi servers, which have been the focus of extortionists and other miscreants in recent months.

    ESXi, a bare-metal hypervisor used by a broad range of organizations throughout the world, has become the target of such ransomware families as LockBit, Hive, and RansomEXX. The ubiquitous use of the technology, and the size of some companies that use it has made it an efficient way for crooks to infect large numbers of virtualized systems and connected devices and equipment, according to researchers with Trend Micro.

    "ESXi is widely used in enterprise settings for server virtualization," Trend Micro noted in a write-up this week. "It is therefore a popular target for ransomware attacks … Compromising ESXi servers has been a scheme used by some notorious cybercriminal groups because it is a means to swiftly spread the ransomware to many devices."

    Continue reading
  • Twitter founder Dorsey beats hasty retweet from the board
    As shareholders sue the social network amid Elon Musk's takeover scramble

    Twitter has officially entered the post-Dorsey age: its founder and two-time CEO's board term expired Wednesday, marking the first time the social media company hasn't had him around in some capacity.

    Jack Dorsey announced his resignation as Twitter chief exec in November 2021, and passed the baton to Parag Agrawal while remaining on the board. Now that board term has ended, and Dorsey has stepped down as expected. Agrawal has taken Dorsey's board seat; Salesforce co-CEO Bret Taylor has assumed the role of Twitter's board chair. 

    In his resignation announcement, Dorsey – who co-founded and is CEO of Block (formerly Square) – said having founders leading the companies they created can be severely limiting for an organization and can serve as a single point of failure. "I believe it's critical a company can stand on its own, free of its founder's influence or direction," Dorsey said. He didn't respond to a request for further comment today. 

    Continue reading

Biting the hand that feeds IT © 1998–2022