HPC

Enough with the rack-grappling, kids. Try this MYSTERY app

Ultra Comprehensive ISC14 Cluster Comp Results - part 2


HPC blog The organisers of the ISC Student Cluster Competitions (here's a quick guide on how these HPC battles work) are a wily bunch. Theirs was the first competition to throw a “mystery application” at the student teams, forcing them to optimise an unfamiliar workload on the fly.

The teams only have a few hours to learn the mystery app and figure out how to best deploy it on their clusters. The goal of the organisers is to ensure that the students not only understand the named applications in the competition, but that they also have the skills necessary to install and then optimise a new application.

At ISC14, the competition committee ratcheted up the pressure even more. In addition to the mystery app, which the students expected, there was also a “Secret Mission” task, which, like the Spanish Inquisition, no one expected.

Here’s how it all played out…..

The dreaded “Mystery Application” has, in years past, caused a lot of problems for student teams. This app is kept a secret until just before the students have to run it, meaning they don’t have any time to prepare for it.

This year, the mystery app was the new HPC benchmark HPCG (High Performance Conjugate Gradient), the brainchild of HPL maven Dr Jack Dongarra. Dongarra and partner Michael Heroux (from Sandia National Labs) developed HPCG to better measure how modern systems perform on today’s real world problems.

As far as I can tell, there isn’t a widely available accelerator (GPU or Phi)-enabled release of HPCG. That isn’t to say that one doesn’t exist, but I didn’t find it during my research.

All of the teams did pretty well on HPCG – the average score was 66 per cent, the highest of all the competition applications. But the end result was a Teutonic tour de force as the Germans notched a one-two finish, reminiscent of some of the Chinese powerhouse teams in past competitions.

Team Hamburg topped all competitors with an astonishing 100 per cent score, which is a huge accomplishment for a newbie team. Chemnitz finished second by only a single percentage point, with South Africa taking the Bronze with 97 per cent.

Once again, Team Tsinghua gets Honourable Mention for their fourth place finish with old school, unaccelerated gear.

Secret Mission sinks students

In addition to the Mystery application, the organisers threw another wrinkle into the competition this year by giving students a "Secret Mission".

The mission? Turn in a GADGET-3 run that uses the least amount of peak power within a 20-minute time limit.

In a break from cluster competition tradition, the teams could shut down and rejigger their hardware to find the combination of gear that had enough computational power to complete the run in 20 minutes, but did it with the lowest peak electricity usage.

The students were given a couple of hours to consider the problem, reconfigure their hardware, and test. After that, they had one hour to provide the judges with their best GADGET run.

This turned out to be quite the challenge. It was, in fact, the most difficult task in the entire competition, with an average team score of just 22%. From what I could tell, most of the teams depowered their systems a bit too much and didn’t have enough enabled gear to hit the 20-minute time limit for a successful run.

But three teams managed to put together the right combo of gear and tuning to complete this task. Team South Africa snared their first Gold Medal on this task while dominating the rest of the field with their perfect score.

Team Tsinghua snared silver with 79 per cent and Shanghai took bronze with 62 per cent. The rest of the field wasn’t able to log a successful run in the allotted time.

This task was a great success in my book, since it really pushed the teams to the limit and forced them to use all of their skills to tackle an out of the box problem. Quite the character builder.

Students shine in interviews

As usual, all of the teams did well on the interview component this year, with an average score of 73 per cent. The fact that all of the teams did so well isn’t surprising.

Participating in a cluster competition means that the students spent months before the competition learning how to put together the right HPC cluster for the tasks they’ll be given. They have to be on intimate terms with the applications, knowing what sliders to move to make them run like a pack of scalded weasels. (Which is pretty fast, as it turns out.)

Taking the Gold Medal for best interview is Team USTC with 90 per cent - and that’s despite facing a language barrier (although the competition did provide interpreters for the judges). Team Edinburgh edged out the field to snatch up the Silver Medal, even without the benefit of a Scottish-English interpretation services.

Team South Africa edged out Mass Green by fractions of a point for the Bronze Medal. As first time ISC competitors, the teams from South Korea and Hamburg did exceptionally well on the interview portion of the challenge.

In the next article, we'll lay out the official results for the top three Overall Championship winners, along with the winner of the Fan Favourite Award, plus pictures and maybe even some video from the epic awards ceremony.

(For part one of our incredibly comprehensive coverage of the ISC14 cluster competition results, click here) ®


Other stories you might like

  • Robotics and 5G to spur growth of SoC industry – report
    Big OEMs hogging production and COVID causing supply issues

    The system-on-chip (SoC) side of the semiconductor industry is poised for growth between now and 2026, when it's predicted to be worth $6.85 billion, according to an analyst's report. 

    Chances are good that there's an SoC-powered device within arm's reach of you: the tiny integrated circuits contain everything needed for a basic computer, leading to their proliferation in mobile, IoT and smart devices. 

    The report predicting the growth comes from advisory biz Technavio, which looked at a long list of companies in the SoC market. Vendors it analyzed include Apple, Broadcom, Intel, Nvidia, TSMC, Toshiba, and more. The company predicts that much of the growth between now and 2026 will stem primarily from robotics and 5G. 

    Continue reading
  • Deepfake attacks can easily trick live facial recognition systems online
    Plus: Next PyTorch release will support Apple GPUs so devs can train neural networks on their own laptops

    In brief Miscreants can easily steal someone else's identity by tricking live facial recognition software using deepfakes, according to a new report.

    Sensity AI, a startup focused on tackling identity fraud, carried out a series of pretend attacks. Engineers scanned the image of someone from an ID card, and mapped their likeness onto another person's face. Sensity then tested whether they could breach live facial recognition systems by tricking them into believing the pretend attacker is a real user.

    So-called "liveness tests" try to authenticate identities in real-time, relying on images or video streams from cameras like face recognition used to unlock mobile phones, for example. Nine out of ten vendors failed Sensity's live deepfake attacks.

    Continue reading
  • Lonestar plans to put datacenters in the Moon's lava tubes
    How? Founder tells The Register 'Robots… lots of robots'

    Imagine a future where racks of computer servers hum quietly in darkness below the surface of the Moon.

    Here is where some of the most important data is stored, to be left untouched for as long as can be. The idea sounds like something from science-fiction, but one startup that recently emerged from stealth is trying to turn it into a reality. Lonestar Data Holdings has a unique mission unlike any other cloud provider: to build datacenters on the Moon backing up the world's data.

    "It's inconceivable to me that we are keeping our most precious assets, our knowledge and our data, on Earth, where we're setting off bombs and burning things," Christopher Stott, founder and CEO of Lonestar, told The Register. "We need to put our assets in place off our planet, where we can keep it safe."

    Continue reading

Biting the hand that feeds IT © 1998–2022