WekaIO almost, but not quite, summits Summit supercomputer on storage performance

Takes second place in IO-500 10 Node Challenge

WekaIO has served up 95 per cent of the Summit supercomputer's 40 storage racks IO using just half a rack's worth of its Matrix scale-out fast filer software.

It's documented in the IO-500 10 Node Challenge List, maintained by the Virtual Institute for I/O.

WekaIO ran the IO-500 test on eight Supermicro BigTwin enclosures, representing less than half of a storage server rack, and scored 67.79, coming within 5 per cent of the Oak Ridge IBM Summit Supercomputer, which ran its system on a 40-rack Spectrum Scale storage cluster.


IO-500 10 Node Challenge list. Click to enlarge

The IO-500 is a list comparing storage systems that work with the world's largest supercomputers. Each system is evaluated by the IO-500 benchmark that measures the storage performance using read/write bandwidth for large files and read/write/listing performance for small files.

Supermicro's BigTwin is an x86 air-cooled 2U multi-node system supporting 205-watt processors, 24 DIMMs, and hot-swap NVMe flash storage with Mellanox networking.

WekaIO scored 67.79, compared to Summit's 70.63 from its Spectrum Scale software.

Third place in the list went to DDN, using the Lustre parallel access filesystem, with a score of 31.78, less than half WekaIO's.

The 10 nodes are client nodes by the way.

The Matrix filer software is POSIX compliant, and claimed to run more efficiently than NFS, using a customised protocol to deliver file-based semantics.

Interestingly, WekaIO had a leading score of 1,200 on the SPEC SFS 2014 benchmark in March 2018. It has since been passed by E8 (Optane + Spectrum Scale and 1,200), DDN (Spectrum Scale and 1,500), NetApp (4-node AFF A800 and 2,200), and NetApp again (8-node AF800 and 4,200). ®

Broader topics

Other stories you might like

  • DuckDuckGo tries to explain why its browsers won't block some Microsoft web trackers
    Meanwhile, Tails 5.0 users told to stop what they're doing over Firefox flaw

    DuckDuckGo promises privacy to users of its Android, iOS browsers, and macOS browsers – yet it allows certain data to flow from third-party websites to Microsoft-owned services.

    Security researcher Zach Edwards recently conducted an audit of DuckDuckGo's mobile browsers and found that, contrary to expectations, they do not block Meta's Workplace domain, for example, from sending information to Microsoft's Bing and LinkedIn domains.

    Specifically, DuckDuckGo's software didn't stop Microsoft's trackers on the Workplace page from blabbing information about the user to Bing and LinkedIn for tailored advertising purposes. Other trackers, such as Google's, are blocked.

    Continue reading
  • Despite 'key' partnership with AWS, Meta taps up Microsoft Azure for AI work
    Someone got Zuck'd

    Meta’s AI business unit set up shop in Microsoft Azure this week and announced a strategic partnership it says will advance PyTorch development on the public cloud.

    The deal [PDF] will see Mark Zuckerberg’s umbrella company deploy machine-learning workloads on thousands of Nvidia GPUs running in Azure. While a win for Microsoft, the partnership calls in to question just how strong Meta’s commitment to Amazon Web Services (AWS) really is.

    Back in those long-gone days of December, Meta named AWS as its “key long-term strategic cloud provider." As part of that, Meta promised that if it bought any companies that used AWS, it would continue to support their use of Amazon's cloud, rather than force them off into its own private datacenters. The pact also included a vow to expand Meta’s consumption of Amazon’s cloud-based compute, storage, database, and security services.

    Continue reading
  • Atos pushes out HPC cloud services based on Nimbix tech
    Moore's Law got you down? Throw everything at the problem! Quantum, AI, cloud...

    IT services biz Atos has introduced a suite of cloud-based high-performance computing (HPC) services, based around technology gained from its purchase of cloud provider Nimbix last year.

    The Nimbix Supercomputing Suite is described by Atos as a set of flexible and secure HPC solutions available as a service. It includes access to HPC, AI, and quantum computing resources, according to the services company.

    In addition to the existing Nimbix HPC products, the updated portfolio includes a new federated supercomputing-as-a-service platform and a dedicated bare-metal service based on Atos BullSequana supercomputer hardware.

    Continue reading

Biting the hand that feeds IT © 1998–2022