Linux kernel-bypassing Quobyte plug-in goes with the TensorFlow for faster file access

Skip it, it's a Google thing

Linux-loving hyperscale types at Euro startup Quobyte have pushed out a plug-in for its Data Centre File System, used in HPC-style workloads, that enables TensorFlow apps to access its files directly instead of having to traipse through the Linux kernel.

Old beardy man thinking. Pic: Henadz via Flickr

BBC bypasses Linux kernel to make streaming videos flow


TensorFlow machine learning work can be read-intensive with lots of server cores and GPUs needing access to stored file data. Shaving time off each access by avoiding passing through the Linux kernel storage stack can shorten the time needed for model training and inference.

Kernel bypassing has often been used with applications bound by filesystem and network IO. For example:

  • WekaIO uses Linux kernel bypass technology to speed its filesystem. It operates its own RTOS (real time operating system) in Linux user space, not kernel space, and runs its own scheduling and networking stack, with the latter talking directly to the host server's network interface card (NIC) through PCIe virtualisation. WekaIO also has its own memory management and talks directly to a server's SSDs.
  • The BBC uses kernel bypassing for video-streaming to improve performance. It avoids video data being copied from the application's buffers to the socket buffer, and then from the socket buffer to the network device driver's buffers.
  • Solarflare is in the kernel bypass game for its NVMe-over-TCP storage network fabric. Its XtremeScale NICs support a universal kernel bypass suite that accelerates NFV and storage server traffic. It says NVMe-over-TCP kernel extension provides its network adapters with the ability to approach the latencies of NVMe local flash storage over conventional POSIX-compliant Ethernet TCP networks with no RDMA required.

Quobyte claimed the tech could improve GPU utilisation, with less time wasted waiting for file IOs to complete. It can be used on-premises or in the Google cloud.

Other HPC parallel and scale-out file system suppliers may soon add TensorFlow support. The Reg storage desk sees Elastifile, Isilon, Lustre, Panasas, Qumulo, Spectrum Scale and WekaIO as likely candidates. ®

Broader topics

Other stories you might like

  • Stolen university credentials up for sale by Russian crooks, FBI warns
    Forget dark-web souks, thousands of these are already being traded on public bazaars

    Russian crooks are selling network credentials and virtual private network access for a "multitude" of US universities and colleges on criminal marketplaces, according to the FBI.

    According to a warning issued on Thursday, these stolen credentials sell for thousands of dollars on both dark web and public internet forums, and could lead to subsequent cyberattacks against individual employees or the schools themselves.

    "The exposure of usernames and passwords can lead to brute force credential stuffing computer network attacks, whereby attackers attempt logins across various internet sites or exploit them for subsequent cyber attacks as criminal actors take advantage of users recycling the same credentials across multiple accounts, internet sites, and services," the Feds' alert [PDF] said.

    Continue reading
  • Big Tech loves talking up privacy – while trying to kill privacy legislation
    Study claims Amazon, Apple, Google, Meta, Microsoft work to derail data rules

    Amazon, Apple, Google, Meta, and Microsoft often support privacy in public statements, but behind the scenes they've been working through some common organizations to weaken or kill privacy legislation in US states.

    That's according to a report this week from news non-profit The Markup, which said the corporations hire lobbyists from the same few groups and law firms to defang or drown state privacy bills.

    The report examined 31 states when state legislatures were considering privacy legislation and identified 445 lobbyists and lobbying firms working on behalf of Amazon, Apple, Google, Meta, and Microsoft, along with industry groups like TechNet and the State Privacy and Security Coalition.

    Continue reading
  • SEC probes Musk for not properly disclosing Twitter stake
    Meanwhile, social network's board rejects resignation of one its directors

    America's financial watchdog is investigating whether Elon Musk adequately disclosed his purchase of Twitter shares last month, just as his bid to take over the social media company hangs in the balance. 

    A letter [PDF] from the SEC addressed to the tech billionaire said he "[did] not appear" to have filed the proper form detailing his 9.2 percent stake in Twitter "required 10 days from the date of acquisition," and asked him to provide more information. Musk's shares made him one of Twitter's largest shareholders. The letter is dated April 4, and was shared this week by the regulator.

    Musk quickly moved to try and buy the whole company outright in a deal initially worth over $44 billion. Musk sold a chunk of his shares in Tesla worth $8.4 billion and bagged another $7.14 billion from investors to help finance the $21 billion he promised to put forward for the deal. The remaining $25.5 billion bill was secured via debt financing by Morgan Stanley, Bank of America, Barclays, and others. But the takeover is not going smoothly.

    Continue reading

Biting the hand that feeds IT © 1998–2022