Why two scale-out NAS, IBM? One's a pickup, the other's a juggernaut

Spectrum NAS overlaps with Spectrum Scale, but there are differences

Analysis IBM already had a scale-out NAS (filer) when it announced Spectrum NAS last month: Spectrum Scale, which can grow to 16,000-plus nodes. Why does it need another?

The two overlap in the same way as a Dodge pickup and a Mack truck. Sure, they can both carry small loads but using a Mack truck for Dodge pickup loads is a waste of money. If they both turn up for a load then one of them is in the wrong place.

We know how to contrast and compare pickup vehicles and trucks. How are Spectrum NAS and Spectrum Scale alike yet different?

Spectrum Scale

Spectrum Scale is IBM's mature scale-out and parallel access file system that supports from 1 to 16,384 nodes. It used to be called GPFS (General Parallel File System). A specific CES (Cluster Export Services) cluster of its nodes provides NAS access as a gateway to Spectrum Scale data.

CES supports NFS v4 and Server Message Block (SMB) v3 access. It is based on Samba software and IBM has good links with the Samba and Microsoft SMB people.

There can be from 1 to 16 SMB nodes. IBM does not say how many NFS nodes there can be in a CES cluster.

Spectrum Scale and Scale CES can run on x86, POWER and z System (mainframe) hardware, and these must run the RHEL 7 operating system. All nodes in a CES SMB cluster must be identical.

IBM doesn't say Spectrum Scale CES has no single point of failure but does claim high availability.

All Spectrum Scale CES nodes see the same configuration data. The state of opened files is shared among the CES nodes so that data integrity is maintained.

There is a central CES address pool of IP addresses distributed among the nodes.

We understand that Spectrum Scale CES can use the full features and performance of the GPFS filesystem but the setup is a little bit like in a F1 race car – you need the good support team and the full understanding. CES also offers more than just SMB and NFS access, providing iSCSI, Swift/S3, OpenStack and Unified Objects.

IBM has a graphic positioning Spectrum NAS, Spectrum Scale and its Cloud Object Services:


IBM positioning of Spectrum Scale (CES), Spectrum NAS and Cloud Object ServicesCOS

Spectrum NAS

Spectrum NAS was introduced to provide a scale-out NAS cluster supporting from four to tens of nodes, each of which must use identical x86 server hardware. It is based on Compuverde vNAS software. Compuverde talks of scaling out to hundreds of nodes, and IBM doesn't identify an upper scaling limit.

It appears, then, that it may outscale Spectrum Scale CES as an SMB-accessed NAS system.

The nodes are commodity x86 servers, either bare metal or virtual, and Spectrum NAS is a bootable software stack.

There is a single namespace and it's claimed bottlenecks and single points of failure are avoided.

Both disk and flash node storage is supported with, obviously, flash providing higher performance.

All cluster resources are aggregated, meaning CPUs, storage, cache and bandwidth. Every node has knowledge about which node owns a copy of any given data.

Spectrum NAS is self-healing. There is erasure coding with data striped across nodes and locations, not just disks.

A virtual IP mechanism is used to ensure that all nodes in a cluster appear available at all times, even when a particular node is taken down for upgrade or has failed.

Spectrum NAS supports a wider range of NFS protocols than Spectrum Scale CES; v3, v4, v4.1, as well as SMB ones; v1. v2. v3.

Microsoft and Compuverde have entered into a licence agreement to enable access to Microsoft's SMB file transport technology for Compuverde's software. The agreement includes access to future generations of SMB.

The Compuverde software also provides iSCSI, OpenStack Swift, and Amazon S3 access support, but we don't know if IBM's Spectrum NAS provides this.

Spectrum NAS has intelligent locking and supports snapshots.

It can be set up and/or upgraded in 30 minutes. This is on a per-node basis we understand. Rolling upgrades can be performed across a Spectrum NAS cluster.

Spectrum NAS and Spectrum Scale CES positioning

Our understanding is that you should use Spectrum NAS and not Spectrum Scale CES if:

  1. You don't intend to scale past hundreds of nodes
  2. You don't have parallel file access requirements
  3. You don't wish to be involved in complex software support and optimisation

Specifically Spectrum NAS is for home directories, general and virtual machine file serving, and to provide NAS storage for Microsoft applications. Spectrum Scale is to provide fast-access storage for compute clusters, big data analytics, machine learning and deep learning, and fast backup and restore.

Think of Spectrum NAS as like a neighbourhood coffee shop. Spectrum Scale is then like a 2,000-room hotel with a coffee shop on its premises. You can have coffee in both places, but that's not the main reason for going to the hotel. ®

Similar topics

Narrower topics

Other stories you might like

  • Experts: AI should be recognized as inventors in patent law
    Plus: Police release deepfake of murdered teen in cold case, and more

    In-brief Governments around the world should pass intellectual property laws that grant rights to AI systems, two academics at the University of New South Wales in Australia argued.

    Alexandra George, and Toby Walsh, professors of law and AI, respectively, believe failing to recognize machines as inventors could have long-lasting impacts on economies and societies. 

    "If courts and governments decide that AI-made inventions cannot be patented, the implications could be huge," they wrote in a comment article published in Nature. "Funders and businesses would be less incentivized to pursue useful research using AI inventors when a return on their investment could be limited. Society could miss out on the development of worthwhile and life-saving inventions."

    Continue reading
  • Declassified and released: More secret files on US govt's emergency doomsday powers
    Nuke incoming? Quick break out the plans for rationing, censorship, property seizures, and more

    More papers describing the orders and messages the US President can issue in the event of apocalyptic crises, such as a devastating nuclear attack, have been declassified and released for all to see.

    These government files are part of a larger collection of records that discuss the nature, reach, and use of secret Presidential Emergency Action Documents: these are executive orders, announcements, and statements to Congress that are all ready to sign and send out as soon as a doomsday scenario occurs. PEADs are supposed to give America's commander-in-chief immediate extraordinary powers to overcome extraordinary events.

    PEADs have never been declassified or revealed before. They remain hush-hush, and their exact details are not publicly known.

    Continue reading
  • Stolen university credentials up for sale by Russian crooks, FBI warns
    Forget dark-web souks, thousands of these are already being traded on public bazaars

    Russian crooks are selling network credentials and virtual private network access for a "multitude" of US universities and colleges on criminal marketplaces, according to the FBI.

    According to a warning issued on Thursday, these stolen credentials sell for thousands of dollars on both dark web and public internet forums, and could lead to subsequent cyberattacks against individual employees or the schools themselves.

    "The exposure of usernames and passwords can lead to brute force credential stuffing computer network attacks, whereby attackers attempt logins across various internet sites or exploit them for subsequent cyber attacks as criminal actors take advantage of users recycling the same credentials across multiple accounts, internet sites, and services," the Feds' alert [PDF] said.

    Continue reading

Biting the hand that feeds IT © 1998–2022