IBM hooks up with Hortonworks to Hadoop Big Blue products

But customers welcome to taste IBM's own-brand Hadoop sauce...

+Comment Cognitive Watsonian and mainframer IBM is making Hortonworks available for its Elastic Storage Server (ESS) and Spectrum Scale products.

ESS is an integrated bundle of POWER8 servers, storage enclosures, disks and Spectrum Scale software. The GPFS parallel file system software was renamed Elastic Storage and then rebranded again as Spectrum Scale. Both ESS and Spectrum Scale are called software-defined storage products* by IBM.

IBM now has an agreement with Hortonworks to certify the Hortonworks Data Platform (HDP) with Spectrum Scale on Power and x86 ESS server hardware. HDP, which is a Hadoop distribution using a centralised architecture, was recently made available on POWER8 server hardware, and this announcement moves things on a step.

This will be the first IBM storage offering certified for Hortonworks' Hadoop, according to Big Blue, which makes us wonder why IBM has been so slow (but see the note below about IBM's own Hadoop distribution).

The deal suits both parties. Hortonworks needs server and software support for its Hadoop distribution and IBM can use HDP to help sell its ESS products into Big Data analytics prospects wanting Hadoop.

Ed Walsh, general manager for IBM Storage and Software Defined Infrastructure, has a canned quote and he or his PR flack writer couldn't resist putting a cognitive spin on this: "Every organization is becoming a digital organization. With this announcement IBM is delivering a powerful platform to extend the use of data and for cognitive applications."

That provides a high marketing buzzword score as Walsh got the "digital organisation" term in there too.

Buzzword sniping apart, IBM customers can analyse enterprise storage data directly instead of having to copy it to a separate analytics platform first, which is good news. IBM also reminds us HDFS makes three copies of data whereas ESS uses the more space-efficient erasure-coding for data protection.

It also claims ESS, with parallel file access, can be faster than distributed HDFS deployments, though not when ESS uses a cloud back-end tier – but that, it says, can bring cost benefits.


Lastly, in its announcement, IBM wants us to know that its own Hadoop and Spark distribution and analytics software is also an option for customers using Spectrum Scale Storage.

El Reg could well imagine Hortonworks would be pissed off at reading this in an IBM press release extolling IBM product certification with Hortonworks's HDP product, and justifiably so. ®

*Well, actually software-defined storage solutions but we couldn't bring ourselves to use that horrible marketing-speak term.

Similar topics

Other stories you might like

  • Want to buy your own piece of the Pi? No 'urgency' says Upton of the listing rumours

    A British success story... what happens next?

    Industry talk is continuing to circulate regarding a possible listing for the UK makers of the diminutive Raspberry Pi computer.

    Over the weekend, UK newspaper The Telegraph reported that a spring listing could be in the offing, with a valuation of more than £370m slapped onto the computer maker.

    Pi boss, Eben Upton, described the article as "interesting" in an email to The Register today, before repeating that "we're always looking at ways to fund the future growth of the business, but the $45m we raised in September has taken some of the urgency out of that."

    Continue reading
  • JetBrains embraces remote development with new IDE for multiple programming languages

    Security, collaboration, flexible working: Fleet does it all, says project lead

    JetBrains has introduced remote development for its range of IDEs as well as previewing a new IDE called Fleet, which will form the basis for fresh tools covering all major programming languages.

    JetBrains has a core IDE used for the IntelliJ IDEA Java tool as well other IDEs such as Android Studio, the official programming environment for Google Android, PyCharm for Python, Rider for C#, and so on. The IDEs run on the Java virtual machine (JVM) and are coded using Java and Kotlin, the latter being primarily a JVM language but with options for compiling to JavaScript or native code.

    Fleet is "both an IDE and a lightweight code editor," said the company in its product announcement, suggesting perhaps that it is feeling some pressure from the success of Microsoft's Visual Studio Code, which is an extensible code editor. Initial language support is for Java, Kotlin, Go, Python, Rust, and JavaScript, though other languages such as C# will follow. Again like VS Code, Fleet can run on a local machine or on a remote server. The new IDE uses technology developed for IntelliJ such as its code-processing engine for features such as code completion and refactoring.

    Continue reading
  • Nextcloud and cloud chums fire off competition complaint to the EU over Microsoft bundling OneDrive with Windows

    No, it isn't the limited levels of storage that have irked European businesses

    EU software and cloud businesses have joined Nextcloud in filing a complaint with the European Commission regarding Microsoft's alleged anti-competitive behaviour over the bundling of its OS with online services.

    The issue is OneDrive and Microsoft's habit of packaging it (and other services such as Teams) with Windows software.

    Nextcloud sells on-premises collaboration platforms that it claims combine "the convenience and ease of use of consumer-grade solutions like Dropbox and Google Drive with the security, privacy and control business needs." Microsoft's cloud storage system, OneDrive, is conspicuous by its absence.

    Continue reading

Biting the hand that feeds IT © 1998–2021