+Comment Out of the blue Toshiba has launched an Atom-powered real-time, scale-out, compute-plus-flash analytics engine that is set to compete with Pure’s FlashBlade product.
This announcement unveils the first real competition for Pure Storage's Big Data analytics box and comes from a most unlikely and surprising source, Toshiba not being known at all for enterprise, data centre-class complete systems.
Flashmatrix is a Toshiba-designed densely packaged multi-processor, multi-node, server-flash-network system for real-time/streaming analytics. Toshiba calls it a super-converged system and says Flashmatrix enables multiple data sets to be accessed in parallel and scaled linearly.
In canned quotery, Ralph Schmitt, Executive of System Development at Toshiba America Electronic Components, Inc, stated: “Big data processing can face multiple problems in scaling, latency and power as the customer demands increase. Flashmatrix addresses each of those issues to create a system that is a true solution for analytic processing by offering low-power-consumption, parallel processing to reduce system latency, card level scaling and a large non-volatile memory space shared by all CPUs.”
A node is a 2U box containing:
- 12 Micro Servers - called Connection Units (CU) - CPU cards with;
- 2 x 24 x 64-bit Atom C2550 2.4GHz processors,
- 2 x 16GB DRAM,
- 2 x 1GbitE ports.
- 48 flash cards, called Node Modules (NM);
- 2 x FPGA (Xilinx K7) co-processors,
- 8 x 512GB DDR3L DRAM,
- 8 x eMMC A19 64GiB* NAND.
Toshiba is not saying if this is 3D TLC NAND.
Each Micro Server has firmware encompassing Virtual Drive Control, a Block device, and extended APIs. The middleware listed is HDFS (Hadoop), Postgres SQL, KVS database, a Distributed File System sand Toshiba Linux (Debian 6).
Each Node Module has a Node Controller (NC), eMMC flash with ECC, wear levelling and a write-back cache. The Node Controller provides packet routing, inter-CU communications, flash read/write, ACID control (Lock, Mutex), and calculation (filtering, arithmetic op).
A node contains 24 x 64-bit ATOM CPUs (192 cores), 384GB of DRAM, 24TiB of NAND and 24 x 1GbitE ports.
The CPUs are logically connected at the edge of a mesh, a 2D torus network, with the NAND drives inside the mesh. Each processor can see all of the flash drives.
Flashmatrix node CPU-flash matrix design
Seen from above, each node has a set of 48 non-volatile memory drives at the front. The set has two rows of 12 cards, one behind the other, each side of a central front-back row of components.
Behind these flash drives are two groups of 6 Micro Server cards, each group being either side of the central component row. The 24 x 1GbitE ports are at the rear of the box.
Thus each node contains two units, each with 12 CPUs (the CUs) and 24 flash cards (the NMs) with 12TB of flash.
There can be up to 14 nodes with linear scalability.
Toshiba claims Flashmatrix needs one-fifth of the power of an equivalent traditional IT system using X86 processors and disk drives and, of course, everything sits in 2U boxes instead of racks, saving lots of space. The traditional system design has multiple servers in a shared-nothing layout while Flashmatrix has a shared-everything design.
Pure Storage’s FlashBlade is a another system designed for real-time big data analytics. That uses integrated Xeon processors with flash storage and PCIe connectivity on integrated server/storage/networking blades, with up to 15 blades in a 4U box.
WD’s Infiniflash is a flash storage array for big data storage and that requires an added server and software to turn it into a system, with various partners such as IBM, Nexenta and Tergile offering products based on it. We would expect FlashBlade and FlashMatrix to outperform such systems.
Toshiba will have fun establishing a channel to sell such systems, it having either HDD/NAND component channel partners on the one hand and laptop resellers on the other. Channel partners will need big data analytics expertise. Perhaps Toshiba is thinking of OEM-like or reseller deals with existing system suppliers. It's all a mystery for now.
We have no pricing or availability information.
You can see FlashMatrix information at Toshiba’s booth (407) at the Flash Memory Summit in Santa Clara, August 10-11. ®
* 1 GiB = 1,024 MiB and 1 MiB = 1,024 kiB or 1,048,576 bytes