Oh no, you're thinking, yet another cookie pop-up. Well, sorry, it's the law. We measure how many people read us, and ensure you see relevant ads, by storing cookies on your device. If you're cool with that, hit “Accept all Cookies”. For more info and to customize your settings, hit “Customize Settings”.

Review and manage your consent

Here's an overview of our use of cookies, similar technologies and how to manage them. You can also change your choices at any time, by hitting the “Your Consent Options” link on the site's footer.

Manage Cookie Preferences
  • These cookies are strictly necessary so that you can navigate the site as normal and use all features. Without these cookies we cannot provide you with the service that you expect.

  • These cookies are used to make advertising messages more relevant to you. They perform functions like preventing the same ad from continuously reappearing, ensuring that ads are properly displayed for advertisers, and in some cases selecting advertisements that are based on your interests.

  • These cookies collect information in aggregate form to help us understand how our websites are being used. They allow us to count visits and traffic sources so that we can measure and improve the performance of our sites. If people say no to these cookies, we do not know how many people have visited and we cannot monitor performance.

See also our Cookie policy and Privacy policy.

This article is more than 1 year old

Huawei hugs open-sourcey Alluxio: Thanks for the memories

China giant + OS software in big data analytics acceleration scheme

Huawei has announced a Big Data analytics acceleration scheme using its FusionStorage product and Alluxio open source software; which seems to be the canine genitalia du jour for speeding up lethargic analytics queries.

Alluxio is the renamed Tachyon Nexus, an Andreessen Horowitz-backed startup.

FusionStorage is Huawei's distributed software-defined storage system. The latest FusionStorage 6.0 supports distributed block, file, and object storage, with classification, encryption and deduplication.

Alluxio's software is a memory-centric, virtual distributed storage system. It functions as a ginormous local cache for a remote storage system, such as a set of HDFS nodes. It is based on a cluster of local nodes which are accessed by compute nodes running Big Data analytics jobs and queries.

The software provides:

  • Tiered storage (memory, flash, disk) with automatic data placement
  • Single namespace with transparent naming
  • Native S3, Google Cloud Storage, Open Stack Swift, Alibaba OSS, Microsoft Azure Blob store integrations
  • Fuse Connector, key-value interface
  • One command cluster deployment
  • Metrics reporting
Alluxio_1
Alluxio_2

Alluxio supports lots of different underlying (remote) storage systems include HDFS, Gluster, S3, OpenStack, GCS, NFS, OrangeFS, IBM Spectrum Scake, Ceph, Isilon and others.

Alluxio_3

Baidu ran Spark queries 30 times faster with Alluxio. Batch queries that took 15 minutes completed in less than 30 seconds and a 1000-user Alluxio cluster provided more than 50TB of RAM space.

Barclays accelerated Spark jobs from hours to seconds by interposing an Alluxio set-up between the query-running compute nodes and a Teradata data repository.

Sounds like hot stuff. We think that all this suits Huawei and its IoT/cloud strategy very well. Check out the Alluxio project at www.alluxio.org and run through an Alluxio slide deck here. ®

 

Similar topics

Similar topics

Similar topics

TIP US OFF

Send us news


Other stories you might like