Oh no, you're thinking, yet another cookie pop-up. Well, sorry, it's the law. We measure how many people read us, and ensure you see relevant ads, by storing cookies on your device. If you're cool with that, hit “Accept all Cookies”. For more info and to customize your settings, hit “Customize Settings”.

Review and manage your consent

Here's an overview of our use of cookies, similar technologies and how to manage them. You can also change your choices at any time, by hitting the “Your Consent Options” link on the site's footer.

Manage Cookie Preferences
  • These cookies are strictly necessary so that you can navigate the site as normal and use all features. Without these cookies we cannot provide you with the service that you expect.

  • These cookies are used to make advertising messages more relevant to you. They perform functions like preventing the same ad from continuously reappearing, ensuring that ads are properly displayed for advertisers, and in some cases selecting advertisements that are based on your interests.

  • These cookies collect information in aggregate form to help us understand how our websites are being used. They allow us to count visits and traffic sources so that we can measure and improve the performance of our sites. If people say no to these cookies, we do not know how many people have visited and we cannot monitor performance.

See also our Cookie policy and Privacy policy.

This article is more than 1 year old

It's a Flink-off: Hazelcast launches own big data munching distributed processing engine

Brilliant, it's about jolly time someone invented one of those

In-memory computing hopeful Hazelcast is launching Hazelcast Jet, a distributed processing engine for the streams of big data which the business expects will be pouring into enterprises soon.

Hazelcast's eponymous in-memory data grid is based on commodity hardware rather than expensive proprietary Oracle Exadata boxes, and will be providing storage functionality for Jet. With both computation and storage kept in-memory, Hazelcast hopes to achieve high speed and low latency.

The company's CEO, Greg Luck, said the business had recognised an “opportunity in the market for Hazelcast as a distributed computing platform to provide something very fast and simple, not just for programming but also for operations.”

Apache Flink-competitor Jet, which the company has licensed as per Apache 2.0, aims to perform parallel execution to enable data-intensive applications to operate in "near real-time".

Unlike Hadoop and Spark, which run from OS processes, Hazelcast Jet doesn't demand operations maintain a whole separate infrastructure. Jet can execute both batch and stream-based data processing applications, which the company believes there to be much market hunger for, especially with applications that require near real-time workloads from sensor updates in IoT architectures (house thermostats, lighting systems), through to in-store e-commerce systems as well as social media platforms.

Luck said: “Hazelcast Jet is a super fast, low latency, next generation directed acyclic graph engine for big data processing. We believe that the Hadoop and Spark ecosystems are too complex to program and to deploy and have set out to bring Hazelcast’s legendary simplicity to big data.”

“We have designed it as a general purpose engine for the intersect of big data programmers and Java programmers,” with a specific focus for existing Hazelcast users.

Hazelcast Jet is built on top of a one-record-per-time architecture (sometimes known as continuous operators), processesing incoming records as soon as possible, as opposed to accumulating records into micro-batches, consequently lowering latency for applications. Jet ingests data at high-velocity (via socket, file, HDFS or Kafka interfaces), and processes the business logic or complex computation on incoming data. ®

 

Similar topics

Similar topics

Similar topics

TIP US OFF

Send us news


Other stories you might like