HPC

Terror plot spy project helps Kinetica crank up database speed

Ingest billions of records per minute with no indigestion


HPC blog Kinetica presented its in-memory database solution at the recent OpenPOWER European Summit in Barcelona, and served up some benchmark results. You can see the entire presentation in the video below, but here are a few highlights.

First, for those of you unfamiliar with Kinetica, the company came out of a US military research project that aimed to identify terrorist types before they could strike. The problem was that it could take 90 minutes or more to comb through a mass of data and provide actionable intelligence on a specific target individual.

The founder of what eventually became Kinetica solved this problem by rewriting the database to run in memory and to use the latest accelerators. The end result is a blazingly fast database that can deliver intelligence in near real time.

While the solution runs on x86, it runs particularly well on the OpenPOWER platform, due to its new NVLink GPU interface. So how fast are we talking? Here are a couple of examples:

On a BoundingBox for one billion records, Kinetica was 561 times faster than MemSQL & NoSQL

On a Min/Max with one billion records, Kinetica was 712x faster than MemSQL & NoSQL

For SQL queries using 30 Kinetica OpenPOWER nodes versus 100+ x86 nodes running SAP HANA with 150 billion rows, Kinetica turned in near sub-second results compared with 13 seconds for HANA on a SELECT, 45 seconds for a HANA JOIN, and 35 seconds for a GROUP BY query. That’s pretty sporty.

Youtube Video

Check out the video for more details on Kinetica's benchmark results, and more about its OpenPOWER Foundation (Rebel Alliance) involvement. ®


Keep Reading

Business intelligence vendor MicroStrategy reveals it’s bought a billion bucks of bitcoin

Better capital returns than cash and all allowed under company rules

US cyber intelligence officer jailed for kidnapping her kid, trying to hawk top secrets to Russia in Mexico

How's your year going?

Does a national Digital Intelligence Unit sound a bit sinister? India's new one will co-ordinate action on SMS scams

Maybe it can use the spatial data that India also liberalised yesterday to deliver promise of unplugging rogue operators

Iran sent threatening pro-Trump emails to American Democrats, Russia close behind, says US intelligence

Updated No, say it ain't so, maga_christ9000@post.ir

US gov sets up the National Artificial Intelligence Initiative Office at the last minute before Trump's presidency ends

In brief Plus: Google trains 1.6-trillion-parameter AI model, popular software used for job screenings scraps facial-recognition feature

US senators: WikiLeaks 'likely knew it was assisting Russian intelligence influence effort' in 2016 Dem email leak

And: 'Putin ordered the Russian effort to hack computer networks' to help Donald Trump win White House race

Watch: Rare Second World War footage of Bletchley Park-linked MI6 intelligence heroes emerges, shared online

Vid A glimpse of life at Whaddon Hall

Amazon's not saying its warehouse staff are dumb... but it feels they need artificial intelligence to understand what 'six feet' means

Vid The yellow markings on the floor aren't enough for real neural networks

Biting the hand that feeds IT © 1998–2021