Boffins fill a dome with 480 cameras for 3D motion capture

'Panoptic studio' doesn't need no stinkin' sensors


Video Move over Gollum: Carnegie-Mellon boffins are working on 3D motion capture that works without tracking sensors, and can pull together images from hundreds of sensors.

Their work, documented in full here, goes way beyond the motion capture tricks that let Peter Jackson give Gollum and King Kong to the world: they put their subject inside a geodisic dome, and capture their movements with 480 cameras.

With that many input images plus the ability to identify thousands of tracking points in any given image, the system is able to work with 100,000 points at a time without markers, and track those through hundreds of frames. Since a lot of that ends up as noise, a big chunk of the smarts of the system exists to decide what to include and what to exclude from the final capture.

The university says the two-story dome – the Panoptic Studio – has been used to capture activities as diverse as volleyball games, air currents and “a cascade of confetti”.

To eliminate data that doesn't need to be included, the software estimates visibility based on cues from motion. The system tries to identify patterns it can use as tracking points, and for each point, “the system then seeks to determine which cameras see motion that is consistent with that point”.

Carnegie-Mellon's Panoptic Studio

Carnegie-Mellon's Panoptic Studio

Hence if a tracking point becomes invisible to a particular camera, the input from that camera can be ignored (incidentally reducing the processing load on the system).

The MAP – maximum a posteriori – system “increases tracking performance producing longer trajectories, at more locations, and at higher accuracies than methods that ignore visibility or use photometric consistency alone”, the researchers write in their paper.

A bat swing captured by MAP

The swing of a baseball bat, reconstructed by MAP

The Register imagines at least one possible application that will have game studios keenly interested in the technology. Outside the dome, the researchers speculate that the system could be applied to motion capture on an even larger scale. For example, hundreds of camera-phones capturing live sports could become the input images to MAP, rather than the controlled environment of the Panoptic Studio. ®

Youtube Video


Keep Reading

Disney signs on with Microsoft, SQLCMD arrives in Data Studio and Azure goes German

Roundup Heigh-ho, Heigh-ho, it's off to test we go...

If you want to take social distancing to the next level, and go to the Moon, take this: A complete lunar geology map

Video First-of-its-kind blueprint of materials and structures shared online

Microsoft kills broad entry-level IT certifications, replaces them with all-Microsoft curriculum

‘Technology Associate’ exams that taught general skills like Python, HTML and Java are on the way out. No refunds offered

One map to rule them all: UK's Ordnance Survey rolls out its Data Hub and the juicy API goodness that lies therein

It's free too – until you've burned through £1,000 worth of data, that is

NASA's hefty Martian rover will use an AI brain on a robot arm to map out signs of ancient life on Red Planet

The tiny X-ray bullets are only the size of a grain of sand. Pew! Pew! Pew!

Peek inside this fascinating effort to map Britain's subterranean tubes – a deep sprawl of unrecorded infrastructure beneath our feet

Register Lecture Join the Ordnance Survey in a cosy pub for the Reg's February lecture

India launches e-government platform for 125,000 villages and drone land surveys to put them on the map

Hello, expanded tax base and access to capital! Farewell, land ownership disputes

Microsoft giveth and Microsoft taketh away: Certification renewals to be free ... but annual

'Rigorous' exam first, then take a freebie assessment once a year from home

Tech Resources

Webcast Slide Deck | How backup modernization changes the ransomware game

If the thrill of backing up your data and wondering if you will ever see it again has worn off, start the new year by getting rid of the lingering pain of legacy backup. Bipul Sinha, CEO of the Cloud Data Management Company, Rubrik, and Miguel Zatarain, Director of Global Infrastructure Technology at PACCAR, Fortune 500 manufacturer of trucks and Rubrik customer, are talking to the Reg’s Tim Phillips about how to eliminate the costly, slow and spotty performance of legacy backup, and how to modernize your implementation in 2021 to make your business more resilient.

What WAF is right for you

Applications are architected in many ways, but all need protection from threats. Learn the most important things to consider when choosing a WAF.

Three reasons you need a hybrid multicloud

Businesses need their IT teams to operate applications and data in a hybrid environment spanning on-premises private and public clouds. But this poses many challenges, such as managing complex networking, re-architecting applications for the cloud, and managing multiple infrastructure silos. There is a pressing need for a single platform that addresses these challenges - a hybrid multicloud built for the digital innovation era. Just this Regcast to find out: Why hybrid multicloud is the ideal path to accelerate cloud migration.

Top 20 Private Cloud Questions Answered

Download this asset for straight answers to your top private cloud questions.

Biting the hand that feeds IT © 1998–2021