Facebook brews Caffe2 AI toolkit so apps can give SnapChat a slap

Need some code to alter pics and whack some stickers and be worth billions?


F8 2017 Facebook has open sourced Caffe2, the toolbox of deep-learning software its own developers use to train AI models and build apps.

Caffe2 appears to be product driven, and is geared towards deploying machine-learning systems into smartphone applications and onto large-scale clusters. It differs from PyTorch, another software framework from Facebook that is more research oriented as it allows programmers to experiment with different neural network architectures more easily.

Using AI in production is tricky, and Caffe2, written in a mix of Python and C++, tries to alleviate the pain.

Facebook has been working with Nvidia to integrate Caffe2 into the graphics chip giant's deep-learning developer libraries so the framework can take advantage of hardware acceleration on Nv's GPUs. We're told, for example, Caffe2 is nippy on Facebook’s Big Basin OpenCompute AI servers that pack 64 Nvidia Tesla P100 GPUs. Intel, Microsoft and Amazon have also stepped up to make sure Caffe2 is optimized for their systems and services.

Meanwhile, Qualcomm’s Neural Processing Engine (NPE) software development kit supports Caffe2 and Google’s TensorFlow. This library glues software to the neural network math unit built into its top-end Snapdragon 835 system-on-chip, which is appearing in smartphones, tablets and notebooks this year. Code using the engine will therefore gain a performance boost via the on-chip acceleration. The NPE dev kit will be available in July.

It’s a sensible move, considering Qualcomm designs chips used in millions and millions of Android devices, and Facebook is investing heavily in augmented reality, a technology that will manipulate photos and video taken with smartphones. That's going to require some machine-learning processing to identify objects and meddle with them – hence the marriage between Caffe2, Qualcomm, and Facebook.

And, hey, if that means developers using Facebook's tech to produce apps to rival SnapChat – the image-fiddling toy that's cool with the kids and in the way of Mark Zuckerberg's world domination plans – so much the better.

“Augmented reality is going to help us mix the digital and physical in all new ways and that's going to make our physical reality better," Facebook CEO Zuckerberg told his social network's F8 conference in Silicon Valley on Tuesday.

Caffe2 doesn't just add cartoon doodles over images. It's hoping to be more general purpose, allowing developers to create chatbots, hook up IoT devices, use machine translation and speech, and image classification algorithms for medical applications.

Caffe, a predecessor of Caffe2, was developed by Yangqing Jia while he was a PhD student at the University of California, Berkeley. Jia is now a research scientist and leads Facebook’s efforts in building a general platform for its AI applications. ®


Other stories you might like

  • Google engineer suspended for violating confidentiality policies over 'sentient' AI
    Blake Lemoine began to believe that LaMDA, Language Model for Dialogue Applications, exhibited self-awareness

    Google has placed one of its software engineers on paid administrative leave for violating the company's confidentiality policies.

    Since 2021, Blake Lemoine, 41, had been tasked with talking to LaMDA, or Language Model for Dialogue Applications, as part of his job on Google's Responsible AI team, looking for whether the bot used discriminatory or hate speech.

    LaMDA is "built by fine-tuning a family of Transformer-based neural language models specialized for dialog, with up to 137 billion model parameters, and teaching the models to leverage external knowledge sources," according to Google.

    Continue reading
  • Facebook phishing campaign nets millions in IDs and cash
    Hundreds of millions of stolen credentials and a cool $59 million

    An ongoing phishing campaign targeting Facebook users may have already netted hundreds of millions of credentials and a claimed $59 million, and it's only getting bigger.

    Identified by security researchers at phishing prevention company Pixm in late 2021, the campaign has only been running since the final quarter of last year, but has already proven incredibly successful. Just one landing page - out of around 400 Pixm found - got 2.7 million visitors in 2021, and has already tricked 8.5 million viewers into visiting it in 2022. 

    The flow of this phishing campaign isn't unique: Like many others targeting users on social media, the attack comes as a link sent via DM from a compromised account. That link performs a series of redirects, often through malvertising pages to rack up views and clicks, ultimately landing on a fake Facebook login page. That page, in turn, takes the victim to advert landing pages that generate additional revenue for the campaign's organizers. 

    Continue reading
  • Photonic processor can classify millions of images faster than you can blink
    We ask again: Has science gone too far?

    Engineers at the University of Pennsylvania say they've developed a photonic deep neural network processor capable of analyzing billions of images every second with high accuracy using the power of light.

    It might sound like science fiction or some optical engineer's fever dream, but that's exactly what researchers at the American university's School of Engineering and Applied Sciences claim to have done in an article published in the journal Nature earlier this month.

    The standalone light-driven chip – this isn't another PCIe accelerator or coprocessor – handles data by simulating brain neurons that have been trained to recognize specific patterns. This is useful for a variety of applications including object detection, facial recognition, and audio transcription to name just a few.

    Continue reading
  • IBM AI boat to commemorate historic US Mayflower voyage finally lands… in Canada
    Nearly two years late and in the wrong country, we welcome our robot overlords

    IBM's self-sailing Mayflower Autonomous Ship (MAS) has finally crossed the Atlantic albeit more than a year and a half later than planned. Still, congratulations to the team.

    That said, MAS missed its target. Instead of arriving in Massachusetts – the US state home to Plymouth Rock where the 17th-century Mayflower landed – the latest in a long list of technical difficulties forced MAS to limp to Halifax in Nova Scotia, Canada. The 2,700-mile (4,400km) journey from Plymouth, UK, came to an end on Sunday.

    The 50ft (15m) trimaran is powered by solar energy, with diesel backup, and said to be able to reach a speed of 10 knots (18.5km/h or 11.5mph) using electric motors. This computer-controlled ship is steered by software that takes data in real time from six cameras and 50 sensors. This application was trained using IBM's PowerAI Vision technology and Power servers, we're told.

    Continue reading

Biting the hand that feeds IT © 1998–2022