ALL THE LATEST NEWS ABOUT THE VIRTUAL + AUGMENTED + MIXED REALITY BUSINESS

News

Facebook Is The Largest AI Deployment Ever

Facebook Is The Largest AI Deployment Ever

Applied Machine Learning Director Joaquin Quiñonero Candela wasted no time dropping his first AI sound bite after arriving onstage at F8, “We are taking AI out of the data centre and into the phone”. And if the tech will work on a smartphone, you can be confident that it will work in standalone VR/AR HMDs.

Candela showed a video to demonstrate that through deep learning, computers can now not only recognise every pixel in a video, but they can also identify who each pixel belongs to. He explained that this is based on Mask R-CNN - as shown by CTO Schroepfer the day before - a deep learning engine that simultaneously detects classifies and segments objects. Facebook is building a multi-modal video understanding engine that uses several AI algorithms to recognise and understand actions and words – and even translate them into other languages.

 

AI Killed The Video Star

Candela said, “The team has built a new neural network architecture that does 3D spatial temporal convolutions using time as a third dimension.” He disclosed that, “On Facebook, every day people watch over 100 million hours of video”, so it’s just as well that, “Our algorithms crunch over one billion frames of video every second”. These video understanding algorithms have been integrated into the Facebook AI platform.

AI can now understand which person every single pixel belongs to.
 

Let’s Go For Coffee

In the last year, Facebook has built a new deep learning framework called Caffe2 that has been designed to be maximally efficient both in data centres and, crucially for standalone VR/AR hardware, on the phone. If that sounds like double the workload in coding content, Candela explained that, “Developers write exactly the same code and the framework optimises it for the target architecture.” And does it work? “On the phone, we were able to speed up neural site transfer by 100 times, making it possible to run locally and in real-time.”

Facebook has made Caffe2 open-source and is building partnerships with the likes of Amazon, Intel, Microsoft, NVIDIA, and Qualcomm. As Candela said, “This is one of the world’s largest AI deployments ever”.

Editor

Steve has been a games journalist on and off since the first PlayStation made games ‘cool’, but he’s never forgotten the thrill of finding a Space Invaders machine in the wild. Neuromancer is one of his favourite books and The Matrix is one of his favourite movies, so he’s been ready for VR all his life.

Comments

No comments
View options
  • Order by latest to oldest
  • Order by oldest to latest
  • Show all replies
Important information

This site uses cookies to store information on your computer. By continuing to use our site, you consent to Steel Media's privacy policy.

Steel Media websites use two types of cookie: (1) those that enable the site to function and perform as required; and (2) analytical cookies which anonymously track visitors only while using the site. If you are not happy with this use of these cookies please review our Privacy Policy to learn how they can be disabled. By disabling cookies some features of the site will not work.