Facebook taps deep learning for customized feeds

The social network does machine learning one better, applying advanced computer learning techniques to cater to users' interests

Serving more than a billion people a day, Facebook has its work cut out for it when providing customized news feeds. That is where the social network giant takes advantage of deep learning to serve up the most relevant news to its vast user base.

Facebook is challenged with finding the best personalized content, Andrew Tulloch, Facebook software engineer, said at the company’s recent @scale conference in Silicon Valley. “Over the past year, more and more, we’ve been applying deep learning techniques to a bunch of these underlying machine learning models that power what stories you see.”

Applying such concepts as neural networks, deep learning is used in production in event prediction, machine translation models, natural language understanding, and computer vision services. Event prediction, in particular, is one of the largest machine learning problems at Facebook, which must serve the top couple of stories out of thousands of possibilities for users, all in a few hundred milliseconds. “Predicting relevance in and of itself is a very challenging problem in general and relies on understanding multiple content modalities like text, pixels from images and video, and the social context,” Tulloch said.

The company must also deal with content posted in more than 100 languages daily, thus complicating classic machine learning, Tulloch said. Text must be understood at a deep level for proper ranking and display. In its deep learning efforts, Facebook has gone with its DeepText text understanding engine, which reads and understands users’ posts and has been open-sourced in part.

In addition, Facebook must account for visual content. “The real challenge is to understand the content of photos and videos from just the pixels because that’s all a computer sees,” Tulloch noted. High-level understanding of content helps Facebook surface visual memories. But deep learning has pushed the state of the art forward in computer vision tasks, Tulloch said, including with classifying videos.

Also deployed is convolution, which takes images and tries to apply filters to identify patterns, to help with high-level semantic understanding, said Yangqing Jia. Facebook has worked to optimize convolution. Still, deep learning is a very generic technique in general, Tulloch said. A lot of approaches to it transfer cleanly across domains.

Join the newsletter!

Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection
Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Paul Krill

InfoWorld
Show Comments

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Ratchada Dunn

Sharp PN-40TC1 Huddle Board

The Huddle Board’s built in program; Sharp Touch Viewing software allows us to easily manipulate and edit our documents (jpegs and PDFs) all at the same time on the dashboard.

George Khoury

Sharp PN-40TC1 Huddle Board

The biggest perks for me would be that it comes with easy to use and comprehensive programs that make the collaboration process a whole lot more intuitive and organic

David Coyle

Brother PocketJet PJ-773 A4 Portable Thermal Printer

I rate the printer as a 5 out of 5 stars as it has been able to fit seamlessly into my busy and mobile lifestyle.

Kurt Hegetschweiler

Brother PocketJet PJ-773 A4 Portable Thermal Printer

It’s perfect for mobile workers. Just take it out — it’s small enough to sit anywhere — turn it on, load a sheet of paper, and start printing.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?