Facebook's text understanding AI is coming to a phone near you

FastText update brings text understanding to lower-powered devices

Developers have a new tool to help mobile apps understand text, thanks to a Facebook open source project update on Tuesday. The social networking company’s AI research group released a new version of FastText, a programming library that’s designed to make it easier for developers to deploy text-focused machine learning systems.

Using a technique the researchers are calling FastText.zip, developers can compact a language recognition model so that it takes up two orders of magnitude less memory while maintaining much of the accuracy they would get out of a non-compacted model. It’s a move that allows those models to be deployed on less powerful devices like smartphones and Raspberry Pis, making them more useful for a broader variety of applications.

In addition, Facebook released a pair of tutorials designed to help developers get started using FastText. The team also released a set of almost 300 pre-trained language sets to simplify matters further.

The goal behind FastText is to make it easier for people with a light background in programming to do text classification, (the process of assigning a block of words into a set of categories) and text representation (the process of turning unstructured text into numbers for computation).

“That was the idea behind the library — to make it a very accessible library for any text-related machine learning problems,” Facebook Research Scientist Armand Joulin said.

What makes FastText special is that the team building it at Facebook is focused on taking existing techniques and making them more accessible to everyday developers, so that it’s easier for people without a PhD in data science to implement machine learning in their apps.

For example, FastText can be used to power features like hashtag autocompletion, so that users can more quickly insert relevant tags into social media posts. It can also help with sentiment analysis, so that applications can understand whether users are saying something positive or negative.

FastText was also specifically built to handle a wide variety of languages, according to Edouard Grave, a postdoctoral fellow at Facebook. In particular, he said that it could handle languages like German and French that might cause problems for other systems.

Join the newsletter!

Or
Error: Please check your email address.
Rocket to Success - Your 10 Tips for Smarter ERP System Selection

Tags Facebook

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Blair Hanley Frank

IDG News Service
Show Comments

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Andrew Teoh

Brother MFC-L9570CDW Multifunction Printer

Touch screen visibility and operation was great and easy to navigate. Each menu and sub-menu was in an understandable order and category

Louise Coady

Brother MFC-L9570CDW Multifunction Printer

The printer was convenient, produced clear and vibrant images and was very easy to use

Edwina Hargreaves

WD My Cloud Home

I would recommend this device for families and small businesses who want one safe place to store all their important digital content and a way to easily share it with friends, family, business partners, or customers.

Walid Mikhael

Brother QL-820NWB Professional Label Printer

It’s easy to set up, it’s compact and quiet when printing and to top if off, the print quality is excellent. This is hands down the best printer I’ve used for printing labels.

Ben Ramsden

Sharp PN-40TC1 Huddle Board

Brainstorming, innovation, problem solving, and negotiation have all become much more productive and valuable if people can easily collaborate in real time with minimal friction.

Sarah Ieroianni

Brother QL-820NWB Professional Label Printer

The print quality also does not disappoint, it’s clear, bold, doesn’t smudge and the text is perfectly sized.

Featured Content

Product Launch Showcase

Latest Jobs

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?