Google's new AI aims to end abusive online comments using 'Perspective'

The service is a collaboration between the tech giant and an incubator at its parent company

The internet is a tough place to have a conversation. Abuse has driven celebrities and ordinary folks from social media platforms that are ill-equipped to deal with it, and some publishers have switched off comment sections.

That’s why Google and Jigsaw (an early stage incubator at Google parent company Alphabet) are working on a project called Perspective. It uses artificial intelligence to try to identify toxic comments, with an aim of reducing them. The Perspective API released Thursday will provide developers with a score of how likely users are to perceive a comment as toxic.

In turn, that score could be used to develop features like automatic post filtering or to provide users with feedback about what they're writing before they submit it for publication. Starting on Thursday, developers can request access to Perspective's API for use in projects they're working on, and Jigsaw will approve them on a rolling basis.

Many publishers have been unwilling or unable to spend the time aggressively moderating comments on their articles and have instead opted to shut them down entirely and cede the discussion to social media platforms. The New York Times, which helped with the development of Perspective, opens comments on roughly 10 percent of its articles because of the effort needed to manually moderate them.

Google also has a vested interest in better filtering abuse. Its YouTube comment sections can get filled with vitriol, leaving online video creators to add moderation duties to their already-long list of responsibilities. Using Perspective's API to do the filtering could help alleviate that burden.

Perspective's interpretation of comments is imperfect, at best. A series of profane statements intended to forcefully express approval got flagged as likely to be toxic. The system marketed "This is some kick-ass music right here" as 85 percent similar to comments other people said were toxic, for example.

Jigsaw, for its part, acknowledges the potential problems. Perspective's website gives users a way to test out comments and provide feedback about whether or not they're toxic. The implication there is that the team will take in that feedback to help with further iterations on the abuse recognition technology.

"It's still early days and we will get a lot of things wrong," the company said on its website.

Right now, Perspective is only available in English, though it does seem to contextually understand some toxic comments in other languages. Jigsaw is taking applications from developers working in a wide variety of languages and will use that feedback to inform what Perspective will be compatible with in the future.

In addition, Jigsaw said that it plans to release additional Perspective APIs that perform other functions.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags GoogleAI

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Blair Hanley Frank

IDG News Service
Show Comments

Cool Tech

Toys for Boys

Family Friendly

Stocking Stuffer

SmartLens - Clip on Phone Camera Lens Set of 3

Learn more >

Christmas Gift Guide

Click for more ›

Brand Post

Most Popular Reviews

Latest Articles

Resources

PCW Evaluation Team

Michael Hargreaves

Microsoft Office 365/Dell XPS 15 2-in-1

I’d recommend a Dell XPS 15 2-in-1 and the new Windows 10 to anyone who needs to get serious work done (before you kick back on your couch with your favourite Netflix show.)

Maryellen Rose George

Brother PT-P750W

It’s useful for office tasks as well as pragmatic labelling of equipment and storage – just don’t get too excited and label everything in sight!

Cathy Giles

Brother MFC-L8900CDW

The Brother MFC-L8900CDW is an absolute stand out. I struggle to fault it.

Luke Hill

MSI GT75 TITAN

I need power and lots of it. As a Front End Web developer anything less just won’t cut it which is why the MSI GT75 is an outstanding laptop for me. It’s a sleek and futuristic looking, high quality, beast that has a touch of sci-fi flare about it.

Emily Tyson

MSI GE63 Raider

If you’re looking to invest in your next work horse laptop for work or home use, you can’t go wrong with the MSI GE63.

Laura Johnston

MSI GS65 Stealth Thin

If you can afford the price tag, it is well worth the money. It out performs any other laptop I have tried for gaming, and the transportable design and incredible display also make it ideal for work.

Featured Content

Product Launch Showcase

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?