It seems like for every feel-good story or picture of a puppy playing with a kitten, there are 1,000 trolls rummaging through the depths of their minds to post the most vile comments they can imagine.
The web may be a harsh place.And if youre a woman or person of color, well, multiply that troll army by 10.
But hey, thats the internet, right? apart from it doesnt have to be that way.And it might not be for much longer if the folks at Google(google.com) subsidiary Jigsaw have their way.A kind of high-powered startup inside Googles parent company Alphabet, Jigsaw focuses on how technology can defend international human rights.
The toxicity of trolls
The companys latest effort is called the Perspective API.Available Thursday, Feb.23,Perspective is the result ofJigsaws Conversation AI projectanduses Googles machine learning technologies to provide online publishers with a tool that can automatically rank comments in their forums and comments sections based on the likelihood that they will cause someone to leave aconversation.Jigsaw refers to this as a toxicity ranking.
At its core, Perspective is a tool that simply takes a comment and returns back this score from 0 to 100 based on how similar it is to things that other people have told that are toxic, explained product manager CJ Adams.
Jigsaw doesnt become the arbiter of what commenters can and cant say in a publishers comment section, though.Perspectiveis only a tool that publishers use as they see fit.For instance, they can give their readers the ability to filter comments based on their toxicity level, so theyll only see non-toxic posts.Or the publisher could provide a kind of feedback mechanism that tells you if your comments are toxic.
The tool wont stop you from submitting toxiccomments, but it will provide you with the nudge to rethink what youre writing.
Perspective isnt just a bad word filter, though.Googles machine learning truly gives the tool the ability to know context.So it will eventually be able to tell the difference between telling someone a vacuum cleaner can truly suck and that they suck at life.
Perspective still makes mistakes, as I witnessed during a brief demo.But the more comments and information its fed, the more it can learn about how to improved understand the nuances of human communication.
Jigsaws global efforts
In its little over a year of existence, Jigsaw has implemented a series of projects designed to improve the lives of internet users about the world.Project Shield, for example,is a free service that protects news websites from distributed denial of service (DDoS) attacks.Redirect Methoduses Adwords targeting tools to help refute ISIS online recruitment messages, whileMontage helps researchers sort through thousands of hours of YouTube(youtube.com) videos to find evidence of potential war crimes.
We wake up and come to work everyday to test to find ways to use technology to create people around the world safer, Jigsaw President Jared Cohen said. We are at this nexus between international security and business.
Cohensaid Jigsaws engineers travel around the world to meet with internet users vulnerable to harassment and other online-based rights abuses, such as individuals promoting free speech or opposingauthoritarian regimes, to understand their unequaled challenges.And one of the biggest problems, Cohen explained, has been online harassment.
Trolls arent always just cruel
Dealing with trolls is par for the course in the US.But in other countries, harassment in comment sections and forums can have political implications.
In lots of parts of the world where we spend time [harassment] takes on a political motivation, sectarian motivation, ethnic motivation and its all sort kind of heightened and exacerbated, Cohen explained.
But with Perspective, Jigsaw can start to cut down on those forms of harassing comments, and bring more people into online conversations.
Our goal is to get as many people to rejoin conversations as possible and also to get people who everyday are sort of entering the gauntlet of toxicity to have an opportunity to see that environment improve, said Cohen.
The path to a better internet?Read More
Jigsaw is already working with The New York Times and Wikipedia to improve their commenting systems.At The New York Times, the Perspective API is being used to let The Gray Lady enable more commenting sections on its articles.
Prior to using Perspective, The Times relied on employees to manually keep reading and filter comments from the papers online articles.As a result, just 10% of stories could have comments activated.The Times is using Perspective to create an open source tool that will help reviewers run through comments more fast and open up a larger number of stories to comments.
Wikipedia, meanwhile, has been using Perspective to detect personal attacks on its volunteer editors, something Jigsaw and the online encyclopedia recently published a paper on.
With the
releaseAnnounce
of Perspective, publishers and developers around the world can take advantage of GoogleTechnology company
technologies to improve their users experiences.And the conversation filtering wont just stop hateful comments.Cohen said the company is also working to provide publishers and their readers with the ability to filter out comments that are off-topic or generally dont contributeto conversations.If Perspective takes off, and a number of publications end up using the technology, the internet could one day have far fewer trolls lurking in its midst.
More from Dan:
The coolest tech toys from Toy Fair 2017Everything we know about the next
iPhonecellular phone made by Apple
so farDell XPS 13 2-in-1 review: The best laptopusually called a notebook computer by manufacturers
around learns a new trickSamsungs Chromebook Pro is the best Chromebook yet5 ways criminals will try to scam you this tax seasonSymantec CEO: Its a new theater of war for cybercriminalsEmail Daniel at dhowley@yahoo-inc.com; follow him on Twitter(twitter.com) at @DanielHowley.
