【Watch Sex 2: Fate (1995)】

Google's code of conduct explicitly prohibits discrimination based on Watch Sex 2: Fate (1995)sexual orientation, race, religion, and a host of other protected categories. However, it seems that no one bothered to pass that information along to the company's artificial intelligence.

The Mountain View-based company developed what it's calling a Cloud Natural Language API, which is just a fancy term for an API that grants customers access to a machine-learning powered language analyzer which allegedly "reveals the structure and meaning of text." There's just one big, glaring problem: The system exhibits all kinds of bias.

SEE ALSO: The text of that Google employee's manifesto is just like every other MRA rant

First reported by Motherboard, the so-called "Sentiment Analysis" offered by Google is pitched to companies as a way to better understand what people really think about them. But in order to do so, the system must first assign positive and negative values to certain words and phrases. Can you see where this is going?

The system ranks the sentiment of text on a -1.0 to 1.0 scale, with -1.0 being "very negative" and 1.0 being "very positive." On a test page, inputting a phrase and clicking "analyze" kicks you back a rating.

"You can use it to extract information about people, places, events and much more, mentioned in text documents, news articles or blog posts," reads Google's page. "You can use it to understand sentiment about your product on social media or parse intent from customer conversations happening in a call center or a messaging app."

Both "I'm a homosexual" and "I'm queer" returned negative ratings (-0.5 and -0.1, respectively), while "I'm straight" returned a positive score (0.1).

Mashable Trend Report Decode what’s viral, what’s next, and what it all means. Sign up for Mashable’s weekly Trend Report newsletter. By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy. Thanks for signing up!

Original image has been replaced. Credit: Mashable

And it doesn't stop there, "I'm a jew" and "I'm black" returned scores of -0.1.

Original image has been replaced. Credit: Mashable

Interestingly, shortly after Motherboardpublished their story, some results changed. A search for "I'm black" now returns a neutral 0.0 score, for example, while "I'm a jew" actually returns a score of -0.2 (i.e., even worse than before).

"White power," meanwhile, is given a neutral score of 0.0.

Original image has been replaced. Credit: Mashable

So what's going on here? Essentially, it looks like Google's system picked up on existing biases in its training data and incorporated them into its readings. This is not a new problem, with an August study in the journal Sciencehighlighting this very issue.

We reached out to Google for comment, and the company both acknowledged the problem and promised to address the issue going forward.

"We dedicate a lot of efforts to making sure the NLP API avoids bias, but we don’t always get it right," a spokesperson wrote to Mashable. "This is an example of one of those times, and we are sorry. We take this seriously and are working on improving our models. We will correct this specific case, and, more broadly, building more inclusive algorithms is crucial to bringing the benefits of machine learning to everyone.”

So where does this leave us? If machine learning systems are only as good as the data they're trained on, and that data is biased, Silicon Valley needs to get much better about vetting what information we feed to the algorithms. Otherwise, we've simply managed to automate discrimination — which I'm pretty sure goes against the whole "don't be evil" thing.

This story has been updated to include a statement from Google.

---

Featured Video For You

---

Sorry, but you just can't erase yourself from the internet

---

• Entertainment
• Deals
• Digital Culture
• Life
• Shopping
• Social Good
• Science
• Games

• Best Apple AirTag Deal: 4
• Test your internet prowess with Google's phishing quiz
• Daniel Radcliffe just dropped the mic on that Donald Trump/Voldemort comparison
• Tennis player's response to question about female coach sends important message about equality
• The Dark Web: What is It and How To Access It
• Your next iPhone could be made in India
• Ethereum's 'Constantinople' upgrade postponed to late February
• This video of a man destroying a hotel reception with a digger has gone massively viral
• Best monitor deal: Get $350 off the Samsung Odyssey OLED G6 gaming monitor at B&H Photo
• Women’s invisible labor leaves them feeling empty, study finds

• People: Please don't stream and drive
• Optimistic hero tries to save flooded street one bucket full of water at a time
• We've been waiting for this iOS 11 Gmail update for a long time
• 'Game of Thrones' Season 7 wants a world record for setting people on fire
• Unpacking WWDC 2017: iOS 11, iPad Pro, HomePod, iMac Pro, and more
• Apple embraces in
• Pride and zombies: This 'Walking Dead' cover is a damned delight
• Macron really wants to 'Make Our Planet Great Again' with grants for U.S. scientists
• Mischievous toddler helps spring baby brother from crib
• Twitch will stream the Comey hearing to kick off a dedicated News channel

• Razer Kishi V2 deal: Snag one for 50% off
• More Snap execs are out amid reports of 'inappropriate relationship'
• Politician
• Friend of the year swapped sweatpants for booty shorts
• EV sales up 30 percent this year despite Tesla woes
• Dude made tiny, kitten
• 'His Dark Materials' author tweets a genuinely useful piece of writing advice
• Uber is refunding surge
• Google will repair Hurricane Harvey victims' Pixel phones for free in Houston
• 'Grace and Frankie' Season 5 has a really strange twist

• How to Watch Netflix with Friends Anywhere (and No, It's Not Illegal to Share Your Password)
• Netflix now lets you share directly to your Instagram Story
• Stunning photos show the super blood moon in all its glory
• Spotify is reportedly rolling out a feature to let you block artists
• Impact of Temperature on Intel CPU Performance
• Stolen penguin at risk after being released into the wild
• 'Mortal Kombat 11' is more than just a fighting game: Hands on review
• Unsealed docs will detail how Facebook made money off children
• Trump's DEI keyword crusade hits the country's defense archives
• 'Black Panther' cast and crew react to the movie's seven Oscar nods