Facebook doesn't just want its AI-trained bots to know how humans speak--it wants them to understand our faces,Sister too.
In a newly published paper, the company's AI researchers detail their efforts to train a bot to mimic human facial expressions during a conversation.
SEE ALSO: Let's all take a deep breath and stop freaking out about Facebook's bots 'inventing' a new languageThe researchers trained the bots using a series of YouTube videos of people having Skype conversations where each participant's face was clearly visible. They then used these videos as training data for their AI system.
Notably, the researchers didn't teach the bot to recognize a particular type of expression, or the emotions associated with them, like "happy" or "sad." Instead, they trained the system to recognize subtle patterns in users' faces. These patterns, sometimes referred to as "micro expressions," tend to be similar in everyone, even though our faces may look very different.
The image below shows the type of patterns the system learned to recognize.
By learning these patterns, the system was able to predict which expressions looked more human-like. The researchers tested out their bot's newfound abilities using human judges who were asked whether they believed the bot's animated expressions were believable.
The researchers don't delve into specific practical applications for their method, though they note that human-bot interactions are most effective when people are engaged with the "agent" (research speak for robot) they are interacting with.
Now, Facebook isn't making a humanoid robot -- that we know about at least -- but it's not difficult to imagine this type of research impacting other areas Facebook hasinvested in, like virtual reality, though the researchers don't address this particular use case.
The company has made big investments in social applications for virtual reality, including one called Facebook Spaces, which allows participants to interact with each other's avatars in a virtual environment. Their latest research could perhaps one day have implications on Facebook's efforts to improve avatars in VR.
The research is still in its early days for now, but the scientists say they hope their work will inspire more groups to look at similar situations. You can read their full paper here.
Topics Artificial Intelligence Facebook Social Media
All the TVs at CES that won't ruin your interior decorRing admits its employees tried to access customers' private videoJoe Biden met a puppy named Biden and for a moment, the entire world stoppedBuy the latest iPhone, get $700 off a second one with Verizon’s 2020 smartphone dealUberEATS is delivering alcohol now, but probably not in the way you were hopingAdele freaks out midThe Oscars will once again go without a host at the 2020 ceremonyIgnore the claim that streaming Netflix ‘makes climate change worse’5 cool CES products you can get your hands on in 2020Adele freaks out midPrince Charles posts rare video message to Australians affected by bushfire crisisElizabeth Warren is Team Baby Yoda, duhTwo guys trespassing an NBA player's yard is now a judgmental memeTrump driving a truck becomes the internet's new favorite metaphor for AmericaThe Tesla of motorcycles probably doesn't have to worry about TeslaFacebook redesign with dark mode rolls out for some usersAmericans are eating less beef. Here's why that matters for climate changeFunny or Die takes on the absurdity of rape kit testing in '80s spoofSerena Williams and Roger Federer to play in Australian bushfire charity matchYoungest Ed Sheeran fan immediately stops crying at sound of 'Shape of You' Comet caught strangely zigzagging its way through space Shop new Animal Crossing and Super Mario sets on Amazon and Lego Store 'House of the Dragon' Season 2 finale: What is Sharp Point, and why does Aemond burn it? Simone Biles shades former Olympic teammate MyKayla Skinner in Instagram caption France vs. Argentina livestream: Watch Paris 2024 football for free Play it loud: the 25 best music documentaries on Netflix Alcaraz Paris 2024 livestream: Watch live tennis for free WNBA 2024 livestream: How to watch WNBA for free from anywhere in the world 800m final Paris 2024 livestream: Watch live athletics for free Intel will lay off at least 15,000 employees Morocco vs. USA livestream: Watch Paris 2024 football for free 400m final Paris 2024 livestream: Watch live athletics for free Why the Google Gemini Olympics ad failed Reddit wants Microsoft to pay up if its search engine wants to crawl the platform 400m men hurdles final Paris 2024 livestream: Watch live athletics for free Wordle today: The answer and hints for August 1 Murray Paris 2024 livestream: Watch Andy Murray for free Contestants of MrBeast's Amazon show allege unsafe conditions during filming Japan vs. Spain livestream: Watch Paris 2024 football for free Scientists devised an unexpected use for the moon. It's a vault.