Facebook AI turns friends into controllable game characters

Must Read

President Ram Nath Kovind appoints new governor for Kerala, Telangana, Himachal Pradesh and Maharashtra

President Ram Nath Kovind appointed new governors for Maharashtra, Kerala, Telangana, Rajasthan, and Himachal Pradesh on Sunday. https://twitter.com/ANI/status/1168037199767457792 Former Union Minister Kalraj...

NRC list for Assam released; Fear looms as 19 lakh people face exclusion

NRC (National Register of Citizens) for Assam has been published at 10 am today. The final list excludes over...

Lateral Entry Era Begins as Union govt. appoints 9 professionals to Joint Secretary posts

The government has appointed its first batch of private professionals to the post of Joint Secretary in various ministries....
Saurabh Joshi
Hey Guys!!! I am a regular Content Writer here and I bring to you the latest and the hottest Tech related news and blogs. I hope you enjoy reading my content and are learning something new everyday. Thanks and have a nice day!!!

A team of AI researchers at Facebook have published a paper earlier this week describing a technique to extract playable characters from real-world videos.

Facebook’s AI Research team has created an AI called Vid2Play that can extract playable characters from videos of real people, creating a much higher-tech version of ’80s full-motion video (FMV) games like Night Trap. The neural networks can analyze random videos of people doing specific actions, then recreate that character and action in any environment and allow you to control them with a joystick.

Two different neural networks were trained on the footage, just five to eight minutes in length, of someone performing a specific action, like playing tennis. The first network, Pose2Pose, analyze the footage and extracts the person who’s going through the motions. The second network, Pose2Frame, then transfers all the elements of that person, including shadows and reflections they’re creating, and then overlays it onto a new background setting, which could be a rendered video game locale.

The results aren’t quite as smooth or fluid as the detailed 3D video game characters modern consoles can generate, but they are completely controllable. As this research evolves the results will undoubtedly improve, but a hybrid approach might be even better. The AI could extract characteristics of someone in a video, including the nuances of how they move, and automatically apply them to a custom 3D character, saving players from painstakingly have to make hundreds of tweaks themselves. It won’t be useful for just video games, though, as the world moves towards more virtual reality experiences (remember, Facebook owns Oculus) it would make creating believable avatars of ourselves much easier. Your friend could shoot a smartphone video of you dancing for a few seconds, and a few minutes later you’d appear just as awkward in a virtual world.


Please enter your comment!
Please enter your name here

- Advertisement -

Latest News

SL issues landslide warnings amidst heavy rains

Colombo, Sep 16 (IANS) Sri Lanka on Monday issued landslide warnings for several districts of the island nation after...

Two Americans held for flying drone over Rashtrapati Bhawan

By Sanjeev Kumar Singh ChauhanNew Delhi, Sep 16 (IANS) Intelligence agencies and Delhi Police scrambled into action after they were alerted about a drone...

Ronaldo breaks down during emotional interview

New Delhi, Sep 16 (IANS) Star footballer Cristiano Ronaldo recently broke down in tears after he was shown footage of his late father which...

Mugabe’s body to be taken to rural home

Harare, Sep 16 (IANS) The body of former Zimbabwe President Robert Mugabe, who died in Singapore on September 6, is scheduled to be brought...

ED slaps Rs 230 cr fine on PwC for FEMA violations

New Delhi, Sep 16 (IANS) The Enforcement Directorate's (ED) adjudicating authority slapped a Rs 230.40 crore penalty for the Foreign Exchange Management Act (FEMA)...
- Advertisement -

More Articles Like This