Facebook Developers Push AI to New Limits: Making Games out of a Video in Coming Years!

The future is going to be AI based. All aspects of life point to that direction, honestly. While some jobs are very important today, AI will make them redundant quite soon. Take brokers, for example. The art of predicting stock market changes, drawing up Random Walks for stocks, that would be the thing of the past. AI-based systems would do that on their own, more efficiently even. Just like that, there are more applications to them as well. Recently, we have seen Snapchat and Instagram filters. While that was another innovative application of the technology, a couple of developers at Facebook have a different idea.

They have applied Pose2Frame and Pose2Pose to form Vid2Game. Perhaps a good way to explain it will be to first show a demonstration, as seen in a report on WCCFTECH:

How it Works

Now that you have an idea of what it is, let us elaborate it further. What it would do is take a specific subject from a video and the Pose2Pose part of network analyses the 2D image, making a map out of it. Then the map is used by the Pose2Frame network to impose the object onto any background.

While this is purely in a developmental phase, there can be many applications to this. Purely enough, this could be a revival for facebook games. Imagine, scanning a video and then being able to play as yourself, for example, in a tennis match. While this may seem similar to what Kinect did or what you could do with your face on a Nintendo Wii, it is not. They merely imprinted an RGB signal onto the digital character. This uses AI to smartly form a 2D architecture from the target video to make a new surrounding for it, all poses being recorded and then, eventually changing (which weren’t in the video).

While this is an amazing idea, there is still much work to be done on it. Not only that, its application would take even more time and if you’re looking to see this by this year’s end or even the next year, well, sorry to burst your bubble. What is most exciting is the fact that there can be even more applications for the technology. Imagine, making your own games. How cool would be that? To further understand the physics behind this all, refer to this paper.

Sarmad Burki
Sarmad Burki is a Mathematician and a Economist with a passion for all things gaming and tech. His academics and professional experience combined with tech and gaming adds to his skills giving him a unique ability to observe the tech and gaming industry from various prespectives.