Your new post is loading...
Researchers have taken another step towards realistic, synthesized video. The team, made up of scientists in Germany, France, the UK and the US, used AI to transfer the head poses, facial expressions, eye motions and blinks of a person in one video onto another entirely different person in a separate video. The researchers say it's the first time a method has transferred these types of movements between videos and the result is a series of clips that look incredibly realistic.
The neural network created by the researchers only needs a few minutes of the target video for training and it can then translate the head, facial and eye movements of the source to the target. It can even manipulate some background shadows when they're present. In the video below, you can see how the system does this using videos of Barack Obama, Vladimir Putin and Theresa May, among others, as examples -- mouth movements, head rotations and eyebrow wiggles are all transferred between videos. The researchers even use different portions of the same video as both the source and the target and the synthesized result is nearly indistinguishable from the original video.
You need to check this Siggraph video if you want to seize the potential and the wide range of applications (including questionable ones)