Member-only story
DEEP LEARNING
X-Fields — Neural Network That Changes the Scene Angle
Researchers from MPI Informatik and University College London trained a neural network that changes the angle of view of a scene in an image. The neural network takes into account the change in lighting. To interpolate the viewing angle, time and lighting from a set of 2D images, which have coordinates marked, the neural network learns to draw each image from the others.
On inference, the model takes as input a set of coordinates that describe the parameters of the viewing angle, time and lighting. At the output, the model generates a 2D image in real time with the specified coordinates. At the same time, additional parameters can be added to the model, which will be taken into account when generating the image.
X-Fields — Video Demonstration
Approach and Benchmarking
The researchers propose to represent a set of 2D images of one scene using a neural network to correlate the parameters of view, lighting and time with images. The…
