DEEP LEARNING

X-Fields — Neural Network That Changes the Scene Angle

X-Fields — Neural Network That Changes the Scene Angle
X-Fields — Neural Network That Changes the Scene Angle
Source: X-Fields

X-Fields — Video Demonstration

Approach and Benchmarking

The researchers propose to represent a set of 2D images of one scene using a neural network to correlate the parameters of view, lighting and time with images. The model can estimate for each pixel in the image how it will change when viewing angle, time, or lighting changes. Technically, this is the Jacobi matrix for pixels in relation to viewing angle, time and lighting.

X-Fields — Neural Network That Changes the Scene Angle
X-Fields — Neural Network That Changes the Scene Angle
Image for post
Image for post
X-Fields. Comparison of space, time, and illumination interpolation methods (rows) in respect to capabilities (columns), with an emphasis on deep methods. Source: X-Fields

Original Paper

http://xfields.mpi-inf.mpg.de/paper/X_Fields__siggasia_2020.pdf

Read More

If you found this article helpful, click the💚 or 👏 button below or share the article on Facebook so your friends can benefit from it too.

Written by

Bioinformatician at Oncobox Inc. (@oncobox). Research Associate at Moscow Institute of Physics and Technology (@mipt_eng).

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store