The technology manufacturer Nvidia, together with the University of Toronto and the Finnish institution Aalto University, surprised at the annual congress Neural Information Processing Systems. The novelty was the development of software with which it is possible to capture 2D images and then visualize them in 3D.
The development is projected to be a great opportunity for all computer simulation enthusiasts. With fields of action that can range from differentiation maps in virtual reality and even immersive video games and movies.
Nvidia software is like a human eye
Through its official blog, Nvidia commented that, thanks to machine learning models, the software is able to mimic the capabilities of the human eye. And in this way, it can very accurately understand the data in an image.
That said, the system is a rendering framework called DIB-R, which mimics a human eye and produces 3D visualizations. So, what happens is that knowing that people see in two dimensions, in this case the images captured by the retinas are combined, and the result is the perception of depth and the generation of a sensation of three-dimensionality.
In addition, Nvidia added that, their goal is to be able to build an architecture for:
“The production of high-fidelity images through the use of an encoder-decoder architecture. A type of neural network that transforms input into a feature map or vector that is used to predict specific information such as shape, color, texture, and lighting in an image.”
According to Nvidia‘s head of artificial intelligence, Sanja Fidler:
“Taking 3D images means that you’ll be able to see that scene that you’ve taken a picture of with a multitude of different viewpoints. You can step into it, see it from different angles – they can take old photographs from their photo collection and turn them into a 3D scene and inspect them as if they were there, basically.”
Finally, you should know that the possibilities of this system are apparently inexhaustible. One option could be, for example, to try to capture extinct animals and perhaps revive their appearance in a 3D figure, dinosaurs could be an excellent idea. Almost anything could be visualized in 3D.
Do you have a 2D photo that you would definitely like to relive in 3D?
If you liked this article, you can also read: This is the first human anatomy course with virtual reality
