Search Unity

Unity-NYU 3D sketch fundamental research kicks off

August 4, 2021 in News | 3 min. read
Girl wearing pink VR headset in front of a purple background.
Girl wearing pink VR headset in front of a purple background.
Share

Is this article helpful for you?

Thank you for your feedback!

One of the most important external sources of research, knowledge, and technology in innovation are universities; industry-academia collaborations are force multipliers for high impact research. Unity partnered with the Future Reality Lab at New York University (NYU) to research and develop the most efficient ways for non-technical content creators and consumers to construct 3D objects. This project is spearheaded by a team of senior researchers at Unity Labs and Kenneth Perlin, professor of Computer Science at NYU’s Courant Institute, founding director of the Future Reality Lab at NYU, and director of the NYU Holodeck Project, a multidisciplinary initiative funded under an NSF MRI grant. 

The NYU Future Reality Lab explores how people will use future mixed reality technologies to better communicate and interact with each other whether or not they are in the same physical space. The lab features a team of experts in diverse areas of computer science.

This collaborative industry-academia undertaking will aim to lower the barrier of entry for non-technical users to be able to rapidly ingest, digitize and prototype 3D assets so they can realize RT3D capabilities in a way they currently cannot. 

In the first stage of this project, the Unity-NYU team will focus on 3D asset retrieval and producing a low detail 3D object example. The team will then apply those learnings to work on multiple retrieval inputs in the second stage of the research. The ultimate goal of the project is to discover a clear path toward designing an interactive system to assist users in sketching by providing them with responsive data-driven autocomplete of high quality 3D models based on the sketch. Think, solving jigsaw puzzles with machine learning algorithms that can auto detect the correct puzzle piece. 

We are excited to embark on this research journey with NYU and our hope is to create a long lasting relationship that will result in groundbreaking discoveries in such domains as machine learning, geometrical computation, or mixed reality technologies. 

** Academic Research Partnerships Program is part of Unity's Technology Org and supports multiple business units across the company. Our mission is to forge strategic subject matter expertise partnerships to support success in managing technological uncertainty, reducing risk, and accelerating growth. 

August 4, 2021 in News | 3 min. read

Is this article helpful for you?

Thank you for your feedback!