Intelligent Systems Research Group
NeRDy
Neural 3D Representation for Dynamic Scenes with Passive Multi-Camera Systems
Team:
Prof. Dr.-Ing. Niclas Zeller
Prof. Dr.-Ing. Astrid Laubenheimer
Julian Zirbel
Matthias Möller
Funding: BMFTR
Duration: 2024 - 2029
Overview
The NeRDy research project aims to achieve detailed and precise 3D reconstruction of dynamic scenes, objects and people based on passive multi-camera systems that are easy to install and operate and serve the purpose of scene understanding.
In line with current developments in science, the methodological focus is on neural representations of dynamic scenes, objects and people. In addition to off-the-shelf stereo cameras, special camera technologies – in particular arrays of light field cameras – are considered and, for example, the extent to which corresponding camera models of these technologies is advantageously used in the creation of neural representations will be investigated. This integrated consideration of neural representations with the aforementioned camera technologies will enable the exploration of innovative solutions that are expected to be superior to existing approaches, particularly in terms of reconstruction accuracy and, in the medium term, resource consumption.
Partners
Our partners are raytrix GmbH, Technical University of Munich, ImFusion GmbH, Vitracom GmbH, EVOMOTIV GmbH.