Light Field Processing

projects
In contrast to standard cameras, light field (or plenoptic) cameras capture the light field of a scene in four dimensions (i.e. spatial and directional information). Therefore, among others, one is able to obtain metric 3D information from a single recording of a light field camera. Our research focuses on calibration, depth estimation, SLAM, etc. based on light field recordings.

Publications

PRISM-VO: Scale-Aware Visual Odometry Using Photometric Plenoptic Bundle Adjustment
PRISM-VO: Scale-Aware Visual Odometry Using Photometric Plenoptic Bundle Adjustment
Aymeric Fleith, Julian Zirbel, Daniel Cremers, Niclas Zeller
European Conference on Computer Vision (ECCV); 2026
Oral Presentation
PDF Project Video
LiFMCR: Dataset and Benchmark for Light Field Multi-Camera Registration
LiFMCR: Dataset and Benchmark for Light Field Multi-Camera Registration
Aymeric Fleith*, Julian Zirbel*, Daniel Cremers, Niclas Zeller
International Symposium on Visual Computing (ISVC); 2025
* Equal contribution
PDF Code Dataset Project
LiFCal: Online Light Field Camera Calibration via Bundle Adjustment
LiFCal: Online Light Field Camera Calibration via Bundle Adjustment
Aymeric Fleith, Doaa Ahmed, Daniel Cremers, Niclas Zeller
German Conference on Pattern Recognition (GCPR); 2024
PDF Code Project
Generating a Totally Focused Colour Image from Recordings of a Plenoptic Camera
Generating a Totally Focused Colour Image from Recordings of a Plenoptic Camera
Marcel Sütterlin, Niclas Zeller, Franz Quint
International Symposium on Electronics and Telecommunications (ISETC); 2018
Direct Plenoptic Odometry - Robust Tracking and Mapping with a Light Field Camera
Direct Plenoptic Odometry - Robust Tracking and Mapping with a Light Field Camera
Niclas Zeller
Dissertation - Technische Universität München; 2018
PDF
Scale-Awareness of Light Field Camera based Visual Odometry
Scale-Awareness of Light Field Camera based Visual Odometry
Niclas Zeller, Franz Quint, Uwe Stilla
European Conference on Computer Vision (ECCV); 2018
PDF Video
A Synchronized Stereo and Plenoptic Visual Odometry Dataset
A Synchronized Stereo and Plenoptic Visual Odometry Dataset
Niclas Zeller, Franz Quint, Uwe Stilla
arXiv preprint; 2018
PDF Dataset
From the Calibration of a Light-Field Camera to Direct Plenoptic Odometry
From the Calibration of a Light-Field Camera to Direct Plenoptic Odometry
Niclas Zeller, Franz Quint, Uwe Stilla
IEEE Journal of Selected Topics in Signal Processing; 2017
PDF
Metric Calibration of a Focused Plenoptic Camera based on a 3D Calibration Target
Metric Calibration of a Focused Plenoptic Camera based on a 3D Calibration Target
Niclas Zeller, Charles-Antoine Noury, Franz Quint, Celine Teuliere, Uwe Stilla, Michel Dhome
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Proc. XXIII ISPRS Congress); 2017
PDF
Investigating Mathematical Models for Focused Plenoptic Cameras
Investigating Mathematical Models for Focused Plenoptic Cameras
Niclas Zeller, Franz Quint, Marcel Sütterlin, Uwe Stilla
International Symposium on Electronics and Telecommunications (ISETC); 2016
Depth Estimation from Micro Images of a Plenoptic Camera
Depth Estimation from Micro Images of a Plenoptic Camera
Jennifer Konz, Niclas Zeller, Franz Quint, Uwe Stilla
BW-CAR Symposium on Information and Communication Systems (SInCom); 2016
PDF
Feature based RGB-D SLAM for a Plenoptic Camera
Feature based RGB-D SLAM for a Plenoptic Camera
Andreas Kühefuß, Niclas Zeller, Franz Quint, Uwe Stilla
BW-CAR Symposium on Information and Communication Systems (SInCom); 2016
PDF
Depth Estimation and Camera Calibration of a Focused Plenoptic Camera for Visual Odometry
Depth Estimation and Camera Calibration of a Focused Plenoptic Camera for Visual Odometry
Niclas Zeller, Franz Quint, Uwe Stilla
ISPRS Journal of Photogrammetry and Remote Sensing; 2016
PDF
A Real-Time Depth Estimation Approach for a Focused Plenoptic Camera
A Real-Time Depth Estimation Approach for a Focused Plenoptic Camera
Ross Vasko, Niclas Zeller, Franz Quint, Uwe Stilla
Advances in Visual Computing (Proc. International Symposium on Visual Computing (ISVC)); 2015
PDF
Filtering Probabilistic Depth Maps Received from a Focused Plenoptic Camera
Filtering Probabilistic Depth Maps Received from a Focused Plenoptic Camera
Niclas Zeller, Franz Quint, Uwe Stilla
BW-CAR Symposium on Information and Communication Systems (SInCom); 2015
PDF
Establishing a Probabilistic Depth Map from Focused Plenoptic Cameras
Establishing a Probabilistic Depth Map from Focused Plenoptic Cameras
Niclas Zeller, Franz Quint, Uwe Stilla
International Conference on 3D Vision (3DV); 2015
PDF
Narrow Field-Of-View Visual Odometry Based on a Focused Plenoptic Camera
Narrow Field-Of-View Visual Odometry Based on a Focused Plenoptic Camera
Niclas Zeller, Franz Quint, Uwe Stilla
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Proc. PIA); 2015
PDF
Calibration and Accuracy Analysis of a Focused Plenoptic Camera
Calibration and Accuracy Analysis of a Focused Plenoptic Camera
Niclas Zeller, Franz Quint, Uwe Stilla
ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Proc. PCV); 2014
PDF
Kalibrierung und Genauigkeitsuntersuchung einer fokussierten plenoptischen Kamera
Kalibrierung und Genauigkeitsuntersuchung einer fokussierten plenoptischen Kamera
Niclas Zeller, Franz Quint, Uwe Stilla
DGPF Tagungsband; 2014
PDF