Multimedia Information Processing Group

Light Field Capturing

In our multimedia lab we are maintaining a large movable multi-camera array for room-scale light field capturing, featuring commodity color cameras and Time-of-Flight cameras for depth acquisition.

The capturing system currently consists of 24 IDS uEye RGB cameras and 2 Kinect v2 RGB-D cameras assembled on a beam to span a horizontal range of approx. 2.5 meters. The beam can be moved by two linear axes within a horizontal range of 25 cm and 2 meters within the vertical direction, using two isel iMC-S8 microstep controllers with very precise positioning. Image capturing with the uEye cameras is synchronized by an external hardware trigger.


Research Topics

The captured RGB-D data can be used as a basis for several applications, e.g., full-parallax imaging, free-viewpoint video and content creation for 3D displays, augmented reality, analysis of lighting and materials, and digital video post-processing.

Current research topics based on the light field capturing system involve amongst others:

  • Calibration of multi-camera capturing systems (intrinsic/extrinsic calibration, hand-eye calibration, color correction, calibration of depth cameras)
  • Multi-modal sensor data fusion (fusion of depth maps, color and depth fusion)
  • Light field representations for dynamic scenes
  • Efficient representations for large-scale light fields (adaptive sparse grids, kd-trees, tensors)
  • Coding, compression, and storage of dynamic light field data
  • Novel view synthesis from dense/sparse light field samples of dynamic scenes
  • Real-time acquisition, processing, and rendering of light field data


Project Partners and Funding

European Training Network on Full Parallax Imaging
supported by the Marie Skłodowska-Curie actions under the EU Research and Innovation programme Horizon 2020
Project website:
Effiziente Rekonstruktion und Darstellung großflächiger dynamischer Lichtfelder
(Efficient reconstruction and representation of large-scale dynamic light fields)
supported by DFG – German Research Foundation (Deutsche Forschungsgemeinschaft)
Parallel On-Line Methods for High Quality Lightfield Acquisition and Reconstruction supported by Intel Labs, Computational Imaging Lab Intel-Logo