In our multimedia lab we are maintaining a large movable multi-camera array for room-scale light field capturing, featuring commodity color cameras and Time-of-Flight cameras for depth acquisition.
The capturing system currently consists of 24 IDS uEye RGB cameras and 2 Kinect v2 RGB-D cameras assembled on a beam to span a horizontal range of approx. 2.5 meters. The beam can be moved by two linear axes within a horizontal range of 25 cm and 2 meters within the vertical direction, using two isel iMC-S8 microstep controllers with very precise positioning. Image capturing with the uEye cameras is synchronized by an external hardware trigger.
The captured RGB-D data can be used as a basis for several applications, e.g., full-parallax imaging, free-viewpoint video and content creation for 3D displays, augmented reality, analysis of lighting and materials, and digital video post-processing.
Current research topics based on the light field capturing system involve amongst others:
- Calibration of multi-camera capturing systems (intrinsic/extrinsic calibration, hand-eye calibration, color correction, calibration of depth cameras)
- Multi-modal sensor data fusion (fusion of depth maps, color and depth fusion)
- Light field representations for dynamic scenes
- Efficient representations for large-scale light fields (adaptive sparse grids, kd-trees, tensors)
- Coding, compression, and storage of dynamic light field data
- Novel view synthesis from dense/sparse light field samples of dynamic scenes
- Real-time acquisition, processing, and rendering of light field data
Project Partners and Funding
| European Training Network on Full Parallax Imaging |
supported by the Marie Skłodowska-Curie actions under the EU Research and Innovation programme Horizon 2020
Project website: www.full-parallax-imaging.eu
| Effiziente Rekonstruktion und Darstellung großflächiger dynamischer Lichtfelder |
(Efficient reconstruction and representation of large-scale dynamic light fields)
supported by DFG – German Research Foundation (Deutsche Forschungsgemeinschaft)
| Parallel On-Line Methods for High Quality Lightfield Acquisition and Reconstruction |
supported by Intel Labs, Computational Imaging Lab