Multimedia Information Processing Group

Team

Prof. Dr. Reinhard Koch

Head of group

Hermann-Rodewald-Straße 3, R. 301 (HRS 3)
Phone: +49 431 880-4484
Telefax: +49 431 880-4845
rk@informatik.uni-kiel.de

Publications
Google Scholar

Honours and Awards

  • 1982    
Member of American Physics Honor Society Sigma Pi Sigma
  • 1995
Award of the 'Deutsche AG Mustererkennung (DAGM '95)' for the contribution U. Rost und R. Koch: Rekonstruktion von Schleifpapieroberflaechen fuer die Qualitaetskontrolle
  • 1996
ECVNet Technology Innovation Award ECVNet Consortiums at International Conference on Pattern Recognition '96, for the product Sphinx of DIMENSION GbR
  • 1996
Award of the Deutsche AG Mustererkennung (DAGM '96) for the contribution R. Koch: 3D Modeling of Human Heads from Stereoscopic Image Sequences
  • 1997
OLYMPUS Award 1997 of the Olympus Europa Foundation 'Science for Live' during DAGM '97, for the contribution on automatic 3D surface modeling from stereoscopic image sequences
  • 1999
David Marr Award at International Conference of Computer Vision ICCV '98 for the contribution M. Pollefeys, R. Koch, L. Van Gool: Self-Calibration and Metric Reconstruction in spite of Varying Internal Camera Parameters

 

Johannes Brünger

PhD Student

Hermann-Rodewald-Straße 3, R. 305 (HRS 3)
Phone: +49 431 880-1418
Telefax: +49 431 880-4845
jobr@informatik.uni-kiel.de

Yuan Gao

PhD Student

Hermann-Rodewald-Straße 3, R. 307a (HRS 3)
Phone: +49 431 880-4844
Telefax: +49 431 880-4845
yga@informatik.uni-kiel.de

Short CV

  • since 2015
PhD student, Kiel University, Germany
  • 2012 - 2015     
M.S. Peking University, Beijing, China
  Discipline: Computer Application Technology
  Thesis: "Smile Detection and Gender Identification Methods based on Self-Similarity of Gradients Features"
  • 2008 - 2012
B.E. Xidian University, Xi’an, China
  Discipline: Intelligence Science and Technology

Research topics

Densely-Sampled Light Field (DSLF) Reconstruction for Static and Dynamic scenes, Rigid and Non-Rigid 3D Reconstruction using Kinect V2.

Projects:
Light Field Capturing

Personal Website  

Tim Michels

PhD Student

Hermann-Rodewald-Straße 3, R. 310 (HRS 3)
Phone: +49 431 880-4841
Telefax: +49 431 880-4845
tmi@informatik.uni-kiel.de

Short CV

  • since 2016
PhD student, Kiel University, Germany
  • 2013 - 2016    
MSc Computer Science, WWU Münster, Germany
  Thesis: "Entzerrung von zylindrischen FIM-Bildern in einem Multikamera-Setup und Tracking von Drosophila Melanogaster Larven unter Benutzung des RJMCMC-Verfahrens"
  • 2010 - 2013
MSc Mathmatics, WWU Münster, Germany
  Thesis: "Ricci-Fluss auf Mannigfaltigkeiten nicht-negativer, komplexer Schnittkrümmung"
  • 2007 - 2010
BSc Mathmatics, WWU Münster, Germany

Research topics

I am working on light fields, i.e. data from multi-camera setups or plenoptic cameras which can be viewed as samples of the plenoptic function. The aim is to reconstruct scene properties such as geometry, materials and lighting conditions in order to build parametric models and enable free viewpoint rendering. Furthermore I am involved in capturing and simulating light field data which also includes the calibration of the necessary hardware.

Projects:
Light Field Capturing
Plenoptic Cameras - Analysis and Simulation

Publications

Tim Michels, Arne Petersen, Luca Palmieri, Reinhard Koch
Simulation of Plenoptic Cameras
3DTV Conference, 2018. (accepted, to appear)
Preprint GitHub Repository


Tim Michels, Dimitri Berh and Xiaoyi Jiang
An RJMCMC-Based Method for Tracking and Resolving Collisions of Drosophila Larvae
IEEE/ACM Transactions on Computational Biology and Bioinformatics. (to appear)
DOI: 10.1109/TCBB.2017.2779141 Preprint Github Repository


D. Berh, B. Risse, T. Michels, N. Otto, X. Jiang and C. Klämbt
An FIM-Based Long-Term In-Vial Monitoring System for Drosophila Larvae
IEEE Transactions on Biomedical Engineering, vol. 64, no. 8, pp. 1862-1874, Aug. 2017.
DOI: 10.1109/TBME.2016.2628203 Preprint


S. Esquivel, Y. Gao, T. Michels, L. Palmieri, R. Koch
Synchronized Data Capture and Calibration of a Large-Field-of-View Moving Multi-Camera Light Field Rig
Invited talk at: 3DTV-CON 2016, Workshop on Light Field Capture and Processing, Hamburg, 2016

Luca Palmieri

PhD Student

Hermann-Rodewald-Straße 3, R. 307 (HRS 3)
Phone: +49 431 880-4843
Telefax: +49 431 880-4845
lpa@informatik.uni-kiel.de

Short CV

  • since 2016
PhD student, Kiel University, Germany
  • 2015 - 2016    
Working at 3DEverywhere in Padua, Italy
  • 2013 - 2015
MSc Telecommunication Engineering, University of Padua, Italy
  • 2013 - 2014
Erasmus Program at Polytechnic University of Barcelona, Spain
  • 2010 - 2013
BSc Information Engineering, University of Padua, Italy

Research topics

I am working on depth estimation using multi-lens array (MLA) based plenoptic cameras. These camera capture enough information to calculate the 3D geometry of the scene in a single shot. I am involved in the development of datasets to be used as benchmark in this field and in the development of novel approaches for estimating depth from different types of plenoptic cameras.

Projects:
Plenoptic Cameras - Analysis and Simulation

Publications

Luca Palmieri, Ron Op Het Veld and Reinhard Koch
The Plenoptic 2.0 Toolbox: Benchmarking of depth estimation methods for MLA-based focused plenoptic cameras
ICIP 2018 (accepted, to appear) GitHub Repository


Ron Op het Veld, Tobias Jaschke, Michel Bätz, Luca Palmieri and Joachim Keinert
A Novel Confidence Measure for Disparity Maps by Pixel-wise Cost Function Analysis
ICIP 2018 (accepted, to appear)


Waqas Ahmad, Luca Palmieri, Reinhard Koch and Mårten Sjöström
Matching Light Field Datasets from Plenoptic Cameras 1.0 and 2.0
3DTV Conference, 2018 (accepted, to appear), Dataset


Tim Michels, Arne Petersen, Luca Palmieri, Reinhard Koch
Simulation of Plenoptic Cameras
3DTV Conference, 2018 (accepted, to appear), GitHub Repository


Luca Palmieri, and Reinhard Koch
Optimizing the Lens Selection Process for Multi-Focus Plenoptic Cameras and Numerical Evaluation
IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1763-1774, 2017
DOI: 10.1109/CVPRW.2017.223 Github Repository


S. Esquivel, Y. Gao, T. Michels, L. Palmieri, R. Koch
Synchronized Data Capture and Calibration of a Large-Field-of-View Moving Multi-Camera Light Field Rig
Invited talk at: 3DTV-CON 2016, Workshop on Light Field Capture and Processing, Hamburg, 2016

Dr.-Ing. Arne Petersen

Postdoc

Hermann-Rodewald-Straße 3, R. 310 (HRS 3)
Phone: +49 431 880 4841
Telefax: +49 431 880 4845
arp@informatik.uni-kiel.de

Short CV

  • since 2017
Postdoc, Kiel University, Germany
  • 2012 - 2017   
Software Developer, Raytrix GmbH
  • 2014
Doctoral degree in Engineering, Kiel University, Germany
  Thesis: "A Specialized Kalman Filter Framework for IMU Aided Stereo SLAM"
  • 2007 - 2012
Research assistent, Kiel University, Germany
  • 2006
Engineer diploma, Kiel University, Germany

Research topics

The focus of my research is on 3D scene analysis using multi-camera systems (ranged from stereo rigs to light filed camera systems) and other depth sensors (e.g. Time-Of-Flight cameras). To exploit the acquired data in an optimal fashion I apply methods from (multi) sensor fusion, knowing that "The whole is more than the sum of its parts".
Since October 2016 I take part in the European Training Network on Full Paralax Imaging ETN-FPI (see www.full-parallax-imaging.eu). To May 2017 I was supervising the project as representative of Raytrix GmbH Kiel. From July 2017 I take part as a member of the MIP work group.
For my doctoral thesis, finished October 2013, I've designed a SLAM (Simultaneous Localization And Mapping) system, using stereo vision and inertial sensors. The task was to optimize the system models used in Iterated/Extended Kalman Filters, with regard to linearity and error modelling. Therefore new state parametrizations and tools for statistical analysis have been developed. By this, the filter is optimized to increase the long term stability, consistency and quality of the estimated parameters and their error estimate.
In the past, I was involved in a joint venture project, aiming at the development of a commercial navigation system. Multiple sensors were used, to gain comprehensive information of the systems navigation state. The project ended successfully in 2010.
From end of 2010 to 2012 I took part in the research project "MoSES", as a joint venture with "IBAK Helmut Hunger GmbH & Co. KG". Within this project a modular software framework has been developed, that allows for easily assembling specialized software for multi sensor fusion.

Projects:
Light Field Capturing
Plenoptic Cameras - Analysis and Simulation

Publications

Tim Michels, Arne Petersen, Luca Palmieri, Reinhard Koch
Simulation of Plenoptic Cameras
3DTV Conference, 2018 (accepted, to appear), GitHub Repository


Carlsohn, M.F.; Kemmling, A; Petersen, A.; Wietzke, L.
Light Field Particle Image Velocimetry by Plenoptic Image Capturing for 3D-Display of Simulated Blood Flow in Cerebral Aneurysms
Bildverarbeitung für die Medizin, Workshop 13. – 15. März 2016, Berlin
DOI: 10.1007/978-3-662-49465-3_41


Carlsohn, M.F.; Kemmling, A.; Petersen, A.; Wietzke, L.
3D real-time visualization of blood flow in cerebral aneurysms by light field particle image velocimetry
Proceedings of SPIE , Real-Time Image and Video Processing April 2016, Brussels, Belgium
DOI: 10.1117/12.2220417


Zielke, R.; Perwaß, C.; Petersen, A.; Erdmann, A.; Wietzke, L.; Menzel, P.; Brede, M.; Leder, A.
Erprobung der Lichtfeldkamera-Mikroskopie an einem μ-PIV Versuchstand zur Bestimmung von 3D-3C Geschwindigkeitsfeldern
Lasermethoden in der Strömungsmesstechnik, 23. Fachtagung, 8. - 10. September 2015, Dresden, Karlsruhe
Deutsche Gesellschaft für Laser-Anemometrie GALA eV pp. 3.1-3.8, 2015
ISBN 9783981676419


Arne Petersen:
Dissertation zur Erlangung des Titels Dr.-Ing.
A Specialized Kalman Filter Framework for IMU Aided Stereo SLAM
Kiel Computer Science Series 2014 Volume 3
Free access : http://macau.uni-kiel.de/receive/dissertation_diss_00014529
URN: urn:nbn:de:gbv:8-diss-145295


Menzel, P.; Perwaß, C.; Petersen, A.; Pinnow, A.; Wietzke, L.; Wolter, A.; Leder, A.
Erprobung eines neuartigen Lichtfeldkamera-Messsystems zur gleichzeitigen Messung von 3D-3C-Geschwindigkeitsfeldern sowie einer 3D-Oberflächenkontur
Lasermethoden in der Strömungsmesstechnik, 22. Fachtagung 9. - 11. September 2014, Karlsruhe
GALA pp. 7.1-7.9, 2014, ISBN 9783981676402


Arne Petersen, Reinhard Koch:
Video-based realtime IMU-camera Calibration for Robot Navigation
Proceedings of  SPIE , Real-Time Image and Video Processing 2012, 843706 (June 1, 2012);  doi:10.1117/12.924066
April 2012, Brussels, Belgium; BibTex


Arne Petersen, Reinhard Koch:
A Novel State Parametrization for Stereo SLAM (pdf 400KB)
Proceedings of  VisApp 2012, February 2012, Rom, Italy; BibTex


Arne Petersen, Marc-Andre Beyer (Raytheon Anschütz GmbH, Kiel):
Partitioned Covariance Intersection (pdf 514.6KB)
Proceedings of ISIS 2011, September 2011, Hamburg, Germany; BibTex


Arne Petersen, Reinhard Koch:
Statistical Analysis of Kalman Filters by Conversion to Gauss-Helmert Models with Applications to Process Noise Estimation(pdf 127.81 Kb)
Proceedings of  ICPR2010, August 2010, Istanbul, Turkey; BibTex


Jan-Friso Evers-Senne, Ingo Schiller, Arne Petersen, and Reinhard Koch:
"A Mobile Augmented Reality System with Distributed Tracking"
Proceedings of 3DPVT ,June 2006, Chapel Hill, NC, USA BibTeX

Teaching

In the past I supported Prof. Dr.-Ing. Koch in lecturing multimedia communications. This lecture is especially designed for the international degree program digital communications. It deals with analyzing visual as well as aural perception, i.e. for signal-compression (MP3, JPEG etc.). Beside that, I've supervised various bachelor- and master/diploma-theses.

Stefan Reinhold

PhD Student

Hermann-Rodewald-Straße 3, R. 310 (HRS 3)
Phone: +49 431 880-4841
Telefax: +49 431 880-4845
sre@informatik.uni-kiel.de

Short CV

  • since 2014
PhD student, Kiel University, Germany
  • 2011 - 2012   
Software and FPGA Developer, SciEngines GmbH, Kiel, Germany
  • 2005 - 2014
Dipl. Inf., Kiel University, Germany

Research topics

Projects:
Deformation Tracking

Publications

Stefan Reinhold, Andreas Jordt, Reinhard Koch:
Randomly Sparsified Synthesis for Model-based Deformation Analysis
Proceedings of the 38th German Conference on Pattern Recognition (GCPR 2016), pp. 143-154, Springer LNCS 9796, 2016.
The final publication is available at Springer via https://dx.doi.org/10.1007/978-3-319-45886-1_12. Preprint


Andreas Jordt, Stefan Reinhold, Reinhard Koch:
Tracking of Object Deformations in Color and Depth Video: Deformation Models and Applications.
Proceedings on SPIE Optical Metrology, Munich, 2015
DOI: 10.1117/12.2190780

Tobias Schwede

PhD Student

Hermann-Rodewald-Straße 3, R. 309a (HRS 3)
Phone: +49 431 880-4448
Telefax: +49 431 880-4845
tosc@informatik.uni-kiel.de

Dominik Wolters

PhD Student

Hermann-Rodewald-Straße 3, R. 305 (HRS 3)
Phone: +49 431 880-1418
Telefax: +49 431 880-4845
dwol@informatik.uni-kiel.de

Short CV

  • since 2014
PhD student, Kiel University, Germany
  • 2011 - 2013    
M.Sc. Computer Science, Kiel University, Germany
  • 2008 - 2011
B.Sc. Computer Science, Kiel University, Germany

Publications

Dominik Wolters, Reinhard Koch:
Combined Precise Extraction and Topology of Points, Lines and Curves in Man-Made Environments
Proceedings of the 39th German Conference on Pattern Recognition (GCPR 2017), pp. 115-125, Springer LNCS 10496, 2017.
The final publication is available at Springer via https://dx.doi.org/10.1007/978-3-319-66709-6_10. Preprint


Dominik Wolters, Reinhard Koch:
Precise and Robust Line Detection for Highly Distorted and Noisy Images
Proceedings of the 38th German Conference on Pattern Recognition (GCPR 2016), pp. 3-13, Springer LNCS 9796, 2016.
The final publication is available at Springer via https://dx.doi.org/10.1007/978-3-319-45886-1_1. Preprint


Dominik Wolters
Automatic 3D Reconstruction of Indoor Manhattan World Scenes Using Kinect Depth Data
Proceedings of the German Conference on Pattern Recognition (GCPR 2014), pp. 715-721, Springer LNCS, 8753, 2014
The final publication is available at Springer via https://dx.doi.org/10.1007/978-3-319-11752-2_59. Preprint

Claudius Zelenka

PhD Student

Hermann-Rodewald-Straße 3, R. 309a (HRS 3)
Phone: +49 431 880-4448
Telefax: +49 431 880-4845
cze@informatik.uni-kiel.de
Details

Short CV

  • since 2014
PhD student, Kiel University, Germany
   
   
   

Research topics

 

Publications

Claudius Zelenka, Reinhard Koch:
Improved wavefront correction for coherent image restoration
Opt. Express 25, 18797-18816 (2017)
DOI: 10.1364/OE.25.018797


Claudius Zelenka, Reinhard Koch:
Restoration of images with wavefront aberrations
2016 23rd International Conference on Pattern Recognition (ICPR) (IEEE, 2016), 1388–1393
DOI: 10.1109/ICPR.2016.7899831


Anne Jordt, Claudius Zelenka, Jens Schneider V. Deimling, Reinhard Koch, Kevin Koeser:
The Bubble Box: Towards an Automated Visual Sensor for 3D Analysis and Characterization of Marine Gas Release Sites
Sensors. 2015; 15(12):30716-30735.
DOI: 10.3390/s151229825


Claudius Zelenka, Reinhard Koch:
Blind Deconvolution on Underwater Images for Gas Bubble Measurement
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-5/W5, pp. 239-244, 2015
DOI: 10.5194/isprsarchives-XL-5-W5-239-2015


Claudius Zelenka:
Gas Bubble Shape Measurement and Analysis
Proceedings of the German Conference on Pattern Recognition (GCPR 2014), pp. 743-749, Springer LNCS, 8753, 2014
DOI: 10.1007/978-3-319-11752-2_63 


Master's thesis on
Underwater Bubble Shape Measurement and Analysis
Supervised by Reihard Koch and Anne Jordt
awarded the Fokusfinder 2014 price by the Initiative Bildverarbeitung

Teaching

WS 2015 - Computer Graphics - Teaching Assistant
WS 2015 - Computer Systems - Teaching Assistant
SS 2015 - Computer Science for Engineers - Teaching Assistant
WS 2014/2015 - Introduction to Image Processing - Teaching Assistant
SS 2014 - Computer Graphics - Teaching Assistant