Multimedia Information Processing

Deformation Tracking







The deformation tracking project has its focus on the reconstruction of flexible objects from depth and color videos. The Analysis by Synthesis (AbS) method developed in this project is able to meet the different requirements of various applications by its modular approach.
The applications range from real-time tracking of partly occluded objects and Human Computer Interaction (HCI) to grasp evaluation for robots and material parameter estimation based on the visible deflection. The following list features a selection of AbS methods and applications of this project:



Image Edit Plugin:img
Reconstruction of Deformation from Depth and Color Video with Explicit Noise Models

Andreas Jordt, Reinhard Koch: Time-of-Flight and Depth Imaging: Sensors, Algorithms, and Applications (LNCS 8200), Pages 128--146, Springer Verlag 2013, ISBN 978-3-642-44963-5
Links: Abstract Edit Plugin:alink, Full Paper (Self-Archived Version), Bibtex
The final publication is available at


Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays

Jürgen Steimle, Andreas Jordt, Pattie Maes: ACM International Conference on Human Factors in Computing (CHI 2013). ACM Press.
(Best Paper Honorable Mention Award)
Links: Abstract Edit Plugin:alink, Full Paper, Bibtex



Direct Model-based Tracking of 3D Object Deformations in Depth and Color Video

Andreas Jordt, Reinhard Koch: International Journal Of Computer Vision (IJCV). Springer Verlag.
Links: Abstract , Full Paper (Submission Version), Bibtex
The final publication is available at


Estimation of Material Properties and Pose for Deformable Objects from Depth and Color Images

Andreas R. Fugl, Andreas Jordt, Henrik G. Petersen, Morten Willatzen, Reinhard Koch: In Pattern Recognition, Proceedings of the DAGM/OAGM 2012, Springer Verlag, LNCS 7476, Pages 165--174.
Links: Abstract , Bibtex


Fast Tracking of Deformable Objects in Depth and Colour Video

Andreas Jordt, Reinhard Koch, BMVC 2011, Proceedings of the British Machine Vision Conference.
Links: Abstract , Full Paper, Bibtex


An Outline for an intelligent System performing Peg-in-Hole Actions with flexible Objects

Andreas Jordt, Andreas R. Fugl, Leon Bodenhagen, Morten Willatzen, Reinhard Koch, Henrik G. Petersen, Knud A. Andersen, Martin M. Olsen, Norbert Krueger: ICIRA 2011, Proceedings of the International Conference on Intelligent Robotics and Applications.
Links: Abstract , Full Paper, Bibtex