Markerless Real-time Tracking for Augmented Reality Image Synthesis.
There are many applications in which it is necessary to overlay a computer-generated object onto a real scene in real-time, requiring accurate measurements of the position, orientation and focal length of a camera in real-time, by analysis of the camera images and exploitation of unobstrusive inertial motion sensors. This will enable the system as a whole to determine its location and orientation in a very natural way, mimicking the way a human orients himself, using the vestibular organ (in the ears), which is essentially an inertial measurement unit, and the eyes - essentially comparable to a camera.
The goal of the project is to construct be a marker-free tracking system that works with high frame-rate on a low-performance computer unit. It will allow the capture of camera and head motions respectively for TV production and mobile augmented reality applications. As the system will not require markers or special infrastructure, it will be suitable for applications where existing tracking systems cannot easily be used, including:
insertion oif virtual objects in live broadcast images outside of a dedicated virtual studio environment, such as graphics for sports or virtual objects in a conventional TV studios
augmented reality applications in the area of development, production and service
augmented reality for architecture, design and cultural heritage
G. Thomas, J. Chandaria, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schön, J. Skoglund, P. J. Slycke, S. Smeitz:
Realtime Camera Tracking in the MATRIS Project
SMPTE Motion Imaging Journal 2007 (07/08), Society of the Motion Picture and Television Engineers, London, 2007
LNCS 4174 (DAGM 2006), pp. 739–749, September 2006, Berlin, Germany
J. Chandaria, G. Thomas, B.Bartczak, K.Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, J. Hol, T. Schön, J. Skoglund, P. Slycke, S. Smeitz: