Passive-Active Geometric Calibration for View-Dependent Projections onto Arbitrary Surfaces

In this paper we present a hybrid technique for cor- recting distortions that appear when projecting images onto geometrically complex, colored and textured sur- faces. It analyzes the optical flow that results from perspective distortions during motions of the observer and tries to use this information for computing the correct image warping. If this fails due to an unreli- able optical flow, an accurate -but slower and visible- structured light projection is automatically triggered. Together with an appropriate radiometric compensa- tion, view-dependent content can be projected onto ar- bitrary everyday surfaces. An implementation mainly on the GPU ensures fast frame rates.