Cell-Based Shape Reconstruction From Incomplete Silhouettes

Shape reconstruction from images is one of the most widely adopted approaches to compute accurate 3D reconstructions of people or objects in a multi-camera environment. However, such algorithms are traditionally very sensitive to errors in the silhouettes due to imperfect foreground-background estimation or occluding objects appearing between the camera and the object of interest. We propose a novel algorithm that is still able to provide high quality reconstruction from incomplete silhouettes. At the core of the method is the partitioning of the reconstruction space in cells, i.e. regions with uniform camera and silhouette coverage properties. An iterative process is proposed which incrementally adds cells to the temporal reconstruction based on their potential to explain the observed silhouettes from different cameras. Experimental results are close to manually labelled approaches and outperform standard leave-M-out reconstruction techniques in terms of F1-score.