Fusing Georeferenced and Stereoscopic Image Data for 3D Building Façade Reconstruction

3D building façade reconstruction has become a very popular topic in various applications related to restoration and preservation of architectural structures as well as urban planning. This paper deals with the reconstruction of realistic 3D models of buildings façades, in the urban environment for cultural heritage. We present an approach that enables the relation of stereoscopic images with tacheometry data. The proposed multimodal fusing scheme results in an accurate 3D realistic façade reconstruction and provides a fast and low cost solution. In the first stage of the proposed approach a 2D skeleton of the building is extracted from the viewed scene using Active Contour and Hough line extraction. The next stage of our method utilizes depth information, extracted from a stereoscopic layout, to infer the structural details of inner façade structures, such as windows or doors. In the final stage, the structural information extracted from the image data is integrated with georeferenced point datasets. The final output of our method is a georeferenced 3D model of the structure’s façade, which can be further refined with the use of image-driven texture information.