This paper describes an algorithm to segment stereo images. The key idea is based on the hybrid use of various image information resources about the scene contents. In order to get reliable segmentation result, not only the pixel-orientated luminance distribution of the image but also object contours and disparity information in stereo image pairs are analysed. This algorithm is applied to an interactive multimedia system with an autostereoscopic display to produce dynamic perspectives and to simulate the limited depth of focus mechanism of the human eye.