Projective rectification-based view interpolation for multiview video coding and free viewpoint generation

A projective rectification-based view interpolation algor ithm is de- veloped for multiview video coding and free viewpoint video. It first calculates the fundamental matrix between two views without using any camera parameter. The two views are then resampled to have horizontal and matched epipolar lines. One-dimensional disparity is estimated next, which is used to interpolate the image for an inter- mediate viewpoint. After unrectification, the interpolate d view can be displayed directly for free viewpoint video purpose. It can also be used as a reference to encode data of an intermediate camera. Exper- imental results show that the interpolated views can be 3 dB better than existing method. Video coding results illustrate that the method can provide up to 1.3 dB improvement over JMVC.