Attention-Weighted Depth Map' Te-Allocation In Free-Viewpoint Television

We propose optimal rate-allocation, using viewer attention information among viewpoints, for depth map cameras within a free-viewpoint television broadcast system. An attention weighted rate-allocation framework enables bit-rate, or quality, to be distributed across the multiple cameras in accordance with viewer interest, minimizing total observed distortions perceived among all viewers. Prior work has considered attention-weighted rate-allocation for texture cameras only in such systems. Depth maps, nonetheless, are a common requirement for view rendering in many systems. They may constitute a significant part of overall transmission bit-rate and they present their own distortion characteristics, different from those of texture. We model the effects of depth camera distortions upon virtual or synthesized views and propose an optimal attention-weighted rate-allocation among depth cameras. Results show significant gains in average PSNR of synthesized views and bit-rate savings of our proposal relative to the balanced rate-allocation alternative.