Reconstruction of lost depth data in multiview video-plus-depth communications using geometric transforms

Marcelino, Sylvain; Soares, Salviano; Faria, Sergio; Assunção, Pedro

http://hdl.handle.net/10400.8/12982

Use this identifier to reference this record.

Name:	Description:	Size:	Format:
1-s2.0-S104732031630150X-main.pdf		1.99 MB	Adobe PDF	Download

Send Feedback

Authors

Abstract(s)

This paper addresses depth data recovery in multiview video-plus-depth communications affected by transmission errors and/or packet loss. The novel aspects of the proposed method rely on the use of geometric transforms and warping vectors, capable of capturing complex motion and view-dependent deformations, which are not efficiently handled by traditional motion and/or disparity compensation methods. By exploiting the geometric nature of depth information, a region matching approach combined with depth contour reconstruction is devised to achieve accurate interpolation of arbitrary shapes within lost regions of depth maps. The simulation results show that, for different packet loss rates, up to 20%, the depth maps recovered by the proposed method produce virtual views with better quality than existing methods based on motion information and spatial interpolation. An average PSNR gain of 1.48 dB is obtained in virtual views synthesised from depth maps using the proposed method.

Keywords

Multiview video-plus-depth Depth map reconstruction Depth loss Error concealment Geometric transforms

URI

http://hdl.handle.net/10400.8/12982

Citation

Sylvain Marcelino, Salviano Soares, Sergio M.M. de Faria, Pedro Assuncao, Reconstruction of lost depth data in multiview video-plus-depth communications using geometric transforms, Journal of Visual Communication and Image Representation, Volume 40, Part B, 2016, Pages 589-599, ISSN 1047-3203, https://doi.org/10.1016/j.jvcir.2016.07.024.