View synthesis distortion elimination filter for depth video coding in 3D video broadcasting

详细信息    查看全文

• 作者：Linwei Zhu ; Yun Zhang ; Xu Wang ; Sam Kwong
• 关键词：3D video ; View synthesis ; Depth image based rendering ; Depth video coding
• 刊名：Multimedia Tools and Applications
• 出版年：2015
• 出版时间：July 2015
• 年：2015
• 卷：74
• 期：15
• 页码：5935-5954
• 全文大小：2,859 KB
• 参考文献：1.Bjontegaard G (2001) Calculation of Average PSNR Differences between RD-curves, ITU-T Video Coding Experts Group (VCEG), document M33, Austin, TX
  2.Chen Y, Pandit P, Yea S, Lim CS (2009) Draft reference software for MVC, ITU-T JVT –AE207
  3.Domański M, Grajek T, Klimaszewski K, Kurc M, Stankiewicz O, Stankowski J, Wegner K (2009) Poznań multiview video test sequences and camera parameters, ISO/IEC JTC1/SC29/WG11 MPEG 2009/M17050, Xian, China
  4.Feldmann I, Mueller M, Zilly F, Tanger R, Mueller K, Smolic A, Kauff P, Wiegand T (2008) HHI test material for 3D Video, SO/IEC JTC1/SC29/WG11 MPEG2008/M15413, Archamps, France
  5.Hu S, Kwong S, Zhang Y, Kuo C–CJ (2013) Rate-distortion optimized rate control for depth map based 3D video coding. IEEE Trans Image Process 22(2):585-94MathSciNet View Article
  6.Liu S, Lai P, Tian D, Chen CW (2011) New depth coding techniques with utilization of corresponding video. IEEE Trans Broadcast 57(2):551-61View Article
  7.Nagoya University FTV test sequences. [Online]. Available: http://?www.?tanimoto.?nuee.?nagoya-u.?ac.?jp/-/span>
  8.Nguyen V, Min D, Do MN (2013) Efficient techniques for depth video compression using weighted mode filtering. IEEE Trans Circ Syst Video Technol 23(2):189-02View Article
  9.Nya PN, K?ppel M, Doshkov D, Lakshman H, Merkle P, Müller K, Wiegand T (2011) Depth Image-based rendering with advanced texture synthesis for 3D video. IEEE Trans Multimed 13:453-65View Article
  10.Oh K, Yea S, Vetro A, Ho Y (2009) Depth reconstruction filter and down/up sampling for depth coding in 3-D Video. IEEE Signal Process Lett 16(9):747-50View Article
  11.Oh K, Yea S, Vetro A, Ho Y (2011) Depth coding using a boundary reconstruction filter for 3-D video systems. IEEE Trans Circ Syst Video Technol 21(3):350-58View Article
  12.Tanimoto M, Fujii T, Suzuki K (2009) View Synthesis Algorithm in View Synthesis Reference Software 3.0 (VSRS 3.0), Tech. Rep. Document M16090, ISO/IEC JTC1/SC29/WG11
  13.Tanimoto M, Tehrani MP, Fujii T, Yendo T (2012) FTV for 3-D spatial communication. Proc IEEE 100(4):905-17View Article
  14.Yuan H, Chang Y, Huo J, Yang F, Lu Z (2011) Model-based joint bit allocation between texture videos and depth maps for 3-D video coding. IEEE Trans Circ Syst Video Technol 21(4):485-97View Article
  15.Yuan H, Liu J, Xu H, Li Z, Liu W (2012) Coding distortion elimination of virtual view synthesis for 3D video system: theoretical analyses and implementation. IEEE Trans Broadcast 58(4):558-68View Article
  16.Zhang Y, Jiang G, Yu M, Ho Y (2009) Adaptive multiview video coding scheme based on spatiotemporal correlation analyses. ETRI J 31(2):151-61View Article
  17.Zhang Y, Kwong S, Xu L, Hu S, Jiang G, Kuo C–CJ (2013) Regional bit allocation and rate distortion optimization for multiview depth video coding with view synthesis distortion model. IEEE Trans Image Process 22(9):3497-512View Article
  18.Zhang L, Tam WJ (2005) Stereoscopic image generation based on depth images for 3DTV. IEEE Trans Broadcast 51(2):191-95View Article
  19.Zhao Y, Zhu C, Chen Z, Yu L (2011) Depth no-synthesis-error model for view synthesis in 3-D video. IEEE Trans Image Process 20(8):2221-227MathSciNet View Article
  20.Zitnick CL, Kang SB, Uyttendaele M, Winder S, Szeliski R (2004) High-quality video view interpolation using a layered representation. ACM SIGGRAPH and ACM Trans. Graphics 23(3):600-08View Article
  
• 作者单位：Linwei Zhu (1)
  Yun Zhang (1) (2)
  Xu Wang (2) (3)
  Sam Kwong (2) (3)
  
  1. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
  2. Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
  3. Shenzhen Research Institute, City University of HongKong, Shenzhen, China
  
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems
  Computer Communication Networks
  Data Structures, Cryptology and Information Theory
  Special Purpose and Application-Based Systems
  
• 出版者：Springer Netherlands
• ISSN：1573-7721

文摘

Depth image based rendering (DIBR), which can generate synthesized images according to the users-demand, is a key technique for achieving 3D television. However, view synthesis by DIBR technique is very sensitive to depth coding distortion. Because depth distortion will lead to geometrical rendering position errors, and seriously affect the quality of synthesized images. In this paper, we propose an in-loop filter to minimize view synthesis distortion at the cost of transmitting extra filter parameters as supplementary information. And an adaptive parameter determination scheme is presented for the proposed filter. Then a good trade-off between bit rate and view synthesis distortion has been achieved by considering the spatial-temporal correlations of 3D video sequence. The simulation results reveal that the proposed view synthesis distortion elimination method can significantly improve the rate-distortion performance, which achieves Bjontegaard Delta Peak Signal-to-Noise Ratio (BDPSNR) gain from 0.41 to 1.09?dB compared with the benchmark.