An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering

详细信息    查看全文

• 作者：Shihua Cui (1)
  Huijuan Cui (1)
  Kun Tang (1)
  
• 关键词：Error concealment ; Kalman filter ; Motion vector prediction ; H.264/AVC
• 刊名：Signal, Image and Video Processing
• 出版年：2014
• 出版时间：November 2014
• 年：2014
• 卷：8
• 期：8
• 页码：1533-1542
• 全文大小：2,865 KB
• 参考文献：1. Lam, W.M., Reibman, A.R., Liu, B.: Recovery of lost or erroneously received motion vectors. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. 417-20 (1993)
  2. Thaipanich, T., Wu, P.-H., Kuo, C.-C.J.: Low-complexity video error concealment for mobile applications using OBMA. In: IEEE Trans. Consum. Electron. 54(2), 753-60 (2008)
  3. Al-Mualla, M.E., Canagarajah, N., Bull, D.R.: Error concealment using motion field interpolation. In: Proceeding of the 1998 IEEE International Conference on Image Processing, vol. 3, pp. 512-16 (1998)
  4. Al-Mualla, M.E., Canagarajah, N., Bull, D.R.: Temporal error concealment using motion field interpolation. Electron. Lett. 35(3), 215-17 (1999) CrossRef
  5. Al-Mualla, M.E., Canagarajah, N., Bull, D.R.: Motion field interpolation for temporal error concealment. In: IEE Proceedings—Vision, Image, and Signal Processing 147(5), 445-53 (2000)
  6. Belfiore, S., Grangetto, M., Magli, E., Olmo, G.: An error concealment algorithm for streaming video. In: Proceedings of the 2003 IEEE International Conference on Image Processing, 3:649-52 (September 2003).
  7. Belfiore, S., Grangetto, M., Magli, E., Olmo, G.: Low bit-rate video based on multiframe optical flow estimation. In: IEEE Trans. Multimed. 7(2), 316-29 (2005)
  8. Peng, Q., Yang, T., Zhu, C.: Block-based temporal error concealment for video packet using motion vector extrapolation. In: IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino. Expositions, vol. 1, pp. 10-4 (2002)
  9. Wu, Z., Boyce, J.M.: An error concealment scheme for entire frame losses based on H.264/AVC. In: Proceedings of the International Symposium on Circuits and Systems, pp. 4463-466 (2006)
  10. Chen, Y., Yu, K., Li, S.: An error concealment algorithm for entire frame loss in video transmission. Presented at IEEE Picture Coding Symposium (2004)
  11. Yan, B., Gharavi, H.A.: hybrid frame concealment algorithm for H.264/AVC. In: IEEE Trans. Image Process 19(1), 98-07 (2010)
  12. Kalman, R.E.: A new approach to linear filtering and prediction problems. J. Basic Eng. 82(1), 35-5 (1960) CrossRef
  13. Lundquist, C., Orguner, U., Gustafsson, F.: Extended target tracking using polynomials with applications to road-map estimation. In: IEEE Trans. Signal Process. 59(1), 15-6 (2011)
  14. Soper, T.D., Haynor, D.R., Glenny, R.W., Seibel, E.J.: In vivo validation of a hybrid tracking system for navigation of an ultrathin bronchoscope within peripheral airways. In: IEEE Trans. Biomed. Eng. 57(3), 736-45 (2010)
  15. Gao, J., Kosaka, A., Kak, A.C.: A multi-Kalman filtering approach for video tracking of human-delineated objects in cluttered environments. Comput. Vis. Image Underst. 102(3), 260-16 (2006) CrossRef
  16. Yin, S., Na, J.H., Choi, J.Y., Oh, S.: Hierarchical Kalman-particle filter with adaptation to motion changes for object tracking. Comput. Vis. Image Underst. 115(6), 885-00 (2011) CrossRef
  17. Breidt, F.J., Carriquiry, A.L.: Highest density gates for target tracking. In: IEEE Trans. Aerosp. Electron. Syst. 36(1), 47-5 (2000)
  18. Graetzel, C.F., Nelson, B.J., Fry, S.N.A.: dynamic region-of-interest vision tracking system applied to the real-time wing kinematic analysis of tethered drosophila. In: IEEE Trans. Autom. Sci. Eng. 7(3), 463-73 (2010)
  19. Rosales, R., Sclaroff, S.A.: framework for heading-guided recognition of human activity. Comput. Vis. Image Underst. 91(3), 335-67 (2003) CrossRef
  20. Reddy, J.B.V., Dash, P.K., Samantaray, R., Moharana, A.K.: Fast tracking of power quality disturbance signals using an optimized unscented filter. In: IEEE Trans. Instrum. Meas. 58(12), 3943-952 (2009)
  21. Dorini, L.B., Goldenstein, S.K.: Unscented feature tracking. Comput. Vis. Image Underst. <
• 作者单位：Shihua Cui (1)
  Huijuan Cui (1)
  Kun Tang (1)
  
  1. Tsinghua National Laboratory for Information Science and Technology, Department of Electronic Engineering, Tsinghua University, Beijing, 100084, People’s Republic of China
  
• ISSN：1863-1711

文摘

Error concealment at the decoder side is an economical approach to ensuring an acceptable and stable video quality in case of packet erasure or loss, and thus, it has attracted considerable research and application interest. Relevant techniques usually employ the spatial or temporal correlation to recover the motion vectors (MVs) of the missing blocks, and interpolation, extrapolation, or boundary-matching schemes are usually effective. However, for heavily corrupted sequences, e.g., with block loss rate beyond 50?%, most methods might perform less satisfactorily. Inspired by the tracking efficiency of Kalman filter (KF), in the present work, we adopted it to predict the missing MVs, and the unpredicted ones (minority) were restored complementarily using a modified bilinear motion field interpolation (MFI) method. Since the KF prediction is independent of the loss rate, the present framework proves to be robust for heavily corrupted videos. Experimental results on typical sequences reveal that the proposed algorithm outperforms the boundary-matching algorithm embedded in the H.264/AVC reference code, the MFI and the MV extrapolation techniques in the literature.