摘要
摘 要
IP 网络视频通信是网络多媒体应用的重要内容,视频业务的本身特性决定
了视频传输对网络带宽、传输延时和丢包特性提出了较高的要求。然而,目前
的 IP 网络采用“尽力而为”(Best-effort)的方式提供服务,不能为视频传输提
供服务质量(QoS,Quality of Service)保证。另外,网络和终端的异构性使得
视频通信在有效性和灵活性方面面临挑战。当前的网络特性不可避免地会带来
传输差错,这种差错会导致视频重建质量的下降,并且差错会在时间域和空间
域上传播,使得用户的主观感受质量进一步恶化。本文针对目前视频传输的差
错问题,分别设计了基于终端和基于网络的差错控制方法,旨在避免差错的发
生或在差错已经发生的情况下尽可能降低差错对视频通信质量的影响,提高视
频通信的可靠性和有效性。
首先,从信源的角度,以 H.263 编码框架为基础,本文提出了基于敏感度
和反馈信息的 Intra 帧刷新的差错控制新方法。前者分析了视频业务的特性,并
结合接收端的误码恢复能力,提出了敏感度的概念,并以此为依据实现帧刷新;
后者以信道的反馈信息作为 Intra 帧刷新的依据,实现了对差错更具针对性的刷
新策略。这两种方法克服了传统的周期 Intra 帧刷新编码效率低的缺点,同时保
持了周期刷新对差错的自恢复能力。
接下来,本文研究了两种 IP 网络信源信道联合编码策略,在分析 Shannon
分离编码理论在 IP 网络视频通信应用中存在局限性的基础上,采用了一种简单
的信源失真估计模型作为信源编码失真的估计方法。然后,引入信道编码理论
对端到端的信道失真估计模型作了修正,提出了一种改进的信道失真估计模型,
并分别采用 H.263 信源编码和 RS 信道编码方法,提出了两种信源信道联合编码
策略。
考虑到网络行为对差错的影响,本文针对传统的 QoS 控制机制存在的问题,
提出了一种面向视频业务的 QoS 控制策略,该策略结合 H.263 分层编码方法,
提出了面向业务的 QoS 定性描述方法,并引入了 QoS 协商机制。基于视频业务
的特性,采用了基于分层重要性的队列管理机制和基于终端的速率控制方法,
分别从网络层和传输层对差错加以控制。
为验证上述方法的可行性,我们搭建了 IP 网络视频通信仿真平台,用以验
证本文提出的方法和机制的有效性。
Abstract
As the crucial component of multimedia communications, video has high demands of network
bandwidth, latency and loss in terms of real-time transmission. However, the best effort or
reliability of data transmission provided by the current IP network doesn’t offer any quality of
service (QoS) guarantees for video transmission. In addition, the heterogeneity of the networks
and end-systems make it difficult to transmit video in an efficient and flexible way. It is
inevitable for a communication system to generate transmission errors due to variable network
characteristics, which will result in decreasing of video reconstructed quality. Furthermore, errors
will propagate in temporal and spatial domains, which will seriously deteriorate subjective
perceptual quality. In this paper, the solutions to error resilience are presented from the
perspectives of network and end system. The goal of research is to relieve the negative influence
caused by errors and improve the reliability and efficiency of video transmission.
Two novel methods of Intra update are proposed in this paper. The first one defines a parameter
called Sensitivity Degree, which combines the properties of video service and capability of error
recovery at the receiver side. The addressed Intra update strategy is discussed based on the
parameter. Another one gives a more efficient update method based on the feedback information
of the communication channel. These two methods overcome the disadvantage of low coding
efficiency while keeping the features of self-recovery to errors in traditional periodic Intra update
method.
Shannon’s separate coding theorem is not applicable in video communication. In the next section
of the paper, joint source channel coding scheme is employed on the basis of features of source
and channel coding. A simple source distortion model is introduced to estimate the distortion of
source coding, and the packet-based channel coding is applied to estimate the end-to-end channel
distortion. Two joint source channel coding strategies are proposed based on H.263 source coding
and RS channel coding respectively.
In the consideration of the effect of network behaviors, the traditional QoS mechanism is
analyzed and a new video-oriented QoS method which applies the scalable coding of H.263 is
proposed. Then a service-based QoS qualitative description method and a QoS negotiation
mechanism are proposed. Congestion control is implemented at both transport layer and network
layer using queue management based on the importance of data and rate control method of the
endpoint.
A test bed for video communication over IP network has been established to verify the feasibility
of the proposed QoS mechanism and error control methods.
引文
参考文献
1 沈兰荪.《图像编码与异步传输》[M] 人民邮电出版社,1998.
2 沈兰荪,卓力,田栋,汪孔桥.《视频编码与低速率传输》[M] 电子工业出版社,2001
3 Dapeng Li, et al. Streaming Video over the Internet: Approaches and Directions [J]. IEEE
Trans on Circuits and Systems For Video Technology, 2001,11(1):1-20.
4 Dapeng Wu, et al. Transporting Real-time Video over the Internet: Challenges and
Approaches.[J]. proceedings of the IEEE 2000,88(Y):1-19
5 Dapeng Wu, et al. On End-to-End Architecture for Transporting MPEG-4 Video over the
Internet [J]. IEEE Trans. Circuits and Systems for Video Technology, 2000, 10(6): 923-941.
6 Konrad,J. Visual Communications of Tomorrow: Natural, Efficient, and Flexible [J].IEEE
Communications Magazine .2001,39(1):126-133
7 糜正琨. 《IP 网络电话技术》[M] 北京:人民邮电出版社,2000.6
8 张宏科,张思东,刘文红. 《路由器原理与技术》[M] 国防工业出版社,2003.1
9 Srinivas Vegesna. 《IP 服务质量》[M]. 北京: 人民邮电出版社, 2001.8
10 刘晓莉 IP 网络 QoS 的实现机制分析 通信技术 2001,7:52-55.
11 David C. Lee et al, The Next Generation of the Internet: Aspects of the Internet Protocol
Version 6. IEEE Network, 1998, 2:28-33.
12 Lars Gullik; Haakon Bryhni, et al. Wireless Experimental Metropolitan Area Network Using
IPv6 in Norway. Proceedings of the 32nd Hawaii International Conference on System
Science,1999: 1-13
13 Juha Wiljakka. Transition to IPv6 in GPRS and WCDMA Mobile Networks. IEEE
Communication Magazine, 2002,4:134-140
14 K.P. Worral. The Impact of IPv6 on Wireless Networks. 3G Mobile Technologies
International Conference, March 26-28, 2001, United Kingdom: 323-329.
15 Jorg Ottensmeyer. IP version6 – an analysis of the long way from concept to large-scale
deployment. Proceedings of the 28th Euromicro Conference: 108-111.
16 ITU-T. Video Coding for Low Bitrate Communication. Draft ITU-T Recommendation H.263.
Mar 1996
17 ITU-T. Video Coding for Low Bitrate Communication. Draft ITU-T Recommendation H.263
Version 2. Jan 1998
18 ITU-T. Draft for “H.263++” Annexes U, V, and W to Recommendation H.263. Nov 2000
19 Yao Wang; Qin-Fan Zhu. Error Control and Concealment for Video Communication: A
Review [J].Proceedings of the IEEE ,1998,86(5):974-997
20 Yao Wang; Wenger, S.; Jiantao Wen; Katsaggelos, A.K. Error resilient video coding
techniques [J] IEEE Signal Processing Magazine .2000,17(4):61-82
21 卓力,沈兰荪等. 视频流关键技术研究进展.电子学报 2002,30(8):1213-1218
22 Yan Mei; Lynch, W.E.; Tho Le-Ngoc; Joint forward error correction and error concealment
for compressed video. Proceedings. International Conference on Information Technology:
Coding and Computing, 2002: 410 -415
23 Stockhammer, T.; Jenkac, H.; Weiss, C. Feedback and error protection strategies for wireless
progressive video transmission. IEEE Transactions on Circuits and Systems for Video
83
北京工业大学工学硕士学位论文
Technology, 2002, 6(12): 465 -482
24 Weiping Li. Overview of Fine Granularity Scalability in MPEG-4 Video Standard [J]. IEEE
Trans. Circuits and Systems For Video Technology, 2001, 11(3): 301-317.
25 J.Liao and J.Villasenor. Adaptive Intra Update for Video Coding over Noisy Channels. [J]
Proc. ICIP, 1996, 3: 763–766.
26 Wu, D.; Hou, Y.T. et al. An end-to-end approach for optimal mode selection in Internet video
communication: theory and application. IEEE Journal on Selected Areas in Communications,
2000,6(18): 977 -995
27 Cote, G.; Shirani, S.; Kossentini, F. Optimal mode selection and synchronization for robust
video communications over error-prone networks. IEEE Journal on Selected Areas in
Communications, 2000,6(18): 952 -965
28 Injong Rhee et al, Error Recovery for Interactive Video Transmission over the Internet.
IEEE Journal on selected area in communication, 2000,6(18): 1033-1049
29 Suk Kim Chin; Braun, R. A survey of UDP packet loss characteristics. Conference Record of
the 35th Asilomar Conference on Signals, Systems and Computers, 2001,1: 200 -204
30 宋彬,常义林. 视频通信抗误码方法研究新进展,电子学报,2002,10(30):1-5
31 Frossard, P. FEC performance in multimedia streaming. IEEE Communications Letters,
2001,3(5): 122-124
32 Tu-Chih Wang; Hung-Chi Fang; Liang-Gee Chen. Low delay, error robust wireless video
transmission architecture for video communication. Proceedings. 2002 IEEE International
Conference on Multimedia and Expo, 2002, 1: 265 -268
33 Jian Lu. Signal Processing for Internet Video Streaming: A Review. Proceedings of SPIE
Image and Video Communication and Processing 2000.
34 Wong, W.Y. et al, Concealment of damaged blocks by neighborhood regions partitioned
matching Proceedings. 2001 International Conference on Image Processing, 2001,2: 45-48
35 Bernd.G, et al, Feedback-based Error Control for Mobile Video Transmission. Proceedings of
IEEE, 1999, 10(87): 1707-1723
36 蔡安妮,孙景鳌.多媒体通信技术基础.电子工业出版社,2000:58~69
37 Kwon, D.; Driessen, P.; Error concealment techniques for H.263 video transmission, 1999
IEEE Pacific Rim Conference on Communications, Computers and Signal Processing,
1999: 276–279
38 Chien-Wu Tsai, et al, A hybrid and flexible H.263-based error resilient and testing system.
Proceedings of IEEE Region 10 International Conference on Electrical and Electronic
Technology, 2001,1: 122 -128
39 田栋,姚志恒,沈兰荪.H.263 的发展及应用.测控技术,2001,20(5):5~12
40 Jae-Young Pyun, et al, Packet loss resilience for video stream over the internet. IEEE
Transactions on Consumer Electronics, 2002,8(48): 556 -563
41 Kim, Y.-G, et al, TCP-Friendly Internet Video With Smooth and Fast Rate Adaptation and
Network-Aware Error Control. IEEE Transactions on Circuits and Systems for Video
Technology, 2004, 2(14): 256 – 268
42 Kim, D.I.; Hossain, E.; Bhargava, V.K. Dynamic Rate Adaptation and Integrated Rate and
Error Control in Cellular WCDMA Networks. IEEE Transactions on Wireless
Communications, 2004, 1(3) :35 – 49
43 Li, Z.G, et al. A unified architecture for real-time video-coding systems. IEEE Transactions
84
参考文献
on Circuits and Systems for Video Technology, 2003, 6(13): 472 – 487
44 Yiao Liu; Badawy, W. A novel adaptive error control scheme for real time wireless video
streaming. 2003 Proceedings. ITRE2003. International Conference on Information
Technology: Research and Education, Aug. 11-13, 2003: 460 – 463
45 Pei, Y.; Modestino, J.W. Use of concatenated FEC coding for real-time packet video over
heterogeneous wired-to-wireless IP networks. 2003. ISCAS '03. Proceedings of the 2003
International Symposium on Circuits and Systems, 25-28 May 2003,2: 840-843
46 Xiao Liu; Badawy, W. A novel error control scheme for video streaming over IEEE802.11
network IEEE CCECE 2003. Canadian Conference on Electrical and Computer
Engineering, May 4-7, 2003, 2:981-984
47 Fan Zhai, et al. A rate-distortion optimized error control scheme for scalable video streaming
over the internet. ICME '03. Proceedings. 2003 International Conference on Multimedia and
Expo, 6-9 July 2003, 2: 125 - 128
48 Appadwedula, S. et al. Joint source-channel matching for a wireless communications link
Communications. IEEE International Conference on 7-11 Jun 1998, Atlanta.
1998,6(1):482-486
49 Qian, L.et al. A general joint source-channel matching method for wireless video
transmission. Data Compression Conference, 1999. Proceedings.DCC '99 on 29-31 Mar 1999,
Utah: 414-423.
50 Kondi, L.P, et al, Joint source-channel coding for motion-compensated DCT-based SNR
scalable video, Image Processing, IEEE Transactions on , 2002,9(11): 1043 -1052
51 Zhihai He; Mitra, S.K.; A linear source model and a unified rate control algorithm for DCT
video coding. [J] IEEE Transactions on Circuits and Systems for Video Technology, 2002,
11(12): 970-982.
52 Jordi Ribas-Corbera, et al. Rate control in DCT video Coding for low-delay communications.
[J] IEEE Trans on Circuits and Systems for Video Technology, 1999, 2(9):172-185.
53 Kwasinski, A.; Chande, V.; Farvardin, N. Delay-constrained joint source-channel coding
using incremental redundancy with feedback. Information Theory Workshop, 2003.
Proceedings. 2003 IEEE , 31 March-4 April 2003: 283 – 286
54 Gastpar, M.; Rimoldi, B. Source-channel communication with feedback. Information Theory
Workshop, 2003. Proceedings. 2003 IEEE , 31 March-4 April 2003: 279 – 282
55 Zhihai He, ChangWen Chen. End-to-end video quality analysis and modeling for video
streaming over IP network. Multimedia and Expo, 2002. ICME '02. Proceedings.IEEE
International Conference on 26-29 Aug.2002, Lauzanne. 2002(1): 853-856.
56 Gallant, M.; Kossentini, F. Rate-distortion optimal joint source/channel coding for robust and
efficient low bit rate packet video communications. ICIP 2000 on 10-13, Sep, 2000, Canada.
Proceedings.2000 International Conference on Image Processing, 2000(1):355-358.
57 Yong Kwan Kim, et al, A novel linear source model and a unified rate control algorithm for
H.263/MPEG-2/MPEG-4. 2001. Proceedings. (ICASSP '01). 2001 IEEE International
Conference on Acoustics, Speech, and Signal Processing, 7-11 May 2001, 3: 1777 -1780
58 Hamzaoui, R.; Stankovic, V.; Zixiang Xiong; Fast joint source-channel coding algorithms for
Internet/wireless multimedia. IJCNN '02. Proceedings of the 2002 International Joint
Conference on Neural Networks, 12-17 May 2002, 3: 2108 -2113
59 Osterberg, P.; Forsgren, D.; Tingting Zhang; Receiver-controlled joint source/channel coding
85
北京工业大学工学硕士学位论文
on the application level, for video streaming over wlans. Vehicular Technology Conference,
2003. VTC 2003-Spring. The 57th IEEE Semiannual , April 22-25, 2003, 3: 1558 – 1561
60 Jianfei Cai.; ChangWen Chen. Robust joint source-channel coding for image transmission
over wireless channels. [J] IEEE Transactions on Circuits and Systems for Video Technology,
2000, 9(10):962-966.
61 Stankovic, V.; Hamzaoui, R.; Xiong, Z.; Efficient Channel Code Rate Selection Algorithms
for Forward Error Correction of Packetized Multimedia Bitstreams in Varying Channels.
IEEE Transactions on Multimedia, 2004, 4(6): 240 – 248
62 Reininger, D.; Raychaudhuri, D.; Ott, M. A dynamic quality of service framework for video
in broadband networks, IEEE Network , 1998,11(12): 22 –34
63 Shigang Chen; Nahrstedt, K. An overview of quality of service routing for next-generation
high-speed networks: problems and solutions, IEEE Network, 1998,11(12): 64 –79
64 Gevros, P, et al, Congestion control mechanisms and the best effort service model, IEEE
Network , 2001,5(15): 16 –26
65 Xia Gao; Gang Wu; Miki, T. End-to-end QoS provisioning in mobile heterogeneous networks.
Wireless Communications and Networking, 2003. WCNC 2003 IEEE, 16-20 March 2003, 2:
1361 - 1366
66 Nikolaidis, I. QoS traffic management in IP and ATM networks [M], IEEE Network,
2000,3(14): 8–18
67 Marcus, W.S. An architecture for QoS analysis and experimentation, IEEE/ACM
Transactions on Networking, 1996, 8(4): 597 –603
68 Seitz, N. ITU-T QoS standards for IP-based networks. Communications Magazine, IEEE,
2003, 6(41): 82 – 89
69 Floyd, S.; Paxson, V. Difficulties in simulating the Internet, IEEE/ACM Transactions on
Networking, 2001, 8(9):: 392 –403
70 Floyd, S. A report on recent developments in TCP congestion control, IEEE Communications
Magazine , 2001, 4(39):: 84 –90
71 Floyd, S.; Jacobson, V. Random early detection gateways for congestion avoidance,
IEEE/ACM Transactions on Networking, 1993, 8(4): 397– 413
72 El-Gendy, M.A.; Bose, A.; Shin, K.G. Evolution of the Internet QoS and support for soft
real-time applications, Proceedings of the IEEE, 2003, 7(91): 1086 – 1104
73 Ahn, C.W.; Ramakrishna, R.S. QoS Provisioning Dynamic Connection-Admission Control
for Multimedia Wireless Networks Using a Hopfield Neural Network., IEEE Transactions on
Vehicular Technology, 2004, 1(53): 106 – 117
74 Jacobson.V Congestion avoidance and control. ACM Computer Communication Review,
1988, 18(4): 314-329
75 宋磊,黄祥林,沈兰荪,局域网视频流传输系统的设计与实现,测控技术,2002,21(5):5-8.
76 Zhang Zhanjun; Han Chengde. A RTP-based architecture of multimedia communications for
wireless networks, 2001. Proceedings. ICII 2001 - Beijing. 2001 International Conferences
on Info-tech and Info-net, 2001, 5:: 345 -350
77 Ahmed, T.; Mehaoua, A.; Buridant, G. Implementing MPEG-4 video on demand over IP
Differentiated Services, Global Telecommunications Conference, 2001. GLOBECOM '01.
IEEE, 2001,4: 2489 -2493
78 W.Richard Stevens. 《TCP/IP 详解 卷 1:协议》[M]. 北京: 机械工业出版社,2000.