21 6 2009 6 J OU RNAL OF COMPU TER2A IDED DESIGN & COMPU TER GRAP HICS Vol. 21, No. 6 J une, 2009 1) 1) 1) 1,2) 1) ( 430074) 2) ( 430205) (yjqing @hust. edu. cn),.,.,, ;,,.,,. ;; ;; TP391 Adaptive Video Transmission Using Motion Intensity Yu J unqing 1) Liu Chong 1) He Yunfeng 1) Hu Shenghong 1,2) 1) ( School of Com puter S cience & Technology, H uaz hong Universit y of Science & Technology, W uhan 430074) 2) ( Com p uter S chool, H ubei Universit y of Economics, W uhan 430205) Abstract Adaptive video transmission is dedicated to deliver video content over dynamic and heterogeneo us net works and devices. U sing Darwin st reaming server, a set of adaptive st rategy is proposed based on motion intensity. To avoid network congestion, the sending rate level on t he server is controlled by detecting t he packet loss rate in real time. To eliminate t he mo saic effect brought by f rame dropping, an algorit hm of certain P f rame dropping is p ropo sed. A s for different motio n intensity, the video quality is different when t he f rame dropping rate is same, so t he motion intensity descriptor from MPEG27 standard is introduced to t he adaptive strategy as a parameter. Experimental result s demonstrate t hat the proposed strategies can not only improve t he overall video quality, but also eliminate t he mo saic effectively. Key words motion intensity ; adaptive transmission ; Darwin streaming server ; f rame dropping ; mo saic,,.,, [1 ].. 2,,,. :2008-07 - 16 ; :2009-01 - 12. :(60703049) ; (2007ABA265) ; (200850731353).,,1975,,,CCF,.,,1983,,,.,,1977,,,.,,1979,,,.
848 2009, DVMM. Chang,, [2 ]. Wang, [3 ].,,. H.264, (Darwin streaming server, DSS). DSS 7, ( additive increase and multiplicative decreasing,a IMD), P ;,. 1 5,., (common intermediate format, CIF) 25 Πs 50,80,100 120, MPEG27. 1, 1 5. 1,, 1,, 6. 86,; 2,, 69. 50 ; 3,,, 80. 13 ; 4,, 110. 56 ; 5,, 126.79. 1 1. 1 MPEG27,, [4 ],.,,.,,. MPEG21, : Step1. MPEG21 mpeg2decode MPEG21P, Cmv = { R ( i, j) }., R ( i, j) = x 2 ii + y 2 ii,( i, j), xii y ii ( i, j) x y. Step2. C avg I mv = 1 Cmv IJ ( i, j), i = 1 J I, J P x y. j = 1 Step3. P S = I 1 IJ ( C avg mv - Cmv ( i, j) ) 2. i =1 J j =1 Step4. S - = E( S). S -, 1 1 5 1. 2, 2. 1),, (kbp s) 2. 2,,,.,,,
6 : 849,, I,.,,. 5,I,,,.,,. 2 2), [5 ]. Q ( L) = N 1 N n = 1 45 - PS N R ( n,, L) 45 L., PS N R ( n,, L ) n, 45, N. 3,,,,.,,.,,. 2, DSS.. 2. 1 Hint Track H.264,Hint Track,.,: 1) I 20 %,B P,P ;2),B P,. B, P B, B,;B P,,I. 7,1. 1 1 kallpacket s 2 k70percentbframes 30 % B 3 k30percentbframes 70 % B 4 knobframes B 5 k70percent PFrames 30 % P 6 k30percent PFrames 70 % P 7 k KeyFramesOnly I 3 : 2. 2, I,I,,. B,30 % B B, ; 70 % B, B. P, P I P,,
850 2009 P,,, P., P ;P, P P., P. P, P 2 I. 30 % P, I I P, 70 % P, I.,, P. 2. 3,,. (real2time transport control protocol, R TCP), [627 ].,,,.,.,, P - loss ( t) = Ploss ( t) + (1 - ) P - loss ( t - 1)., 1Π4 1Π8 ; P - loss ( t), Ploss ( t). 4,; 6,., TCP, A IMD [829 ],., 3. P1, P2,.,,, [10 ]. k = k - -, Ploss < P1, n 6, k > 1 4, Ploss > P2, n 4, k < 4 7, Ploss > P2, n 4, k 4 ;, k, n, P1, P2.,,, TCP., :1 3, 4,B ;4 6, 7, I. 2. 4,,,,.,,. 3, 10 %, 2. 2 1 2 3 4 5 1 3 5 7 9 30 25 20 17 15, ;,.,,,.,.,,,,.,,,,. 3 3. 1 Apple DSS 5.5.4. DSS 2
6 : 851,, ;. R TP,,. 3. 2,,.., ;,,,, 2 Πs. 4 10 (peak signal to noise, PSNR). 4 k30percent PFrames,,,. 5 2, P, P,. 6 PS N R 18. 522, 18.382,17. 864 23. 274, 24. 421, 22. 704,6. 6 PSNR,1 5., 5,,, ;,,.,,.,,,,,. 4,.,,,,,.,MPEG27 MPEG221. 5 [ 1 ] Rejaje R, Handley M, Estrin D. Layered quality adaptation for internet video streaming [J ]. IEEE Journal on Selected Areas in Communications, 2000, 18 (12) : 253022543 [ 2 ] Chang S F, Zhong D, Kumar R. Real2time content2based adaptive streaming of sport s videos [ C] ΠΠProceedings of IEEE Workshop on Content2Based Access of Image and Video Library, Hawaii, 2001 : 1392146
852 2009 [ 3 ] Wang Y, Kim J G, Chang S F. Content2based utility function prediction for real2time MPEG24 video transcoding [ C] ΠΠProceedings of International Conference on Image Processing, Barcelona, 2003 : I1892I192 [ 4 ] Peker K A, Alatan A A, Akansu A N. Low2level motion activity features for semantic characterization of video [ C] ΠΠ Proceedings of IEEE International Conference on Multimedia and Expo, Vancouver, 2000 : 8012804 [ 5 ] Lotfallah O A, Reisslein M, Panchanathan S. Adaptive video transmission schemes using MPEG27 motion intensity descriptor [J ]. IEEE Transactions on Circuits and Systems for Video Technology, 2006, 16 (8) : 9292946 [ 6 ] Cheng W X, Lei Z M. A modified R TP adaptive algorit hm [ C] ΠΠProceedings of IEEE International Conference on Info2tech and Info2net, Beijing, 2001 : 33238 [ 7 ] Rejaie R, Handley M, Estrin D. RAP : an end2to2end rate2based congestion control mechanism for realtime streams in the internet [ C] ΠΠProceedings of the 18th Annual Joint Conference on t he IEEE Computer and Communications Societies, New York, 1999 : 133721345 [ 8 ] Bansal D, Balakrishnan H. TCP2friendly congestion control for real2time streaming applications [ R]. Cambridge : Massachusetts Institute of Technology, 2000 [ 9 ] Yan J Y, Katrinis K, May M, et al. Media2 and TCP2friendly congestion control for scalable video streams [J ]. IEEE Transactions on Multimedia, 2006, 8 ( 2) : 1962 206 [ 10 ] Bertin C, Def e I, Kangasoja J, et al. Commerce with MPEG24 on the internet with QoS [ C] ΠΠProceedings of IEEE International Conference on Multimedia Computing and Systems, Florence, 1999 : 104321045 ( 846 ) [ 10 ] Soucy M, Godin G, Rioux M. A texture2mapping approach for the compression of colored 3D triangulations [J ]. The Visual Computer, 1996, 12 (10) : 5032514 [ 11 ] Garland M, Heckbert P S. Simplifying surfaces with color and texture using quadric error metrics [ C] ΠΠProceedings of the Conference on Visualization, Research Triangle Park, 1998 : 2632269 [ 12 ] Zhang Liyan, Zhou Rurong, Tang Jie, et al. Research on mesh simplification with additional attributes [J ]. Journal of Computer2Aided Design & Computer Graphics, 2002, 14 (3) : 1992203 (in Chinese) (,,,. [J ]., 2002, 14 (3) : 1992203) [ 13 ] Hoppe H. Progressive meshes [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAP H, New Orleans, 1996 : 992108 [ 14 ] Sander P V, Snyder J, Gortler S J, et al. Texture mapping progressive meshes [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, 2001 : 4092416 [ 15 ] Garland M, Heckbert P S. Surface simplification using quadric error metrics [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, 1997 : 2092216 [ 16 ] Dyn N, Levin D, Gregory J A. A butterfly subdivision scheme for surface interpolation wit h tension control [J ]. ACM Transactions on Graphics, 1990, 9 (2) : 1602169 [ 17 ] Garland M. Multiresolution modeling : survey & future opportunities [ C] ΠΠProceedings of t he Eurographics, Granada, 1999 : 49265 [ 18 ] van Kaick O M, Pedrini H. A comparative evaluation of metrics for fast mesh simplification [J ]. Computer Graphics Forum, 2006, 25 (2) : 1972210