Adaptive Video Transmission Using Motion Intensity

Μέγεθος: px

Εμφάνιση ξεκινά από τη σελίδα:

Download "Adaptive Video Transmission Using Motion Intensity"

Τίμαιος Μεταξάς
5 χρόνια πριν
Προβολές:

1 J OU RNAL OF COMPU TER2A IDED DESIGN & COMPU TER GRAP HICS Vol. 21, No. 6 J une, ) 1) 1) 1,2) 1) ( ) 2) ( ) edu. cn),.,.,, ;,,.,,. ;; ;; TP391 Adaptive Video Transmission Using Motion Intensity Yu J unqing 1) Liu Chong 1) He Yunfeng 1) Hu Shenghong 1,2) 1) ( School of Com puter S cience & Technology, H uaz hong Universit y of Science & Technology, W uhan ) 2) ( Com p uter S chool, H ubei Universit y of Economics, W uhan ) Abstract Adaptive video transmission is dedicated to deliver video content over dynamic and heterogeneo us net works and devices. U sing Darwin st reaming server, a set of adaptive st rategy is proposed based on motion intensity. To avoid network congestion, the sending rate level on t he server is controlled by detecting t he packet loss rate in real time. To eliminate t he mo saic effect brought by f rame dropping, an algorit hm of certain P f rame dropping is p ropo sed. A s for different motio n intensity, the video quality is different when t he f rame dropping rate is same, so t he motion intensity descriptor from MPEG27 standard is introduced to t he adaptive strategy as a parameter. Experimental result s demonstrate t hat the proposed strategies can not only improve t he overall video quality, but also eliminate t he mo saic effectively. Key words motion intensity ; adaptive transmission ; Darwin streaming server ; f rame dropping ; mo saic,,.,, [1 ].. 2,,,. : ; : :( ) ; (2007ABA265) ; ( ).,,1975,,,CCF,.,,1983,,,.,,1977,,,.,,1979,,,.

848 2009, DVMM. Chang,, [2 ]. Wang, [3 ].,,. H.264, (Darwin streaming server, DSS). DSS 7, ( additive increase and multiplicative decreasing,a IMD), P ;,. 1 5,.

2 , DVMM. Chang,, [2 ]. Wang, [3 ].,,. H.264, (Darwin streaming server, DSS). DSS 7, ( additive increase and multiplicative decreasing,a IMD), P ;,. 1 5,., (common intermediate format, CIF) 25 Πs 50,80, , MPEG27. 1, ,, 1,, 6. 86,; 2,, ; 3,,, ; 4,, ; 5,, MPEG27,, [4 ],.,,.,,. MPEG21, : Step1. MPEG21 mpeg2decode MPEG21P, Cmv = { R ( i, j) }., R ( i, j) = x 2 ii + y 2 ii,( i, j), xii y ii ( i, j) x y. Step2. C avg I mv = 1 Cmv IJ ( i, j), i = 1 J I, J P x y. j = 1 Step3. P S = I 1 IJ ( C avg mv - Cmv ( i, j) ) 2. i =1 J j =1 Step4. S - = E( S). S -, , 2. 1),, (kbp s) 2. 2,,,.,,,

6 : 849,, I,.,,. 5,I,,,.,,. 2 2), [5 ]. Q ( L) = N 1 N n = 1 45 - PS N R ( n,, L) 45 L., PS N R ( n,, L ) n, 45, N. 3,,,,.,,.,,. 2, DSS.. 2. 1 Hint Track H.264,Hint Track,.,: 1) I 20 %,B P,P ;2),B P,.

3 6 : 849,, I,.,,. 5,I,,,.,,. 2 2), [5 ]. Q ( L) = N 1 N n = PS N R ( n,, L) 45 L., PS N R ( n,, L ) n, 45, N. 3,,,,.,,.,,. 2, DSS Hint Track H.264,Hint Track,.,: 1) I 20 %,B P,P ;2),B P,. B, P B, B,;B P,,I. 7, kallpacket s 2 k70percentbframes 30 % B 3 k30percentbframes 70 % B 4 knobframes B 5 k70percent PFrames 30 % P 6 k30percent PFrames 70 % P 7 k KeyFramesOnly I 3 : 2. 2, I,I,,. B,30 % B B, ; 70 % B, B. P, P I P,,

4 P,,, P., P ;P, P P., P. P, P 2 I. 30 % P, I I P, 70 % P, I.,, P. 2. 3,,. (real2time transport control protocol, R TCP), [627 ].,,,.,.,, P - loss ( t) = Ploss ( t) + (1 - ) P - loss ( t - 1)., 1Π4 1Π8 ; P - loss ( t), Ploss ( t). 4,; 6,., TCP, A IMD [829 ],., 3. P1, P2,.,,, [10 ]. k = k - -, Ploss < P1, n 6, k > 1 4, Ploss > P2, n 4, k < 4 7, Ploss > P2, n 4, k 4 ;, k, n, P1, P2.,,, TCP., :1 3, 4,B ;4 6, 7, I. 2. 4,,,,.,,. 3, 10 %, , ;,.,,,.,.,,,,.,,,, Apple DSS DSS 2

6 : 851,, ;. R TP,,. 3. 2,,.., ;,,,, 2 Πs. 4 10 (peak signal to noise, PSNR). 4 k30percent PFrames,,,. 5 2, P, P,. 6 PS N R 18. 522, 18.382,17. 864 23. 274, 24. 421, 22. 704,6. 6 PSNR,1 5., 5,,, ;,,.

5 6 : 851,, ;. R TP,,. 3. 2,,.., ;,,,, 2 Πs (peak signal to noise, PSNR). 4 k30percent PFrames,,,. 5 2, P, P,. 6 PS N R , , , , ,6. 6 PSNR,1 5., 5,,, ;,,.,,.,,,,,. 4,.,,,,,.,MPEG27 MPEG [ 1 ] Rejaje R, Handley M, Estrin D. Layered quality adaptation for internet video streaming [J ]. IEEE Journal on Selected Areas in Communications, 2000, 18 (12) : [ 2 ] Chang S F, Zhong D, Kumar R. Real2time content2based adaptive streaming of sport s videos [ C] ΠΠProceedings of IEEE Workshop on Content2Based Access of Image and Video Library, Hawaii, 2001 :

6 [ 3 ] Wang Y, Kim J G, Chang S F. Content2based utility function prediction for real2time MPEG24 video transcoding [ C] ΠΠProceedings of International Conference on Image Processing, Barcelona, 2003 : I1892I192 [ 4 ] Peker K A, Alatan A A, Akansu A N. Low2level motion activity features for semantic characterization of video [ C] ΠΠ Proceedings of IEEE International Conference on Multimedia and Expo, Vancouver, 2000 : [ 5 ] Lotfallah O A, Reisslein M, Panchanathan S. Adaptive video transmission schemes using MPEG27 motion intensity descriptor [J ]. IEEE Transactions on Circuits and Systems for Video Technology, 2006, 16 (8) : [ 6 ] Cheng W X, Lei Z M. A modified R TP adaptive algorit hm [ C] ΠΠProceedings of IEEE International Conference on Info2tech and Info2net, Beijing, 2001 : [ 7 ] Rejaie R, Handley M, Estrin D. RAP : an end2to2end rate2based congestion control mechanism for realtime streams in the internet [ C] ΠΠProceedings of the 18th Annual Joint Conference on t he IEEE Computer and Communications Societies, New York, 1999 : [ 8 ] Bansal D, Balakrishnan H. TCP2friendly congestion control for real2time streaming applications [ R]. Cambridge : Massachusetts Institute of Technology, 2000 [ 9 ] Yan J Y, Katrinis K, May M, et al. Media2 and TCP2friendly congestion control for scalable video streams [J ]. IEEE Transactions on Multimedia, 2006, 8 ( 2) : [ 10 ] Bertin C, Def e I, Kangasoja J, et al. Commerce with MPEG24 on the internet with QoS [ C] ΠΠProceedings of IEEE International Conference on Multimedia Computing and Systems, Florence, 1999 : ( 846 ) [ 10 ] Soucy M, Godin G, Rioux M. A texture2mapping approach for the compression of colored 3D triangulations [J ]. The Visual Computer, 1996, 12 (10) : [ 11 ] Garland M, Heckbert P S. Simplifying surfaces with color and texture using quadric error metrics [ C] ΠΠProceedings of the Conference on Visualization, Research Triangle Park, 1998 : [ 12 ] Zhang Liyan, Zhou Rurong, Tang Jie, et al. Research on mesh simplification with additional attributes [J ]. Journal of Computer2Aided Design & Computer Graphics, 2002, 14 (3) : (in Chinese) (,,,. [J ]., 2002, 14 (3) : ) [ 13 ] Hoppe H. Progressive meshes [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAP H, New Orleans, 1996 : [ 14 ] Sander P V, Snyder J, Gortler S J, et al. Texture mapping progressive meshes [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, 2001 : [ 15 ] Garland M, Heckbert P S. Surface simplification using quadric error metrics [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, 1997 : [ 16 ] Dyn N, Levin D, Gregory J A. A butterfly subdivision scheme for surface interpolation wit h tension control [J ]. ACM Transactions on Graphics, 1990, 9 (2) : [ 17 ] Garland M. Multiresolution modeling : survey & future opportunities [ C] ΠΠProceedings of t he Eurographics, Granada, 1999 : [ 18 ] van Kaick O M, Pedrini H. A comparative evaluation of metrics for fast mesh simplification [J ]. Computer Graphics Forum, 2006, 25 (2) :

Σχετικά έγγραφα

ER-Tree (Extended R*-Tree)

ER-Tree (Extended R*-Tree) 1-9825/22/13(4)768-6 22 Journal of Software Vol13, No4 1, 1, 2, 1 1, 1 (, 2327) 2 (, 3127) E-mail xhzhou@ustceducn,,,,,,, 1, TP311 A,,,, Elias s Rivest,Cleary Arya Mount [1] O(2 d ) Arya Mount [1] Friedman,Bentley