Evaluation of Methods to Extract Important Scenes for Automatic Digest Generation from a Presentation Video

Μέγεθος: px

Εμφάνιση ξεκινά από τη σελίδα:

Download "Evaluation of Methods to Extract Important Scenes for Automatic Digest Generation from a Presentation Video"

Διδώ Αρβανίτης
6 χρόνια πριν
Προβολές:

1 DEWS2008 E4-1, ( ) {hanhlh,tetsu}@de.cs.titech.ac.jp, thitiporn.lertrusdachakul@nts.ricoh.co.jp, yokota@cs.titech.ac.jp E- MPMeister e- Evaluation of Methods to Extract Important Scenes for Automatic Digest Generation from a Presentation Video Le HIEU HANH, Thitiporn LERTRUSDACHAKUL, Tetsutaro WATANABE, and Haruo YOKOTA, Department of Computer Science, Faculty of Engineering, Tokyo Institute of Technology Ookayama , Meguro-ku, Tokyo, Japan Application Lab, Software R&D Group, Ricoh Company, Ltd. Tomin-Nissei-Kasugacho Bldg.Koishikawa , Bunkyo-ku, Tokyo, Japan Department of Computer Science, Graduate School of Information Science and Engineering, Tokyo Institute of Technology Ookayama , Meguro-ku, Tokyo, Japan Global Scientific Information and Computing Center, Tokyo Institute of Technology Ookayama , Meguro-ku, Tokyo, Japan {hanhlh,tetsu}@de.cs.titech.ac.jp, thitiporn.lertrusdachakul@nts.ricoh.co.jp, yokota@cs.titech.ac.jp Abstract In the recent years, the use of presentation video in E-learning is increasing. On the user s point of view, this often requires previewing the digest of such video before watching the original one. This paper proposes a number of methods of extracting important scenes for automatic digest generation digest from the presentation video which is recorded by MPMeister II - the tool for Multimedia Web Contents. The important scenes extractions are based on several factors, such as word frequency, specificity, duration and orders of the slides. Finally, the results of each methods are evaluated by comparing with the answer sets selected by testers. Key words e-learning, information extraction, video digest

2 %'&)(+*',!!! #"! #$ 1 1. E- ( ) MPMeister [1] UPRISE [2] ( 1 ) MPMeister ( ) MPMeister Sanderson [3] Yihong [4] Barzilay [5] 2. 2 [6] 2. 3 Jinjun [7] Marcus J.P ANSES [8] Liwei [9] UPRISE [2] [10] [11] [12] UPRISE UPRISE

3 BB, + 0 / $"+*, -/ "!$#% & '( )!$#% & :9<;>=@?@9<A<B BDCFE GIHKJLNMOLNP JLNMOLNPRQS 3. MPMeister 2 MPMeister ( ) Microsoft PowerPoint PowerPoint MPMeister PowerPoint PowerPoint MPMeister MPEG-7 (XML ) MPEG-7 MPEG MPMeister MPEG Sen [13] J-E Ontology [14] L l S = {s 1, s 2,..., s N } s i s i = [v i1, v i2,..., v im ] "!$#%'& 3 L 1 (!)#%'* S W = {w 1, w 2,..., w M } v ij W L l L l = [c l1, c l2,..., c ln ] c lk S s i c lk = [v i1, v i2,..., v im ] s i 3 L 1 s 1 c 11 s 2 c 12 L 1 = [c 11, c 12 ], S = {s 1, s 2}, s 1 = [v 11, v 12, v 13, v 14 ], s 2 = [v 21, v 22, v 23, v 24, v 25, v 26 ], v 11 =, v 12 =, v 13 =, v 14 =, v 21 =, v 22 =, v 23 =, v 24 =, v 25 =, v 26 =, W = {,,,,} [15] p(v ij ) p(v ij )

4 ρ t v ij p(v ij ) = ρ bl v ij b l 0 v ij a ) I d (1) UPRISE [12] I d I d (c lk, θ) = I p (c lk ) t(c lk ) θ (2) t(c lk ) c lk θ I p I p(c lk ) = ( w x c lk c y L l ( v z c y,v z =w x p(v z))) (3) 3 L 1 MPMeister ρ t = 5 ρ bl = 1 c 11 (v 11 ) p(v 11 ) = 5 (v 14 ) p(v 14 ) = 1 I p (c 11 ) = 18, I p (c 12 ) = 25 b ) I dc UPRISE [12] I dc I dc (c lk, θ, δ, ε 1, ε 2 ) = j=γ+δ j=γ δ I d (c lk, θ) E(j γ, ε 1, ε 2 ) (4) δ E(j γ, ε 1, ε 2 ) E(x, ε 1, ε 2) = { exp(ε1x) (x < 0) exp( ε 2x) (x > = 0) θ ε θ = 4, ε 1 = 5.0, ε 2 = ε 1 > ε 2 c ) I dr idf 1 I d I dc I dr I drc I df I dr I dr (c lk, θ) = w x W app(c lk, w x ) app(c y, w x ) I pl(c lk ) t(c lk ) θ (5) c y L l I pl I pl (c lk ) = p(v x ) (6) v x c lk app(c lk, w x ) c lk w x d ) I drc I drc I drc (c lk, θ, δ, ε 1, ε 2) = j=γ+δ e ) j=γ δ I dr (c lk, θ) E(j γ, ε 1, ε 2) I df (7) I df I df (c lk, θ) = w x W app(c lk, w x ) I d(c lk, θ) (8) 4. 3

3 F A B F F I d 0.45 0.31 0.37 0.67 0.40 0.50 I dc 0.36 0.24 0.29 0.83 0.42 0.56 I dr 0.45 0.33 0.38 0.50 0.33 0.40 I drc 0.

56 4 2 A 59 1548 26 85 B 32 1043 33 165 C 31 1674 54 160 D 44 1286 29 110 E 98 4256 43 48 F 67 3306 49 68 Windows Media 4 5.

5 3 F A B F F I d I dc I dr I drc I df A B C D E F Windows Media 4 5. ρ t θ A B C C F F F = = F = 2 + (2) (4) (5) (7) (8) ρ t = 5, b l ρ bl = 1 θ = 1 δ = 3 ε 1 = 5 ε 2 = F A B F 5 A MPMeister 6 B

6 >=< ; A@? CB 1230/ KK << "" $$ WWW && "" ## (( $$ ** WWWW && ++ )) -- // DDD -- WWW -- KKKK WWWW -- TTT \\\ << -- III :987 ;<=?> = = FFF!! ## %% && )) ++ )) )) FF )) \\ QQ ))!!" "!# #%$ $!& &(' ')*' ) ') ))) + +,' + + ')))) -- ' ')))) -+' '))))... /8 // /0 /1 /2 /3 /4 /5 /6 /7 08 0/ / / / :::: ;;;; <=> <?@ ABCDE DE GF FFFHHHH = = D= = JJJJ> > > >?? KK?? ABC DE < <FH I 5 A! #" "%$ $'& &)( ('* *, / /1- -2/43 / /46 / /4673 / /:9 ;D ;; ;< ;;=> ;? ;;@A ;B <D ;C <; <<=> <? <<@A <B <C =D =; =<FEHGJI EHGJILK K M7N2O7P0Q7R SSUT7V T7V2W XXXX YYYY ZJ[ X7Y MHNJOHP0Q MJNJOHP QQQ RRRR SUT7V SSS T7V2W T2]J^ X7Y Z7[ ZU[ X2YU\ 6 B I df F 7 6 B "!!$# #$% %$& &(' '*) ),+ +-) ),+/. +/.0) ),+/1 +/12) ),+/13. +/13.4) ),+65 7@ : 7; 77< 7> 8@ 7? : 8; 88< 8> 8? 9@ 9 7BADC6E F3GIH6JLK GIH6JLKNMLO3P MLO3PNQLR QSRNTLUIV WDX6TIULV GYHDJDKZMLO3P GYH6JNK MLO[PLQNR QNRNTLUIV TLUIVSF F WLX6T,ULV T,ULVS\ \YQ QL]L^ 7 B () 4 B F ( ) F F I d I dc I dr I drc I df (1) ρ t θ C D E F ρ t F F ρ t θ F

7 8 ρ t F 10 θ 9 θ F 11 θ ρ t θ F ρ t F 9 F θ = 0 θ F θ θ θ > 0 θ θ θ 8 9 I df F

8 PowerPoint 18 (DEWS2007) pp.e [13] Sen jp/ yamada/ir/morphologicalanalyzer/sen.html. [14] An Experimental Japanese - English Ontology, http: // [15] H. Luhn, A Statistical Approach to Mechanized Encoding and Searching of Literary Information, IBM Journal of Research and Development, vol.1, no.4, pp , ( ) CREST 21 COE [1] Ricoh Japan, MPMeister II Ricoh Japan, ricoh.co.jp/mpmeister. [2] H. Yokota, T. Kobayashi, T. Muraki, and S. Naoi, UP- RISE: Unified Presentation Slide Retrieval by Impression Search Engine, IEICE Trans. on Info. and Syst., vol.e87- D, no.2, pp , [3] M.Sanderson, Accurate User Directed Summarization from Existing Tools, Proc. of the 7th International Conference on Information and Knowledge Management (CIKM98), [4] Y. Gong, and X. Liu, Generic Text Summatization Using Relevance Measure and Latent Semantic Analysis, Proc. of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pp.19-25, [5] R. Barzilay, and M. Elhadad, Using Lexical Chains for Text Summarization, Proc. of the Intelligent Scalable Text Summarization Workshop (ISTS 97), [6] A Study on Statistical Methods for Automatic Speech Summarization Ph.D thesis Tokyo Institute of Technology [7] J. Wang, C. Xu, E. Chng, and Q. Tian, Sport Highlight Dectection from Keyword Sequences using HMM, Proc. of IEEE International Conference on Multimedia and Expo, ICME 04, vol.1, pp , [8] M.J. Pickering, L. Wong, and S.M. Rüer, Image and Video Retrieval, Springer Berlin / Heidelberg, [9] L. He, E. Snocki, A. Gupta, and J. Grudin, Auto- Summarization of Audio-Video Presentation, Proc. of the seventh ACM international conference on Multimedia (Part 1), pp , [10] vol.j88-d-i no.3 pp [11] 17 (DEWS2006) [12]

Σχετικά έγγραφα

2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems

2016 IEEE/ACM International Conference on Mobile Software Engineering and Systems Multiple User Interfaces MobileSoft'16, Multi-User Experience (MUX) S1: Insourcing S2: Outsourcing S3: Responsive design