Automatic extraction of bibliography with machine learning

Μέγεθος: px

Εμφάνιση ξεκινά από τη σελίδα:

Download "Automatic extraction of bibliography with machine learning"

Κασσάνδρα Αναγνωστάκης
8 χρόνια πριν
Προβολές:

1 Automatic extraction of bibliography with machine learning Takeshi ABEKAWA Hidetsugu NANBA Hiroya TAKAMURA Manabu OKUMURA Abstract In this paper, we propose an extraction method of bibliography using support vector machines. We use visual and linguistic features for extracting bibliography of a paper, and use field order for extracting reference infomation. Our method leads to high precision extraction. 1 WWW CD-ROM e-print archive WWW CiteSeer(Research Index)[3] WWW WWW PRESRI [7] WWW Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology abekawa@lr.pi.titech.ac.jp Faculty of Information Sciences, Hiroshima City University nanba@its.hiroshima-cu.ac.jp Precision and Intelligence Laboratory, Tokyo Institute of Technology {takamura,oku}@pi.titech.ac.jp DB ( ) ( ) 2 3, WWW CD-ROM ( PS PDF) PDF PS Ghostscript ps2pdf PDF PDF pdftohtml XML PDF XML ghost/

2 pdftohtml PDF PDF ffi fl Introduction References PDF PDF 1 PS WWW or CD-ROM GS XML XML PDF pdftohtml ( ) 1: [2] [6] (HMM) [5] 1 HMM HMM (SVM) SVM SVM 3.1 SVM SVM x i 2 y i (x i,y i ) n (0 <i<n) : w x + b =0. SVM ( SV ) ( 1/ w ) 1

3 φ(x) φ(x) d : K(x i, x j )=(x i x j +1) d : TITLE TITLE E AUTHORS AUTHORS E AFFILIATION AFFILIATION E ABSTRACT ABSTRACT E KEYWORD KEYWORD E E OTHER 1 E AFFILIATION FAX URL 1 AFFILIATION OTHER <TITLE>...</TITLE> <AUTHORS>...</AUTHORS> <ABSTRACT> </ABSTRACT> <ABSTRACT>...</ABSTRACT> <ABSTRACT>...</ABSTRACT> <ABSTRACT>...</ABSTRACT> <ABSTRACT>...</ABSTRACT> <ABSTRACT>...</ABSTRACT> <TITLE_E>Automatic extraction o...</title_e> <AUTHORS_E>Takeshi ABEKAWA...</AUTHORS_E> <ABSTRACT_E>Abstract</ABSTRACT_E> <ABSTRACT_E>In this paper, we...</abstract_e> <ABSTRACT_E>We use visual and...</abstract_e> <ABSTRACT_E>In this paper, we...</abstract_e> <ABSTRACT_E>extracting refere...</abstract_e> 3.3 pdftohtml () (0 x 1) (0 x 1) (0 x 1) (0,0,1,0,0) 5 (0,0,0,0,1) 1 0

4 abstract Keyword 2 12 {0, 1} 2 2: [A-Za-z] [0-9] [ -] [ -;:[]{}&/ ] [, () () WWW SVM Yam- Cha 3 YamCha YamCha taku-ku/software/yamcha/ d = A B A+B 2 F-measure Recall,Precision β = TITLE ABSTRACT ABSTRACT ABSTRACT ABSTRACT KEYWORD ABSTRACT KEYWORD KEYWORD A+B SVM

5 3: Association for Computational Linguistics(ACL2003) Computational Linguistics(COLING2002) (2003) (2003) WWW : A B A+B () () () F F F TITLE 1, AUTHORS 1, AFFILIATION 2, ABSTRACT 6, KEYWORD OTHER 1, TITLE E AUTHORS E AFFILIATION E ABSTRACT E KEYWORD E , S. Lawrence, C.L. Giles, K. Bollacker, Digital libraries and autonomous citation indexing, IEEE Computer, vol. 6, no.4, pp , Lawrence, S., Giles, C.L., Bollacker, K.(1999). Digital libraries and autonomous citation indexing. IEEE Computer, 32 (6), S.Lawrence,C.Giles,K.Bollacker,Digitallibraries andautonomouscitationindexing,ieeecompute r32(6):67-71(1999) 3. PDF OTHER 1 2 AUTHORS 1 TITLE SOURCE URL

6 1 DATE September PAGE pp pp OTHER to appear PAGE DATE OTHER 1 NONE <AUTHORS>S. Lawrence, C.L. Giles, K. Bollacker </AUTHORS>, <TITLE>Digital libraries and autonomous citation indexing</title>, <SOURCE> IEEE Computer, vol. 6, no.4 </SOURCE>, <PAGE> pp </PAGE>, <DATE> 1999</DATE>. 4.2 HMM SVM HMM [1, 4] HMM 3 PDF 1 HMM 2 q i q j c(q i q j ) c(q σ k ) : c(q i q j ) P (q i q j )= q i,q j Q c(q i q j ) c(q i σ k ) P (q i σ k )= σ k Σ c(q i σ k ) 2 Viterbi 2 HMM HMM AUTHORS 1 [4] DATE DATE PAGE HMM DATE PAGE 2 start AUTHORS TITLE SOURCE 2: HMM OTHER 5 29/2077= 1.4% end

7 6: AUTHORS DATE TITLE J. Connan and C.W. Omlin ( 2000 ) Bibliography Extraction with Hidden Markov Models. AUTHORS DATE TITLE SOURCE 5: (DATE,PAGE ) AUTHORS, TITLE, SOURCE 138 AUTHORS, TITLE, SOURCE, OTHER 107 AUTHORS, SOURCE 40 AUTHORS, TITLE 38 TITLE, SOURCE 23 SOURCE 15 AUTHORS, SOURCE, OTHER 6 AUTHORS, TITLE, OTHER 6 TITLE 2 TITLE, SOURCE, OTHER 2 SOURCE, OTHER 2 15 TITLE, AUTHORS, SOURCE 6 AUTHORS, SOURCE, TITLE 2 AUTHORS, TITLE, OTHER, SOURCE 1 TITLE, OTHER, SOURCE 1 AUTHORS, SOURCE, TITLE, OTHER 1 SOURCE, TITLE 1 AUTHORS, OTHER, SOURCE 1 AUTHORS, OTHER, TITLE, SOURCE 1 AUTHORS 4.3 SVM HMM SVM HMM HMM 7 7 SVM d 3 3 SVM1 SVM2 HMM DATE, PAGE SVM3 SVM2 SVM3 SVM1,SVM2 SVM SVM3 1 HMM (ex. AUTHORS) HMM SVM1, SVM2 HMM HMM SVM HMM

8 7: HMM SVM1 SVM2 SVM3 HMM SVM1 SVM2 SVM3 AUTHORS TITLE SOURCE DATE PAGE OTHER SVM3 HMM SVM AUTHORS,TITLE AUTHORS TITLE AUTHORS HMM 8 15( ) 8: AUTHORS,TITLE,SOURCE [1] J. Connan and C.W. Omlin. Bibliography extraction with hidden markov models [2] Ying Ding, Gobinda Chowdhury, and Schubert Foo. Template mining for the extraction of citation from digital documents. In Proceedings of Second Asian Digital Library Conference, pp , [3] Steve Lawrence, C. Lee Giles, and Kurt Bollacker. Digital libraries and autonomous citation indexing. IEEE Computer, Vol. 32, No. 6, pp , [4] Andrew McCallum, Kamal Nigam, Jason Rennie, and Kristie Seymore. Building domain-specific search engines with machine learning techniques. In Proceedings of AAAI-99 Spring Symposium on Intelligent Agents in Cyberspace, 1999., [5] Kristie Seymore, Andrew McCallum, and Roni Rosenfeld. Learning hidden Markov model structure for information extraction. In AAAI 99 Workshop on Machine Learning for Information Extraction, [6],,. PDF. 65, pp , [7],.., Vol.6, No. 5, pp , 1999.

Σχετικά έγγραφα

{takasu, Conditional Random Field

{takasu, Conditional Random Field DEIM Forum 2016 C8-6 CRF 700 8530 3 1 1 700 8530 3 1 1 101 8430 2-1-2 E-mail: pobp52cw@s.okayama-u.ac.jp, ohta@de.cs.okayama-u.ac.jp, {takasu, adachi}@nii.ac.jp Conditional Random Field 1. Conditional