Real istic Human Head Model ing with Hairstyle Reconstruction

Transcript

1 Vol8, No8 JOURNAL OF COMPU TER2AIDED DESIGN & COMPU TER GRAPHICS Aug, 2006,2) 2) ) ( 30035) 2) ( 0087) ;, Coons2patch ; ; ; ;Coons2patch TP394 Real istic Human Head Model ing with Hairstyle Reconstruction Li Xiaolan,2) Zha Hongbin 2) ) ( College of Com puter Science & Inf ormation Engi neeri ng, Zhejiang Gongshang U niversity, Hangz hou 30035) 2) ( N ational L aboratory on Machi ne Perception, Peki ng U niversity, Beiji ng 0087) Abstract We present methods for generating photo2realistic 3D human head models from a geometric model and multi2view color images of a person The input color images are used not only to generate panoramic texture maps, but also as the source data for hairstyle reconstruction At first, we define the vir2 tual photo plane, corresponding to the true photo plane, to recover 3D positions of hair contour points ex2 tracted from the multi2view color images Then, by using the growth root, direction and length of every hair, hairs are grown till covering the scalp Another hair surface reconstruction approach starts with ex2 tracting contour points of hairs from input images and applying the stereo2vision method to recover their 3D positions Then, a Coons2patch is const ructed to approximate t he hair surface f rom recovered four closed 3D contour curves The experimental results show the performance of the methods for different real models and images Key words radial basis f unction ; text ure blending ; shape2f rom2silhouette ; stereo vision ; Coons2patch,,,, : ; : : ( ) ; (2004CB38005)

2 8 2006,, V IV ID mm SonyDC77 2 :) ;2) ( radial basis function, RBF), 3 Coons2patch,,, Coons2patch [25 ], [627 ] ; [829 ] ; [ 0 ], : [3 ] [4 ] [ ] 3 3 RBF [0 ], :) ;2) ;3) 2 2 : RBF 2,, RBF N 2 RBF

3 8 : 9 V i, i =,2,, N, 4 f ( U j ) = N ( i U j - V i ) + MU j + t, i = ( r) ; U j, j = 2,2,, num, num i, 4 M t, M, t,3 [2 ] ( r), ( r) = e - rπk, K, 3 V i, K = 07 i M t P i = f ( V i ) N i = :) N i = N i = 0, ;2) i V T i x, y, z = 0 x, y, z i =,, P i 4 ( x, y, z ), N + 4 N + 4, 3 b ( ) (virtual photo planes, VPP), (true 32 photo planes, TPP) TPP VPP,, : U V Step TPP VPP U V, Step2, Step3 VPP,, [3 ] 2 3 RBF ( x, y) TPP VPP Step4 VPP Step VPP 3 a,3 b 2 3

4 , ; VPP 3 ( ) 3 c TPPK b VPP c 4 3 Cf i C o f, Cs i, 42 Cs o ) a C o f a C s o y ;2) b C f i y, b Cs o x ;3) c C o f y,, c C s i a M L i w i d, j L j ;4) d C f i y = j =, w i d, j = exp ( - V i - R j 2 )Π 2, d C s i d 4 V i R j ; L j j 2 ; d, 05, 3 : ) 3 ( x, y z ),,, 3, 2 4, 2) 4 3 2D 3D = N ( v ) + N ( v 2 ) + N ( v 3 ), 2 3 N ( v j ) 3 4, L ( v j ) 4 b A, B, C D 42 Coons2patch 4 4 Coons2patch [4 ] VPP X (0, v), X ( u, v) = [ - u u ] + X (, v) [ X ( u,0) X ( u,) ] - v - v

5 8 : 2 [ - u u ] X (0,0) X (0,) X (,0) X (,) - v v, X (0,0), X (0, ), X (, 0) X (, ) 4 A, B, C D ; X (0, v), X (, v ), X ( u,0) X ( u,) 4 AB, 5 CD, A C BD, 4 c 6 3 ( ), b,,vpp a 5 Coons2patch,, : Step,, [5 ] Step2 2 : : T T ; d Coons2patch 2 Step3 5 a 3, 2 abc, a b ac a a b VPD c 2 e 2 f 2 2 ; bc b ; a b a b c 6 abc abc, a VC CPU P ab a a 24 GHz 52 MB PC a c a bc abc 8, 00 5 c 4 s Coons2

6 patch (,, [J ] :A, 2004, 9 (8) : ) 3 [ 6 ] Hadap S, Magnenat T N Interactive hair styler based on fluid Coons2patch 4 0 ; 4, 6 2 VPP,Coons2patch, 2 :) ;2), [ ] Lee Y C, Terzopoulos D, Walters K Realistic modeling for fa2 cial animation [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, California, 995 : [ 2 ] Tarini M, Yamauchi H, Haber J, et al Texturing faces [ C] ΠΠProceedings of Graphics Interface 02, Calgary, 2002 : [ 3 ] Su M S, Chen C Y, Cheng K Y The reconstruction of 3D head model from two orthogonal2view 2D face images [ C] ΠΠProceedings of National Computer Symposium, Taipei, 200 : [ 4 ] Park I K, Zhang H, Vezhnevets V, et al Image2based photo2 realistic 3D face modeling [ C] ΠΠProceedings of the 6th Automat2 ic Face and Gesture Recognition, Seoul, 2004 : [ 5 ] Xu Chenghua, Wang Yunhong, Tan Tieniu. Overview of re2 search on 3D face modeling [J ]. Journal of Image and Graphics : A, 2004, 9 (8) : (in Chinese) flow [ C] ΠΠProceedings of Eurographics Workshop on Computer Animation and Simulation, Interlaken, 2000 : [ 7 ] Kim T Y, Neumann U Interactive multiresolution hair model2 ing and editing [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, San Antonia, Texas, 2002 : [ 8 ] Grabli S, Sillion F X, Marschner S R, et al Image2based hair capture by inverse lighting [ C] ΠΠProceedings of Graphics Inter2 face 02, Calgary, 2002 : 5-58 [ 9 ] Paris S, Briceno H M, Sillion F X Capture of hair geometry from multiple images [J ] ACM Transactions on Graphics, 2004, 23 (3) : [ 0 ] Wei Y C, Ofek E, Quan L, et al Modeling hair from multiple views [ C] ΠΠComputer Graphics Proceedings, Annual Confer2 ence Series, ACM SIGGRAPH, Los Angeles, California, 2005 : [ ] Yemez Y, Schmitt F 3D reconstruction of real objects with high resolution shape and texture [J ] Journal of Image and Vi2 sion Computing, 2004, 22 (3) : [ 2 ] Carr J C, Mitchell T J, Beatson R K, et al Reconstruction and representation of 3D objects with radial basis function [ C] ΠΠComputer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Los Angeles, California, 200 : [ 3 ] Li X L, Zha H B Realistic human head modeling with multi2 view hairstyle reconstruction [ C] ΠΠProceedings of the 5th Inter2 national Conference on 32D Digital Imaging and Modeling, Ot2 tawa, 2005 : [ 4 ] Farin G Curves and surfaces for CAGD : a practical guide [ M ] 4th ed. San Diego : Academic Press, 996 : [ 5 ] Catmull E, Clark J Recursively generated B2spline surfaces on arbitrary topological meshes [J ] Computer2Aided Design, 978, 0 (6) : ,977,962,