filename : Bee12.pdf entry : inproceedings conference : SIGGRAPH 2012, Los Angeles, USA, 5-9 August, 2012 pages : 117:1--117:10 year : 2012 month : August title : Coupled 3D Reconstruction of Sparse Facial Hair and Skin subtitle : author : Beeler, Thabo and Bickel, Bernd and Noris, Gioacchino and Marschner, Steve and Beardsley, Paul and Sumner, Robert W. and Gross, Markus booktitle : Proceedings of ACM SIGGRAPH 2012 ISSN/ISBN : editor : publisher : ACM publ.place : New York, NY, USA volume : 31 issue : 4 language : english keywords : hair reconstruction, multi-view stereo, facial hair abstract : Although facial hair plays an important role in individual expression, facial-hair reconstruction is not addressed by current face-capture systems. Our research addresses this limitation with an algorithm that treats hair and skin surface capture together in a coupled fashion so that a high-quality representation of hair fibers as well as the underlying skin surface can be reconstructed. We propose a passive, camera-based system that is robust against arbitrary motion since all data is acquired within the time period of a single exposure. Our reconstruction algorithm detects and traces hairs in the captured images and reconstructs them in 3D using a multi-view stereo approach. Our coupled skin-reconstruction algorithm uses information about the detected hairs to deliver a skin surface that lies underneath all hairs irrespective of occlusions. In dense regions like eyebrows, we employ a hair-synthesis method to create hair fibers that plausibly match the image data. We demonstrate our scanning system on a number of individuals and show that it can successfully reconstruct a variety of facial-hair styles together with the underlying skin surface.