Reconstructing 3D Shape, Albedo and Illumination from a Single Face Image

dc.contributor.authorWang, S. F.en_US
dc.contributor.authorLai, S. H.en_US
dc.date.accessioned2015-02-21T17:59:46Z
dc.date.available2015-02-21T17:59:46Z
dc.date.issued2008en_US
dc.description.abstractThe morphable model has been employed to efficiently describe 3D face shape and the associated albedo with a reduced set of basis vectors. The spherical harmonics (SH) model provides a compact basis to well approximate the image appearance of a Lambertian object under different illumination conditions. Recently, the SH and morphable models have been integrated for 3D face shape reconstruction. However, the reconstructed 3D shape is either inconsistent with the SH bases or obtained just from landmarks only. In this work, we propose a geometrically consistent algorithm to reconstruct the 3D face shape and the associated albedo from a single face image iteratively by combining the morphable model and the SH model. The reconstructed 3D face geometry can uniquely determine the SH bases, therefore the optimal 3D face model can be obtained by minimizing the error between the input face image and a linear combination of the associated SH bases. In this way, we are able to preserve the consistency between the 3D geometry and the SH model, thus refining the 3D shape reconstruction recursively. Furthermore, we present a novel approach to recover the illumination condition from the estimated weighting vector for the SH bases in a constrained optimization formulation independent of the 3D geometry. Experimental results show the effectiveness and accuracy of the proposed face reconstruction and illumination estimation algorithm under different face poses and multiple-light-source illumination conditions.en_US
dc.description.number7en_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume27en_US
dc.identifier.doi10.1111/j.1467-8659.2008.01317.xen_US
dc.identifier.issn1467-8659en_US
dc.identifier.pages1729-1736en_US
dc.identifier.urihttps://doi.org/10.1111/j.1467-8659.2008.01317.xen_US
dc.publisherThe Eurographics Association and Blackwell Publishing Ltden_US
dc.titleReconstructing 3D Shape, Albedo and Illumination from a Single Face Imageen_US
Files
Collections