Controllable Biophysical Human Faces

Abstract
We present a novel generative model that synthesizes photorealistic, biophysically plausible faces by capturing the intricate relationships between facial geometry and biophysical attributes. Our approach models facial appearance in a biophysically grounded manner, allowing for the editing of both high-level attributes such as age and gender, as well as low-level biophysical properties such as melanin level and blood content. This enables continuous modeling of physical skin properties that correlate changes in skin properties with shape changes. We showcase the capabilities of our framework beyond its role as a generative model through two practical applications: editing the texture maps of 3D faces that have already been captured, and serving as a strong prior for face reconstruction when combined with differentiable rendering. Our model allows for the creation of physically-based relightable, editable faces with consistent topology and uv layout that can be integrated into traditional computer graphics pipelines.
Description

        
@article{
10.1111:cgf.70170
, journal = {Computer Graphics Forum}, title = {{
Controllable Biophysical Human Faces
}}, author = {
Liu, Minghao
and
Grabli, Stephane
and
Speierer, Sébastien
and
Sarafianos, Nikolaos
and
Bode, Lukas
and
Chiang, Matt
and
Hery, Christophe
and
Davis, James
and
Aliaga, Carlos
}, year = {
2025
}, publisher = {
The Eurographics Association and John Wiley & Sons Ltd.
}, ISSN = {
1467-8659
}, DOI = {
10.1111/cgf.70170
} }
Citation
Collections