Hi3DFace: High-Realistic 3D Face Reconstruction From a Single Occluded Image

Simple item page
dc.contributor.authorHuang, Dongjinen_US
dc.contributor.authorShi, Yongshengen_US
dc.contributor.authorQu, Jiantaoen_US
dc.contributor.authorLiu, Jinhuaen_US
dc.contributor.authorTang, Wenen_US
dc.contributor.editorWimmer, Michaelen_US
dc.contributor.editorAlliez, Pierreen_US
dc.contributor.editorWestermann, RĂĽdigeren_US
dc.date.accessioned2025-11-07T08:33:32Z
dc.date.available2025-11-07T08:33:32Z
dc.date.issued2025
dc.description.abstractWe propose Hi3DFace, a novel framework for simultaneous de-occlusion and high-fidelity 3D face reconstruction. To address real-world occlusions, we construct a diverse facial dataset by simulating common obstructions and present TMANet, a transformer-based multi-scale attention network that effectively removes occlusions and restores clean face images. For the 3D face reconstruction stage, we propose a coarse-medium-fine self-supervised scheme. In the coarse reconstruction pipeline, we adopt a face regression network to predict 3DMM coefficients for generating a smooth 3D face. In the medium-scale reconstruction pipeline, we propose a novel depth displacement network, DDFTNet, to remove noise and restore rich details to the smooth 3D geometry. In the fine-scale reconstruction pipeline, we design a GCN (graph convolutional network) refiner to enhance the fidelity of 3D textures. Additionally, a light-aware network (LightNet) is proposed to distil lighting parameters, ensuring illumination consistency between reconstructed 3D faces and input images. Extensive experimental results demonstrate that the proposed Hi3DFace significantly outperforms state-of-the-art reconstruction methods on four public datasets, and five constructed occlusion-type datasets. Hi3DFace achieves robustness and effectiveness in removing occlusions and reconstructing 3D faces from real-world occluded facial images.en_US
dc.description.number6
dc.description.sectionheadersOriginal Article
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.70277
dc.identifier.issn1467-8659
dc.identifier.pages14 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.70277
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf70277
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectmodelling
dc.subjectappearance modelling
dc.subjectfacial modelling
dc.subjectgeometric modelling
dc.subjectComputing methodologies→Texturing
dc.subjectReflectance modelling
dc.subjectShape modelling
dc.titleHi3DFace: High-Realistic 3D Face Reconstruction From a Single Occluded Imageen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
16_cgf70277.pdf
Size:
6.18 MB
Format:
Adobe Portable Document Format
Download
Collections
44-Issue 6