Automating Makeup Appearance Acquisition via Inverse Rendering for Virtual Try-On
Loading...
Date
2026
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Virtual Try-On (VTO) systems are essential for modern beauty e-commerce, yet creating physically accurate digital twins of makeup products remains a labor-intensive process requiring manual parameter tuning by 3D artists. We propose an automated pipeline to estimate rendering parameters for lipstick materials using inverse rendering. By leveraging controlled in-vitro imagery of lipsticks applied to contrast cards, we optimize the parameters of a principled BSDF within Mitsuba 3 [JSR∗22]. We introduce a multi-stage optimization strategy separating color, texture, and reflection, demonstrating high fidelity across five distinct commercial lipstick ranges. The pipeline can be generalized to other makeup materials.
Description
CCS Concepts: Computing methodologies → Reconstruction; Image-based Rendering; Reflectance Modeling; Mixed/Augmented Reality
@inproceedings{10.2312:egp.20261007,
booktitle = {Eurographics 2026 - Posters},
editor = {Gerrits, Tim and Teschner, Matthias},
title = {{Automating Makeup Appearance Acquisition via Inverse Rendering for Virtual Try-On}},
author = {Li, Tao and Tran, Quoc Nam Loïc and Bokaris, Panagiotis-Alexandros },
year = {2026},
publisher = {The Eurographics Association},
ISSN = {1017-4656},
ISBN = {978-3-03868-300-1},
DOI = {10.2312/egp.20261007}
}