• Login
    View Item 
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 42 (2023)
    • 42-Issue 2
    • View Item
    •   Eurographics DL Home
    • Computer Graphics Forum
    • Volume 42 (2023)
    • 42-Issue 2
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Makeup Extraction of 3D Representation via Illumination-Aware Image Decomposition

    Thumbnail
    View/Open
    v42i2pp293-307_cgf14762.pdf (4.017Mb)
    Date
    2023
    Author
    Yang, Xingchao
    Taketomi, Takafumi
    Kanamori, Yoshihiro ORCID
    Pay-Per-View via TIB Hannover:

    Try if this item/paper is available.

    Metadata
    Show full item record
    Abstract
    Facial makeup enriches the beauty of not only real humans but also virtual characters; therefore, makeup for 3D facial models is highly in demand in productions. However, painting directly on 3D faces and capturing real-world makeup are costly, and extracting makeup from 2D images often struggles with shading effects and occlusions. This paper presents the first method for extracting makeup for 3D facial models from a single makeup portrait. Our method consists of the following three steps. First, we exploit the strong prior of 3D morphable models via regression-based inverse rendering to extract coarse materials such as geometry and diffuse/specular albedos that are represented in the UV space. Second, we refine the coarse materials, which may have missing pixels due to occlusions. We apply inpainting and optimization. Finally, we extract the bare skin, makeup, and an alpha matte from the diffuse albedo. Our method offers various applications for not only 3D facial models but also 2D portrait images. The extracted makeup is well-aligned in the UV space, from which we build a large-scale makeup dataset and a parametric makeup model for 3D faces. Our disentangled materials also yield robust makeup transfer and illumination-aware makeup interpolation/removal without a reference image.
    BibTeX
    @article {10.1111:cgf.14762,
    journal = {Computer Graphics Forum},
    title = {{Makeup Extraction of 3D Representation via Illumination-Aware Image Decomposition}},
    author = {Yang, Xingchao and Taketomi, Takafumi and Kanamori, Yoshihiro},
    year = {2023},
    publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.14762}
    }
    URI
    https://doi.org/10.1111/cgf.14762
    https://diglib.eg.org:443/handle/10.1111/cgf14762
    Collections
    • 42-Issue 2

    Related items

    Showing items related by title, author, creator and subject.

    • Rational Bézier Guarding 

      Khanteimouri, Payam; Mandad, Manish; Campen, Marcel (The Eurographics Association and John Wiley & Sons Ltd., 2022)
      We present a reliable method to generate planar meshes of nonlinear rational triangular elements. The elements are guaranteed to be valid, i.e. defined by injective rational functions. The mesh is guaranteed to conform ...
    • VA + Embeddings STAR: A State-of-the-Art Report on the Use of Embeddings in Visual Analytics 

      Huang, Zeyang; Witschard, Daniel; Kucher, Kostiantyn; Kerren, Andreas (The Eurographics Association and John Wiley & Sons Ltd., 2023)
      Over the past years, an increasing number of publications in information visualization, especially within the field of visual analytics, have mentioned the term ''embedding'' when describing the computational approach. ...
    • Personalised Authentic assessments with Synchronous Learning Activities: a Framework for Teaching Visualisation and Graphics 

      Roberts, Jonathan C. (The Eurographics Association, 2022)
      We present an activities framework for learning visualisation and computer graphics. The framework pivots around the academic developing an authentic learning scenario that is personalised for every student, followed by a ...

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA
     

     

    Browse

    All of Eurographics DLCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    BibTeX | TOC

    Create BibTeX Create Table of Contents

    Eurographics Association copyright © 2013 - 2023 
    Send Feedback | Contact - Imprint | Data Privacy Policy | Disable Google Analytics
    Theme by @mire NV
    System hosted at  Graz University of Technology.
    TUGFhA