Now showing items 1-2 of 2

    • Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks 

      Laine, Samuli; Karras, Tero; Aila, Timo; Herva, Antti; Saito, Shunsuke; Yu, Ronald; Li, Hao; Lehtinen, Jaakko (ACM, 2017)
      We present a real-time deep learning framework for video-based facial performance capture-the dense 3D tracking of an actor's face given a monocular video. Our pipeline begins with accurately capturing a subject using a ...
    • Voice2Face: Audio-driven Facial and Tongue Rig Animations with cVAEs 

      Villanueva Aylagas, Monica; Anadon Leon, Hector; Teye, Mattias; Tollmar, Konrad (The Eurographics Association and John Wiley & Sons Ltd., 2022)
      We present Voice2Face: a Deep Learning model that generates face and tongue animations directly from recorded speech. Our approach consists of two steps: a conditional Variational Autoencoder generates mesh animations from ...