GazeDirector: Fully Articulated Eye Gaze Redirection in Video

dc.contributor.authorWood, Errollen_US
dc.contributor.authorBaltrušaitis, Tadasen_US
dc.contributor.authorMorency, Louis-Philippeen_US
dc.contributor.authorRobinson, Peteren_US
dc.contributor.authorBulling, Andreasen_US
dc.contributor.editorGutierrez, Diego and Sheffer, Allaen_US
dc.date.accessioned2018-04-14T18:24:04Z
dc.date.available2018-04-14T18:24:04Z
dc.date.issued2018
dc.description.abstractWe present GazeDirector, a new approach for eye gaze redirection that uses model-fitting. Our method first tracks the eyes by fitting a multi-part eye region model to video frames using analysis-by-synthesis, thereby recovering eye region shape, texture, pose, and gaze simultaneously. It then redirects gaze by 1) warping the eyelids from the original image using a model-derived flow field, and 2) rendering and compositing synthesized 3D eyeballs onto the output image in a photorealistic manner. GazeDirector allows us to change where people are looking without person-specific training data, and with full articulation, i.e. we can precisely specify new gaze directions in 3D. Quantitatively, we evaluate both model-fitting and gaze synthesis, with experiments for gaze estimation and redirection on the Columbia gaze dataset. Qualitatively, we compare GazeDirector against recent work on gaze redirection, showing better results especially for large redirection angles. Finally, we demonstrate gaze redirection on YouTube videos by introducing new 3D gaze targets and by manipulating visual behavior.en_US
dc.description.number2
dc.description.sectionheadersGaze and Attention
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume37
dc.identifier.doi10.1111/cgf.13355
dc.identifier.issn1467-8659
dc.identifier.pages217-225
dc.identifier.urihttps://doi.org/10.1111/cgf.13355
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13355
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.titleGazeDirector: Fully Articulated Eye Gaze Redirection in Videoen_US
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
v37i2pp217-225.pdf
Size:
5.69 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
eg_vid.mp4
Size:
60.15 MB
Format:
Unknown data format
Collections