Zooming On All Actors: Automatic Focus+Context Split Screen Video Generation

dc.contributor.authorKumar, Moneishen_US
dc.contributor.authorGandhi, Vineeten_US
dc.contributor.authorRonfard, Rémien_US
dc.contributor.authorGleicher, Michaelen_US
dc.contributor.editorWilliam Bares and Vineet Gandhi and Quentin Galvane and Remi Ronfarden_US
dc.date.accessioned2017-04-22T17:13:03Z
dc.date.available2017-04-22T17:13:03Z
dc.date.issued2017
dc.description.abstractStage performances can be easily captured using a high resolution camera but these are often difficult to watch because actor faces are too small. We present a novel approach to create a split screen video that incorporates both the context as well as the close-up details of the actors. Our system takes as input the static recording of a stage performance and tracking information about the actor positions, and generates a video with a wide master shot and a set of close-ups of all identified actors and hence showing a focus+context view that shows both the overall action as well as the details of actor faces. The key to our approach is to compute these camera motions such that they are cinematically valid close-ups and to ensure that the set of views of the different actors are properly coordinated and presented. The close-up views are created as virtual camera movements by applying panning, cropping and zooming to the source video. We pose the computation of camera motions as convex optimization that creates detailed views and smooth movements, subject to cinematic constraints such as not cutting faces with the edge of the frame. Additional constraints allow for the interaction amongst the close up views of each actor, causing them to merge seamlessly when actors are close. Generated views are then placed in a layout that preserves the spatial relationships between actors. We demonstrate our results on a variety of video sequences from theatre and dance performances.en_US
dc.description.sectionheadersLive-action Cinematography
dc.description.seriesinformationEurographics Workshop on Intelligent Cinematography and Editing
dc.identifier.doi10.2312/wiced.20171070
dc.identifier.isbn978-3-03868-031-4
dc.identifier.issn2411-9733
dc.identifier.pages43-43
dc.identifier.urihttps://doi.org/10.2312/wiced.20171070
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/wiced20171070
dc.publisherThe Eurographics Associationen_US
dc.subjectI.3.7 [Computer Graphics]
dc.subjectThree Dimensional Graphics and Realism
dc.subjectAnimation H.5.2 [Information Interfaces and Presentation]
dc.subjectUser Interfaces
dc.subjectInteraction styles
dc.titleZooming On All Actors: Automatic Focus+Context Split Screen Video Generationen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
043-043.pdf
Size:
69.48 KB
Format:
Adobe Portable Document Format
Collections