Immersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo Video

Simple item page
dc.contributor.authorMühlhausen, Moritzen_US
dc.contributor.authorKappel, Moritzen_US
dc.contributor.authorKassubeck, Marcen_US
dc.contributor.authorWöhler, Leslieen_US
dc.contributor.authorGrogorick, Steveen_US
dc.contributor.authorCastillo, Susanaen_US
dc.contributor.authorEisemann, Martinen_US
dc.contributor.authorMagnor, Marcusen_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2023-10-06T11:58:50Z
dc.date.available2023-10-06T11:58:50Z
dc.date.issued2023
dc.description.abstractIn this paper, we tackle the challenging problem of rendering real‐world 360° panorama videos that support full 6 degrees‐of‐freedom (DoF) head motion from a prerecorded omnidirectional stereo (ODS) video. In contrast to recent approaches that create novel views for individual panorama frames, we introduce a video‐specific temporally‐consistent multi‐sphere image (MSI) scene representation. Given a conventional ODS video, we first extract information by estimating framewise descriptive feature maps. Then, we optimize the global MSI model using theory from recent research on neural radiance fields. Instead of a continuous scene function, this multi‐sphere image (MSI) representation depicts colour and density information only for a discrete set of concentric spheres. To further improve the temporal consistency of our results, we apply an ancillary refinement step which optimizes the temporal coherency between successive video frames. Direct comparisons to recent baseline approaches show that our global MSI optimization yields superior performance in terms of visual quality. Our code and data will be made publicly available.en_US
dc.description.number6
dc.description.sectionheadersORIGINAL ARTICLES
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14796
dc.identifier.issn1467-8659
dc.identifier.urihttps://doi.org/10.1111/cgf.14796
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14796
dc.publisher© 2023 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject360 videos
dc.subjectimmersive VR
dc.subjectmulti‐sphere image
dc.subjectneural network
dc.subjectomnidirectional stereo rendering
dc.titleImmersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo Videoen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
v42i6_09_14796.pdf
Size:
3.96 MB
Format:
Adobe Portable Document Format
Download
Collections
42-Issue 6