Time‐Warped Foveated Rendering for Virtual Reality Headsets

dc.contributor.authorFranke, Linusen_US
dc.contributor.authorFink, Lauraen_US
dc.contributor.authorMartschinke, Janaen_US
dc.contributor.authorSelgrad, Kaien_US
dc.contributor.authorStamminger, Marcen_US
dc.contributor.editorBenes, Bedrich and Hauser, Helwigen_US
dc.date.accessioned2021-02-27T19:02:28Z
dc.date.available2021-02-27T19:02:28Z
dc.date.issued2021
dc.description.abstractRendering in real time for virtual reality headsets with high user immersion is challenging due to strict framerate constraints as well as due to a low tolerance for artefacts. Eye tracking‐based foveated rendering presents an opportunity to strongly increase performance without loss of perceived visual quality. To this end, we propose a novel foveated rendering method for virtual reality headsets with integrated eye tracking hardware. Our method comprises recycling pixels in the periphery by spatio‐temporally reprojecting them from previous frames. Artefacts and disocclusions caused by this reprojection are detected and re‐evaluated according to a confidence value that is determined by a newly introduced formalized perception‐based metric, referred to as confidence function. The foveal region, as well as areas with low confidence values, are redrawn efficiently, as the confidence value allows for the delicate regulation of hierarchical geometry and pixel culling. Hence, the average primitive processing and shading costs are lowered dramatically. Evaluated against regular rendering as well as established foveated rendering methods, our approach shows increased performance in both cases. Furthermore, our method is not restricted to static scenes and provides an acceleration structure for post‐processing passes.en_US
dc.description.number1
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume40
dc.identifier.doi10.1111/cgf.14176
dc.identifier.issn1467-8659
dc.identifier.pages110-123
dc.identifier.urihttps://doi.org/10.1111/cgf.14176
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14176
dc.publisher© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltden_US
dc.subjectperceptually based rendering
dc.subjectreal‐time rendering
dc.subjectrendering
dc.subjectimmersive VR
dc.subjectvirtual environments
dc.titleTime‐Warped Foveated Rendering for Virtual Reality Headsetsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
v40i1pp110-123.pdf
Size:
2.26 MB
Format:
Adobe Portable Document Format
Collections