FoReCast: Real-time Foveated Rendering and Unicasting for Immersive Remote Telepresence
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Rapidly growing modern virtual reality (VR) interfaces are increasingly used as visualization and interaction media in 3D telepresence systems. Remote environments scanned using RGB-D cameras and represented as dense point-clouds are being used to visualize remote environments in VR in real-time to increase the user's immersion. To this end, such interfaces require high quality, low latency, and high throughput transmission. In other words, the entire system pipeline from data acquisition to its visualization in VR has to be optimized for high performance. Point-cloud data particularly suffers from network latency and throughput limitations that negatively impact user experience in telepresence. The human visual system provides an insight into approaching these challenges. Human eyes have their sharpest visual acuity at the center of their field-of-view, and this falls off towards the periphery. This visual acuity fall-off was taken as an inspiration to design a novel immersive 3D data visualization framework to facilitate the processing, transmission, and visualization in VR of dense point-clouds. The proposed FoReCast framework, shows significant reductions in latency and throughput, higher than 60% in both. A preliminary user study shows that the framework does not significantly affect the user quality of experience in immersive remote telepresence.
Description
CCS Concepts: Human-centered computing -> Visualization design and evaluation methods; Mixed / augmented reality
@inproceedings{10.2312:egve.20221278,
booktitle = {ICAT-EGVE 2022 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments},
editor = {Hideaki Uchiyama and Jean-Marie Normand},
title = {{FoReCast: Real-time Foveated Rendering and Unicasting for Immersive Remote Telepresence}},
author = {Tefera, Yonas T. and Mazzanti, Dario and Anastasi, Sara and Caldwell, Darwin G. and Fiorini, Paolo and Deshpande, Nikhil},
year = {2022},
publisher = {The Eurographics Association},
ISSN = {1727-530X},
ISBN = {978-3-03868-179-3},
DOI = {10.2312/egve.20221278}
}