SkyGAN: Realistic Cloud Imagery for Image‐based Lighting
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.
Abstract
Achieving photorealism when rendering virtual scenes in movies or architecture visualizations often depends on providing a realistic illumination and background. Typically, spherical environment maps serve both as a natural light source from the Sun and the sky, and as a background with clouds and a horizon. In practice, the input is either a static high‐resolution HDR photograph manually captured on location in real conditions, or an analytical clear sky model that is dynamic, but cannot model clouds. Our approach bridges these two limited paradigms: a user can control the sun position and cloud coverage ratio, and generate a realistically looking environment map for these conditions. It is a hybrid data‐driven analytical model based on a modified state‐of‐the‐art GAN architecture, which is trained on matching pairs of physically‐accurate clear sky radiance and HDR fisheye photographs of clouds. We demonstrate our results on renders of outdoor scenes under varying time, date and cloud covers. Our source code and a dataset of 39 000 HDR sky images are publicly available at .
Description
@article{10.1111:cgf.14990,
journal = {Computer Graphics Forum},
title = {{SkyGAN: Realistic Cloud Imagery for Image‐based Lighting}},
author = {Mirbauer, Martin and Rittig, Tobias and Iser, Tomáš and Křivánek, Jaroslav and Šikudová, Elena},
year = {2024},
publisher = {© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.14990}
}