ProjectiveShading: Inserting 3D Objects into Indoor Images with Complex Shadows
Loading...
Date
2026
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
Realistically inserting virtual 3D objects into real-world images requires perceptually coherent shadowing of the object and background scene. Achieving this in single-view indoor scenes with sunlight is challenging due to complex, partially visible occluders and indirect lighting. Environment maps alone cannot produce realistic shadows on virtual objects, and any representation (scene parameters) used for rendering must be practically estimable. We introduce ProjectiveShading, the first automatic method for inverse- and re-rendering that handles bi-directional shadow interactions for realistic object composition. Our key innovation is the sunlight map, a 2D image encoding direct sunlight and arbitrary occlusions. It is generated from single-view estimations using off-the-shelf models and is compatible with standard rendering engines. We also propose algorithms to estimate sunlight direction and to blend virtual and real shadows while preserving background textures. Experiments on synthetic and in-the-wild images show our method outperforms previous approaches.
Description
CCS Concepts: Computing methodologies → Visibility; Image-based rendering; Scene understanding; Mixed / augmented reality;
@article{10.1111:cgf.70320,
journal = {Computer Graphics Forum},
title = {{ProjectiveShading: Inserting 3D Objects into Indoor Images with Complex Shadows}},
author = {Luo, Jundan and Wu, Xiaolong and Zhao, Nanxuan and Wang, Lu and Li, Wenbin and Richardt, Christian},
year = {2026},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.70320}
}