Harmonized Portrait‐Background Image Composition

No Thumbnail Available
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
© 2023 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.
Abstract
Portrait‐background image composition is a widely used operation in selfie editing, video meeting, and other portrait applications. To guarantee the realism of the composited images, the appearance of the foreground portraits needs to be adjusted to fit the new background images. Existing image harmonization approaches are proposed to handle general foreground objects, thus lack the special ability to adjust portrait foregrounds. In this paper, we present a novel end‐to‐end network architecture to learn both the content features and style features for portrait‐background composition. The method adjusts the appearance of portraits to make them compatible with backgrounds, while the generation of the composited images satisfies the prior of a style‐based generator. We also propose a pipeline to generate high‐quality and high‐variety synthesized image datasets for training and evaluation. The proposed method outperforms other state‐of‐the‐art methods both on the synthesized dataset and the real composited images and shows robust performance in video applications.
Description

        
@article{
10.1111:cgf.14921
, journal = {Computer Graphics Forum}, title = {{
Harmonized Portrait‐Background Image Composition
}}, author = {
Wang, Yijiang
and
Li, Yuqi
and
Wang, Chong
and
Ye, Xulun
}, year = {
2023
}, publisher = {
© 2023 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.
}, ISSN = {
1467-8659
}, DOI = {
10.1111/cgf.14921
} }
Citation
Collections