Using Saliency for Semantic Image Abstractions in Robotic Painting
Loading...
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association and John Wiley & Sons Ltd.
Abstract
We present an adaptive, semantics-based abstraction approach that balances aesthetic quality and structural coherence within the practical constraints of robotic painting. We apply panoptic segmentation with color-based over-segmentation to partition images into meaningful regions aligned with semantic objects, while providing flexible abstraction levels. Automatic parameter selection for region merging is enabled by semantic saliency maps, derived from Out-of-Distribution segmentation techniques in combination with machine learning methods for feature detection. This preserves the boundaries of salient objects while simplifying less prominent regions. A graph-based community detection step further refines the abstraction by grouping regions according to local connectivity and semantic coherence. The runtime of our method outperforms optimization-based image vectorization methods, enabling the efficient generation of multiple abstraction levels that can serve as hierarchical layers for robotic painting. We demonstrate the quality of our method by showing abstraction results, robotic paintings with the e-David robot, and a comparison to other abstraction methods.
Description
CCS Concepts: Computing methodologies → Non-photorealistic rendering; Image processing; Applied computing → Fine arts
@article{10.1111:cgf.70259,
journal = {Computer Graphics Forum},
title = {{Using Saliency for Semantic Image Abstractions in Robotic Painting}},
author = {Stroh, Michael and Paetzold, Patrick and Berio, Daniel and Kehlbeck, Rebecca and Leymarie, Frederic Fol and Deussen, Oliver and Faraj, Noura},
year = {2025},
publisher = {The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.70259}
}