Artist-Inator: Text-based, Gloss-aware Non-photorealistic Stylization

dc.contributor.authorSubias, Jose Danielen_US
dc.contributor.authorDaniel-Soriano, Saúlen_US
dc.contributor.authorGutierrez, Diegoen_US
dc.contributor.authorSerrano, Anaen_US
dc.contributor.editorWang, Beibeien_US
dc.contributor.editorWilkie, Alexanderen_US
dc.date.accessioned2025-06-20T07:55:54Z
dc.date.available2025-06-20T07:55:54Z
dc.date.issued2025
dc.description.abstractLarge diffusion models have made a remarkable leap synthesizing high-quality artistic images from text descriptions. However, these powerful pre-trained models still lack control to guide key material appearance properties, such as gloss. In this work, we present a threefold contribution: (1) we analyze how gloss is perceived across different artistic styles (i.e., oil painting, watercolor, ink pen, charcoal, and soft crayon); (2) we leverage our findings to create a dataset with 1,336,272 stylized images of many different geometries in all five styles, including automatically-computed text descriptions of their appearance (e.g., ''A glossy bunny hand painted with an orange soft crayon''); and (3) we train ControlNet to condition Stable Diffusion XL synthesizing novel painterly depictions of new objects, using simple inputs such as edge maps, hand-drawn sketches, or clip arts. Compared to previous approaches, our framework yields more accurate results despite the simplified input, as we show both quantitative and qualitatively.en_US
dc.description.number4
dc.description.sectionheadersStylization and Image Processing
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume44
dc.identifier.doi10.1111/cgf.70182
dc.identifier.issn1467-8659
dc.identifier.pages15 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.70182
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf70182
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Non-photorealistic rendering; Image processing; Perception
dc.subjectComputing methodologies → Non
dc.subjectphotorealistic rendering
dc.subjectImage processing
dc.subjectPerception
dc.titleArtist-Inator: Text-based, Gloss-aware Non-photorealistic Stylizationen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
cgf70182.pdf
Size:
44.37 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
paper1002_mm1.pdf
Size:
126.47 MB
Format:
Adobe Portable Document Format
Collections