Data-Driven Ink Painting Brushstroke Rendering

dc.contributor.authorMadono, Kokien_US
dc.contributor.authorSimo-Serra, Edgaren_US
dc.contributor.editorChaine, Raphaëlleen_US
dc.contributor.editorDeng, Zhigangen_US
dc.contributor.editorKim, Min H.en_US
dc.date.accessioned2023-10-09T07:36:10Z
dc.date.available2023-10-09T07:36:10Z
dc.date.issued2023
dc.description.abstractAlthough digital painting has advanced much in recent years, there is still a significant divide between physically drawn paintings and purely digitally drawn paintings. These differences arise due to the physical interactions between the brush, ink, and paper, which are hard to emulate in the digital domain. Most ink painting approaches have focused on either using heuristics or physical simulation to attempt to bridge the gap between digital and analog, however, these approaches are still unable to capture the diversity of painting effects, such as ink fading or blotting, found in the real world. In this work, we propose a data-driven approach to generate ink paintings based on a semi-automatically collected high-quality real-world ink painting dataset. We use a multi-camera robot-based setup to automatically create a diversity of ink paintings, which allows for capturing the entire process in high resolution, including capturing detailed brush motions and drawing results. To ensure high-quality capture of the painting process, we calibrate the setup and perform occlusion-aware blending to capture all the strokes in high resolution in a robust and efficient way. Using our new dataset, we propose a recursive deep learning-based model to reproduce the ink paintings stroke by stroke while capturing complex ink painting effects such as bleeding and mixing. Our results corroborate the fidelity of the proposed approach to real hand-drawn ink paintings in comparison with existing approaches. We hope the availability of our dataset will encourage new research on digital realistic ink painting techniques.en_US
dc.description.number7
dc.description.sectionheadersImage Editing and Color
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14965
dc.identifier.issn1467-8659
dc.identifier.pages11 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14965
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14965
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies -> Non-photorealistic rendering; Neural networks
dc.subjectComputing methodologies
dc.subjectNon
dc.subjectphotorealistic rendering
dc.subjectNeural networks
dc.titleData-Driven Ink Painting Brushstroke Renderingen_US
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
v42i7_37_14965.pdf
Size:
40.35 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1053_mm.zip
Size:
327.84 MB
Format:
Zip file
Collections