Effective Interactive Visualization of Neural Relightable Images in a Web-based Multi-layered Framework

dc.contributor.authorRighetto, Leonardoen_US
dc.contributor.authorBettio, Fabioen_US
dc.contributor.authorPonchio, Federicoen_US
dc.contributor.authorGiachetti, Andreaen_US
dc.contributor.authorGobbetti, Enricoen_US
dc.contributor.editorBucciero, Albertoen_US
dc.contributor.editorFanini, Brunoen_US
dc.contributor.editorGraf, Holgeren_US
dc.contributor.editorPescarin, Sofiaen_US
dc.contributor.editorRizvic, Selmaen_US
dc.date.accessioned2023-09-02T07:44:28Z
dc.date.available2023-09-02T07:44:28Z
dc.date.issued2023
dc.description.abstractRelightable images created from Multi-Light Image Collections (MLICs) are one of the most commonly employed models for interactive object exploration in cultural heritage. In recent years, neural representations have been shown to produce higherquality images, at similar storage costs, with respect to the more classic analytical models such as Polynomial Texture Maps (PTM) or Hemispherical Harmonics (HSH). However, their integration in practical interactive tools has so far been limited due to the higher evaluation cost, making it difficult to employ them for interactive inspection of large images, and to the difficulty in integration cost, due to the need to incorporate deep-learning libraries in relightable renderers. In this paper, we illustrate how a state-of-the-art neural reflectance model can be directly evaluated, using common WebGL shader features, inside a multiplatform renderer. We then show how this solution can be embedded in a scalable framework capable to handle multi-layered relightable models in web settings. We finally show the performance and capabilities of the method on cultural heritage objects.en_US
dc.description.sectionheadersAI and 3D Reconstruction II
dc.description.seriesinformationEurographics Workshop on Graphics and Cultural Heritage
dc.identifier.doi10.2312/gch.20231158
dc.identifier.isbn978-3-03868-217-2
dc.identifier.issn2312-6124
dc.identifier.pages57-66
dc.identifier.pages10 pages
dc.identifier.urihttps://doi.org/10.2312/gch.20231158
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/gch20231158
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Reflectance modeling; Graphics systems and interfaces; Applied computing → Arts and humanities
dc.subjectComputing methodologies → Reflectance modeling
dc.subjectGraphics systems and interfaces
dc.subjectApplied computing → Arts and humanities
dc.titleEffective Interactive Visualization of Neural Relightable Images in a Web-based Multi-layered Frameworken_US
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
057-066.pdf
Size:
26.79 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1026.mp4
Size:
108.98 MB
Format:
Unknown data format