NeRF‐Tex: Neural Reflectance Field Textures

dc.contributor.authorBaatz, H.en_US
dc.contributor.authorGranskog, J.en_US
dc.contributor.authorPapas, M.en_US
dc.contributor.authorRousselle, F.en_US
dc.contributor.authorNovák, J.en_US
dc.contributor.editorHauser, Helwig and Alliez, Pierreen_US
dc.date.accessioned2022-10-11T05:24:57Z
dc.date.available2022-10-11T05:24:57Z
dc.date.issued2022
dc.description.abstractWe investigate the use of neural fields for modelling diverse mesoscale structures, such as fur, fabric and grass. Instead of using classical graphics primitives to model the structure, we propose to employ a versatile volumetric primitive represented by a neural field (NeRF‐Tex), which jointly models the geometry of the material and its response to lighting. The NeRF‐Tex primitive can be instantiated over a base mesh to ‘texture’ it with the desired meso and microscale appearance. We condition the reflectance field on user‐defined parameters that control the appearance. A single NeRF texture thus captures an entire space of reflectance fields rather than one specific structure. This increases the gamut of appearances that can be modelled and provides a solution for combating repetitive texturing artifacts. We also demonstrate that NeRF textures naturally facilitate continuous level‐of‐detail rendering. Our approach unites the versatility and modelling power of neural networks with the artistic control needed for precise modelling of virtual scenes. While all our training data are currently synthetic, our work provides a recipe that can be further extended to extract complex, hard‐to‐model appearances from real images.en_US
dc.description.number6
dc.description.sectionheadersMajor Revision from EG Symposium on Rendering
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume41
dc.identifier.doi10.1111/cgf.14449
dc.identifier.issn1467-8659
dc.identifier.pages287-301
dc.identifier.urihttps://doi.org/10.1111/cgf.14449
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14449
dc.publisher© 2022 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectray tracing
dc.subjectrendering
dc.subjectappearance modeling
dc.subjectmodelling
dc.subjectreflectance & shading models
dc.titleNeRF‐Tex: Neural Reflectance Field Texturesen_US
Files
Collections