VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representations

dc.contributor.authorZargarbashi, Fatemeh
dc.contributor.authorAgrawal, Dhruv
dc.contributor.authorBuhmann, Jakob
dc.contributor.authorGuay, Martin
dc.contributor.authorCoros, Stelian
dc.contributor.authorSumner, Robert W.
dc.contributor.editorMasia, Belen
dc.contributor.editorThies, Justus
dc.date.accessioned2026-04-17T12:41:46Z
dc.date.available2026-04-17T12:41:46Z
dc.date.issued2026
dc.description.abstractHuman motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and content in human motion data to facilitate style transfer. Our approach is guided by the insight that content corresponds to coarse motion attributes while style captures the finer, expressive details. To model this hierarchy, we employ Residual Vector Quantized Variational Autoencoders (RVQ-VAEs) to learn a coarse-to-fine representation of motion. We further enhance the disentanglement by integrating codebook learning with contrastive learning and a novel information leakage loss to organize the content and the style across different codebooks. We harness this disentangled representation using our simple and effective inference-time technique Quantized Code Swapping, which enables motion style transfer without requiring any fine-tuning for unseen styles. Our framework demonstrates strong versatility across multiple inference applications, including style transfer, style removal, and motion blending.
dc.description.number2
dc.description.sectionheadersMotion in the Wild: From Individuals to Crowds
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume45
dc.identifier.doi10.1111/cgf.70377
dc.identifier.issn1467-8659
dc.identifier.pages14 pages
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf70377
dc.identifier.urihttps://doi.org/10.1111/cgf70377
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.
dc.rightsCC-BY-4.0
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectAnimation
dc.subjectLearning latent representations
dc.titleVQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representations
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
cgf70377.pdf
Size:
27.26 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
paper1269_1_mm4.mp4
Size:
100.04 MB
Format:
Video MP4