Markerless Multi-view Multi-person Tracking for Combat Sports

dc.contributor.authorFeiz, Hosseinen_US
dc.contributor.authorLabbé, Daviden_US
dc.contributor.authorAndrews, Sheldonen_US
dc.contributor.editorZordan, Victoren_US
dc.date.accessioned2024-08-20T08:27:55Z
dc.date.available2024-08-20T08:27:55Z
dc.date.issued2024
dc.description.abstractWe introduce a novel framework for 3D pose estimation in combat sports. Utilizing a sparse multi-camera setup, our approach employs a computer vision-based tracker to extract 2D pose predictions from each camera view, enforcing consistent tracking targets across views with epipolar constraints and long-term video object segmentation. Through a top-down transformerbased approach, we ensure high-quality 2D pose extraction. We estimate the 3D position via weighted triangulation, spline fitting and extended Kalman filtering. By employing kinematic optimization and physics-based trajectory refinement, we achieve state-of-the-art accuracy and robustness under challenging conditions such as occlusion and rapid movements. Experimental validation on diverse datasets, including a custom dataset featuring elite boxers, underscores the effectiveness of our approach. Additionally, we contribute a valuable sparring video dataset to advance research in multi-person tracking for sports.en_US
dc.description.sectionheadersPosters
dc.description.seriesinformationEurographics/ ACM SIGGRAPH Symposium on Computer Animation - Posters
dc.identifier.doi10.2312/sca.20241162
dc.identifier.isbn978-3-03868-263-9
dc.identifier.pages2 pages
dc.identifier.urihttps://doi.org/10.2312/sca.20241162
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/sca20241162
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Computing methodologies → Pose Estimation; Optimization
dc.subjectComputing methodologies → Pose Estimation
dc.subjectOptimization
dc.titleMarkerless Multi-view Multi-person Tracking for Combat Sportsen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
sca20241162.pdf
Size:
5.22 MB
Format:
Adobe Portable Document Format