101 results
Search Results
Now showing 1 - 10 of 101
Item On the Beat: Analysing and Evaluating Synchronicity in Dance Performances(The Eurographics Association, 2023) Menzel, Malte; Tauscher, Jan-Philipp; Magnor, Marcus; Guthe, Michael; Grosch, ThorstenThis paper presents a method to analyse and evaluate synchronicity in dance performances automatically. Synchronisation of a dancer's movement and the accompanying music is a vital characteristic of dance performances. We propose a method that fuses computer vision-based extraction of dancers' body pose information and audio beat tracking to examine the alignment of the dance motions with the background music. Specifically, the motion of the dancer is analysed for rhythmic dance movements that are then subsequently correlated to the musical beats of the soundtrack played during the performance. Using a single mobile phone video recording of a dance performance only, our system is easily usable in dance rehearsal contexts. Our method evaluates accuracy for every motion beat of the performance on a timeline giving users detailed insight into their performance. We evaluated the accuracy of our method using a dataset containing 17 video recordings of real world dance performances. Our results closely match assessments by professional dancers, indicating correct analysis by our method.Item Interactions for Seamlessly Coupled Exploration of High-Dimensional Images and Hierarchical Embeddings(The Eurographics Association, 2023) Vieth, Alexander; Lelieveldt, Boudewijn; Eisemann, Elmar; Vilanova, Anna; Höllt, Thomas; Guthe, Michael; Grosch, ThorstenHigh-dimensional images (i.e., with many attributes per pixel) are commonly acquired in many domains, such as geosciences or systems biology. The spatial and attribute information of such data are typically explored separately, e.g., by using coordinated views of an image representation and a low-dimensional embedding of the high-dimensional attribute data. Facing ever growing image data sets, hierarchical dimensionality reduction techniques lend themselves to overcome scalability issues. However, current embedding methods do not provide suitable interactions to reflect image space exploration. Specifically, it is not possible to adjust the level of detail in the embedding hierarchy to reflect changing level of detail in image space stemming from navigation such as zooming and panning. In this paper, we propose such a mapping from image navigation interactions to embedding space adjustments. We show how our mapping applies the "overview first, details-on-demand" characteristic inherent to image exploration in the high-dimensional attribute space. We compare our strategy with regular hierarchical embedding technique interactions and demonstrate the advantages of linking image and embedding interactions through a representative use case.Item Embodied Augmented Reality for Lower Limb Rehabilitation(The Eurographics Association, 2024) Sarri, Froso; Kasnesis, Panagiotis; Symeonidis, Spyridon; Paraskevopoulos, Ioannis Th.; Diplaris, Sotiris; Posteraro, Federico; Georgoudis, George; Mania, Katerina; Pelechano, Nuria; Pettré, JulienImmersive platforms have emerged as valuable tools in rehabilitation, with potential to enhance patient engagement and recovery outcomes. Addressing the limitations of traditional Virtual Reality (VR) setups that restrict physical movement, this paper presents the system architecture of a novel, head-worn, Augmented Reality (AR) system for lower limb rehabilitation. The rehabilitation experience is enhanced by embodying avatars that replicate patients' movements. The system integrates varied avatar perspectives, such as mirror and follow modes, based on an avatar centered interface. The proposed system architecture supports seated and standing exercises, expanding the scope of rehabilitation beyond just gait. Computer vision-based 3D pose estimation captures patients' movement, mapped onto the avatar in real-time, accurately estimating the co-ordinates of 3D body landmarks. Wearable sensors evaluate patients' movements by utilizing deep learning to discern movement patterns. Feedback to patients is provided based on visual cues indicating limb areas for exercise adjustment so that exercise execution is improved. Embodiment has the potential to improve exercise understanding and assists patients' rehabilitation recovery.Item A Rapid VR House Interior Generator with Eye-tracking Feedback for Home Staging(The Eurographics Association, 2023) Miyakawa, Takuya; Bland, Jeffrey Keith Spaneas; Yoshikawa, Gaku; Ma, Yuan; Abey Campbell; Claudia Krogmeier; Gareth YoungThe employment of virtual reality (VR) technology in home staging (i.e., showcasing layout and interior design to influence potential homebuyers' purchases) has noticeable limitations. First, developing VR models by game engines may bring unaffordable workloads for real estate agencies. Second, pen-and-paper feedback on a VR model of the staged home is sometimes ambiguous and misleading. We developed an application that combines a virtual tour platform and a VR-based eye-tracker to address the two issues. The current work investigated the relationship between subjects' preferences and eye movements in a staged home. Our results support that subjects' eye-tracking data on layout and interior design differs following their preference change, reflecting the potential of eye-tracking in evaluating staged home models. In the future, we will examine the workload reduction in creating a VR model via the virtual tour platform.Item Interactive Deformable Image Registration with Dual Cursor(The Eurographics Association, 2022) Igarashi, Takeo; Koike, Tsukasa; Kin, Taichi; Yang, Yin; Parakkat, Amal D.; Deng, Bailin; Noh, Seung-TakDeformable image registration is the process of deforming a target image to match corresponding features of a reference image. Fully automatic registration remains difficult; thus, manual registration is dominant in practice. In manual registration, an expert user specifies a set of paired landmarks on the two images; subsequently, the system deforms the target image to match each landmark with its counterpart as a batch process. However, the deformation results are difficult for the user to predict, and moving the cursor back and forth between the two images is time-consuming. To improve the efficiency of this manual process, we propose an interactive method wherein the deformation results are continuously displayed as the user clicks and drags each landmark. Additionally, the system displays two cursors, one on the target image and the other on the reference image, to reduce the amount of mouse movement required. The results of a user study reveal that the proposed interactive method achieves higher accuracy and faster task completion compared to traditional batch landmark placement.Item ``Yunluo Journey'': A VR Cultural experience for the Chinese Musical Instrument(The Eurographics Association, 2024) Wang, Yuqiu; Guo, Wenchen; He, Zhiting; Fan, Min; Chen, Renjie; Ritschel, Tobias; Whiting, EmilyThe sustainability of the cultural heritage of traditional musical instruments requires integrating musical culture into people's daily lives. However, the Yunluo, a traditional Chinese musical instrument, is too large and expensive to be easily incorporated into everyday life. To promote the sustainability and dissemination of Yunluo culture, we designed a VR Yunluo cultural experience that allows people to engage in the creation and performance of Yunluo, as well as learn about its historical and cultural significance through a Yunluo experience. This embodied, gamified, and contextualized VR experience aims to enhance participants' interest in Yunluo culture and improve their understanding and appreciation of the related knowledge.Item Study of Alleviating the Symptoms of VR Sickness by Cooling Skin Surface(The Eurographics Association, 2023) Kawamura, Taiki; Sakata, Nobuchika; Abey Campbell; Claudia Krogmeier; Gareth YoungVR sickness with symptoms like motion sickness such as carsick may occur when using VR. The occurrence of VR sickness varies from person to person, and the intensity and symptoms of sickness vary. However, in case of the VR sickness once occurs, it interferes with VR activities. Therefore, the elimination or alleviation of VR sickness is necessary for comfortable VR activities. In this study, we propose a method of cooling the neck and temples of the skin surface to alleviate the symptoms of VR sickness when VR sickness occurs. The experimental results show that skin surface cooling is effective in suppressing the symptoms of VR sickness when it occurs.Item A Visual Approach to Pseudo Unseen Presence in the Metaverse Using HMD(The Eurographics Association, 2023) Funahashi, Kenji; Matsunoo, Yuzuki; Abey Campbell; Claudia Krogmeier; Gareth YoungYou may sometimes sense an unseen-presence when someone is behind you. We propose a novel method to show pseudopresence through visual perception using only a standard HMD. This goal is not to promote a clear perception of the five senses, but rather to somehow subconsciously perceive a sense of presence.Item Improvement of VR Science Teaching Materials That Visualize Invisible Elements and Evaluation as a Self-study use(The Eurographics Association, 2023) Fujiwara, Miraku; Terata, Yuki; Saruta, Kazuki; Chen, Guoyue; Abey Campbell; Claudia Krogmeier; Gareth YoungTeaching materials using virtual reality (VR) technology are expected to further improve learners' understanding. However, it is assumed that the instructor's engineering knowledge may be insufficient to introduce these materials in the classroom, and that it will take time to educate the instructors. Therefore, we improved VR science teaching materials that visualize electric currents and magnetic fields for self-study at home, and reviewed their self-study use. Experiments were conducted with university students, and we found that our modifications improved usability and VR sickness.Item An Interactive Tuning Method for Generator Networks Trained by GAN(The Eurographics Association, 2022) Zhou, Mengyuan; Yamaguchi, Yasushi; Cabiddu, Daniela; Schneider, Teseo; Allegra, Dario; Catalano, Chiara Eva; Cherchi, Gianmarco; Scateni, RiccardoThe recent studies on GAN achieved impressive results in image synthesis. However, they are still not so perfect that output images may contain unnatural regions. We propose a tuning method for generator networks trained by GAN to improve their results by interactively removing unexpected objects and textures or changing the object colors. Our method could find and ablate those units in the generator networks that are highly related to the specific regions or their colors. Compared to the related studies, our proposed method can tune pre-trained generator networks without relying on any additional information like segmentation-based networks. We built the interactive system based on our method, capable of tuning the generator networks to make the resulting images as expected. The experiments show that our method could remove only unexpected objects and textures. It could change the selected area color as well. The method also gives us some hints to discuss the properties of generator networks which layers and units are associated with objects, textures, or colors.