Sign Language Learning System with Concurrent Shared Avatar Hand in a Virtual Environment: Psychological Evaluation

dc.contributor.authorKatsumata, Yasunobuen_US
dc.contributor.authorIshimoto, Hirokien_US
dc.contributor.authorInoue, Yasuyukien_US
dc.contributor.authorKitazaki, Michiteruen_US
dc.contributor.editorTheophilus Teoen_US
dc.contributor.editorRyota Kondoen_US
dc.date.accessioned2022-11-29T07:23:47Z
dc.date.available2022-11-29T07:23:47Z
dc.date.issued2022
dc.description.abstractWe aimed to develop a sign language learning system using virtual reality to improve learning motivation. Hand movements for twenty words consisted of three letters were recorded with a hand motion capture system (model hand). In the learning system, the participant was asked to mimic the model hand movement while looking at both the model hand and the ''own hand'' in a head mounted display (HMD) with the hand motion capture. The ''own hand'' avatar was either of the real own hand or the shared hand motion, which was made by averaging the participant's hand and the model hand movements. The model hand was presented either in the opposite or same direction as the participant. Participants rated the usability of the system in 2 x 2 (own/shared hand x opposite/same direction) experimental blocked design. We found that the shared hand avatar and the same direction presentation were better than the own hand and the opposite direction presentation, respectively. Thus, the proposed shared hand avatar system with the HMD and hand motion capture could improve sign language learning.en_US
dc.description.sectionheadersPosters
dc.description.seriesinformationICAT-EGVE 2022 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments - Posters and Demos
dc.identifier.doi10.2312/egve.20221300
dc.identifier.isbn978-3-03868-192-2
dc.identifier.issn1727-530X
dc.identifier.pages27-28
dc.identifier.pages2 pages
dc.identifier.urihttps://doi.org/10.2312/egve.20221300
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/egve20221300
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Human-centered computing -> Virtual reality; Applied computing -> Computer-assisted instruction
dc.subjectHuman centered computing
dc.subjectVirtual reality
dc.subjectApplied computing
dc.subjectComputer
dc.subjectassisted instruction
dc.titleSign Language Learning System with Concurrent Shared Avatar Hand in a Virtual Environment: Psychological Evaluationen_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
027-028.pdf
Size:
1.2 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
figure1.jpg
Size:
548.85 KB
Format:
Joint Photographic Experts Group/JPEG File Interchange Format (JFIF)