VibVid: VIBration Estimation from VIDeo by using Neural Network

dc.contributor.authorYoshida, Kentaroen_US
dc.contributor.authorInoue, Sekien_US
dc.contributor.authorMakino, Yasutoshien_US
dc.contributor.authorShinoda, Hiroyukien_US
dc.contributor.editorRobert W. Lindeman and Gerd Bruder and Daisuke Iwaien_US
dc.date.accessioned2017-11-21T15:42:40Z
dc.date.available2017-11-21T15:42:40Z
dc.date.issued2017
dc.description.abstractAlong with advances in video technology in recent years, there is an increasing need for adding tactile sensation to it. Many researches on models for estimating appropriate tactile information from images and sounds contained in videos have been reported. In this paper, we propose a method named VibVid that uses machine learning for estimating the tactile signal from video with audio that can deal with the kind of video where video and tactile information are not so obviously related. As an example, we evaluated by estimating and imparting the vibration transmitted to the tennis racket from the first-person view video of tennis. As a result, the waveform generated by VibVid was almost in line with the actual vibration waveform. Then we conducted a subject experiment including 20 participants, and it showed good results in four evaluation criteria of harmony, fun, immersiveness, and realism etc.en_US
dc.description.sectionheadersBeyond Visuals
dc.description.seriesinformationICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
dc.identifier.doi10.2312/egve.20171336
dc.identifier.isbn978-3-03868-038-3
dc.identifier.issn1727-530X
dc.identifier.pages37-44
dc.identifier.urihttps://doi.org/10.2312/egve.20171336
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/egve20171336
dc.publisherThe Eurographics Associationen_US
dc.subjectHuman
dc.subjectcentered computing
dc.subjectHaptic devices
dc.subjectTheory of computation
dc.subjectModels of learning
dc.subjectHardware
dc.subjectHaptic devices
dc.titleVibVid: VIBration Estimation from VIDeo by using Neural Networken_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
037-044.pdf
Size:
6.89 MB
Format:
Adobe Portable Document Format
Collections