Vision-Based Interaction within a Multimodal Framework

Simple item page
dc.contributor.authorSá, Vítoren_US
dc.contributor.authorMalerczyk, Corneliusen_US
dc.contributor.authorSchnaider, Michaelen_US
dc.contributor.editorJoaquim Madeiraen_US
dc.contributor.editorJorge Salvador Marquesen_US
dc.contributor.editorMiguel Salles Diasen_US
dc.contributor.editorJoaquim A. Jorgeen_US
dc.date.accessioned2022-12-21T08:48:33Z
dc.date.available2022-12-21T08:48:33Z
dc.date.issued2022
dc.description.abstractOur contribution is to the field of video-based interaction techniques and is integrated in the home environment of the EMBASSI project. This project addresses innovative methods of man-machine interaction achieved through the development of intelligent assistance and anthropomorphic user interfaces. Within this project, multimodal techniques represent a basic requirement, especially considering those related to the integration of modalities. We are using a stereoscopic approach to allow the natural selection of d evices via pointing gestures. The pointing hand is segmented from the video images and the 3D position and orientation of the forefinger is calculated. This modality has a subsequent integration with that of speech, in the context of a multimodal interaction infrastructure. In a first phase, we use semantic fusion with amodal input, considering the modalities in a so-called late fusion state.en_US
dc.description.sectionheadersInteracção
dc.description.seriesinformation10º Encontro Português de Computação Gráfica
dc.identifier.doi10.2312/pt.20011318
dc.identifier.isbn978-3-03868-193-9
dc.identifier.pages61-67
dc.identifier.pages7 pages
dc.identifier.urihttps://doi.org/10.2312/pt.20011318
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/pt20011318
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectEMBASSI project, 3D deictic gestures, multimodal man-machine interaction, agent-based systems
dc.subjectEMBASSI project
dc.subject3D deictic gestures
dc.subjectmultimodal man
dc.subjectmachine interaction
dc.subjectagent
dc.subjectbased systems
dc.titleVision-Based Interaction within a Multimodal Frameworken_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
061-067.pdf
Size:
245.71 KB
Format:
Adobe Portable Document Format
Download
Collections
Portuguese Meeting on Computer Graphics 2001