ProTrans: Projecting In-Place Translations for Printed Text

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Reading unknown words in non-native languages can hinder comprehension or slow reading by requiring dictionary consultation. Existing solutions for faster lookup only work digitally or, in the case of printed text, require a separate display. To enable a more seamless reading experience in the latter scenario, we present ProTrans (Projected Translation), a projector-camera system that detects words users point to and projects their translations onto nearby surfaces. We compare three projection targets-paper, finger, and hand-and gather initial user feedback. Results indicate that projecting onto the back of the hand balances legibility and viewing comfort, supporting the feasibility of skin-based projection for translation tasks.
Description

CCS Concepts: Human-centered computing → Mixed / augmented reality; Interaction techniques; Computing methodologies → Machine translation; Computer vision

        
@inproceedings{
10.2312:egve.20251352
, booktitle = {
ICAT-EGVE 2025 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
}, editor = {
Jorge, Joaquim A.
and
Sakata, Nobuchika
}, title = {{
ProTrans: Projecting In-Place Translations for Printed Text
}}, author = {
Grünwald, Dustin
and
Imoto, Yusuke
and
Taninaka, Isabella Mika
and
Sato, Kosuke
and
Iwai, Daisuke
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-530X
}, ISBN = {
978-3-03868-278-3
}, DOI = {
10.2312/egve.20251352
} }
Citation
Collections