Torre, RémyFua, PascalBalcisoy, SelimPonder, MichalThalmann, DanielJ. D. Mulder and R. van Liere2014-01-272014-01-2720003-211-83516-41727-530Xhttps://doi.org/10.2312/EGVE/EGVE00/023-032For some years, we have been able to integrate virtual hu- mans into virtual environments. As the demand for Augmented Reality systems grows, so will the need for these synthetic humans to coexist and interact with humans who live in the real world. In this paper, we use the example of a checkers game between a real and a virtual human to demonstrate the integration of techniques required to achieve a realistic- looking interaction in real-time. We do not use cumbersome devices such as a magnetic motion capture system. Instead, we rely on purely image- based techniques to address the registration issue, when the camera or the objects move, and to drive the virtual human's behavior.