Borgo, RitaChen, MinDaubney, BenGrundy, EdwardHeidemann, GuntherHöferlin, BenjaminHöferlin, MarkusJänicke, HeikeWeiskopf, DanielXie, XianghuaN. John and B. Wyvill2014-02-062014-02-0620111017-4656https://doi.org/10.2312/EG2011/stars/001-023In recent years, a collection of new techniques which deal with video as input data, emerged in computer graphics and visualization. In this survey, we report the state of the art in video-based graphics and video visualization. We provide a comprehensive review of techniques for making photo-realistic or artistic computer-generated imagery from videos, as well as methods for creating summary and/or abstract visual representations to reveal important features and events in videos. We propose a new taxonomy to categorize the concepts and techniques in this newlyemerged body of knowledge. To support this review, we also give a concise overview of the major advances in automated video analysis, as some techniques in this field (e.g., feature extraction, detection, tracking and so on) have been featured in video-based modeling and rendering pipelines for graphics and visualization.