Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research
No Thumbnail Available
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
In this paper, we present the Vis Repligogy framework that enables conducting replication studies in the class. Replication studies are crucial to strengthening the data visualization field and ensuring its foundations are solid and methods accurate. Although visualization researchers acknowledge the epistemological significance of replications and their necessity to establish trust and reliability, the field has made little progress to support the publication of such studies and, importantly, provide methods to the community to encourage replications. Therefore, we contribute Vis Repligogy, a novel framework to systematically incorporate replications within visualization course curricula that not only teaches students replication and evaluation methodologies but also results in executed replication studies to validate prior work. To validate the feasibility of the framework, we present case studies of two graduate data visualization courses that implemented it. These courses resulted in a total of five replication studies. Finally, we reflect on our experience implementing the Vis Repligogy framework to provide useful recommendations for future use. We envision this framework will encourage instructors to conduct replications in their courses, help facilitate more replications in visualization pedagogy and in research, and support a culture shift towards reproducible research. Supplemental materials of this paper are available at https://osf.io/ncb6d/.
Description
CCS Concepts: Human-centered computing→Visualization theory and methods; Visualization pedagogy
@inproceedings{10.2312:eved.20241054,
booktitle = {EuroVis 2024 - Education Papers},
editor = {Firat, Elif E. and Laramee, Robert S. and Andersen, Nicklas Sindelv},
title = {{Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research}},
author = {Syeda, Uzma Haque and South, Laura and Raynor, Justin and Panavas, Liudas and Saffo, David and Morriss, Tommy and Dunne, Cody and Borkin, Michelle A.},
year = {2024},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-257-8},
DOI = {10.2312/eved.20241054}
}