At this year's IEEE PacificVis 2023, researchers of the Institute for Visualization and Interactive Systems (VIS) and the Visualization Research Center of the University of Stutgart (VISUS) received the Best Visualization Notes Honorable Mention Award for their publication "Toward Reproducible Visual Analysis Results". Congratulations!
Authors
- Max Franke (University of Stuttgart, VIS)
- Guido Reina (University of Stuttgart, VISUS, SFB 1313 principal investigator, research project D01)
- Steffen Koch (University of Stuttgart, VIS)
The IEEE PacificVis 2023 took place in Seoul, South Korea, from 18 to 21 April 2023.
Publication
Franke, Max ; Reina, Guido ; Koch, Steffen: Toward Reproducible Visual Analysis Results. In: Proceedings of the 16th IEEE Pacific Visualization Symposium, Proceedings of the 16th IEEE Pacific Visualization Symposium : IEEE, 2023. — Slides: https://dx.doi.org/10.5281/zenodo.7846110, S. 102--106
Abstract
In visualization research, reproducibility is often not taken into account as a design goal. Reproducibility is desirable beyond ensuring scientific rigor: In the long-term, it helps advance sustainable visualization research, and in the short-term, it supports domain experts using the visualizations in their daily work. Designing for and ensuring reproducibility introduces costs, such as as storage cost or infrastructure maintenance. We propose a typology of reproducibility aspects that can be considered during visualization design. We then propose practical strategies to improve reproducibility and discuss their initial and running costs, their limits, and their tradeoffs. Finally, we discuss three concrete visualization approaches in the context of our typology and strategies.
Guido Reina
Dr.Principal Investigator, Research Project D01