Haedecke, ElenaMock, MichaelAkila, MaramBernard, JürgenAngelini, Marco2022-06-022022-06-022022978-3-03868-183-02664-4487https://doi.org/10.2312/eurova.20221071https://diglib.eg.org:443/handle/10.2312/eurova20221071We present ScrutinAI, a Visual Analytics approach to exploit semantic understanding for deep neural network (DNN) predictions analysis, focusing on models for object detection and semantic segmentation. Typical fields of application for such models, e.g. autonomous driving or healthcare, have a high demand for detecting and mitigating data- and model-inherent shortcomings. Our approach aims to help analysts use their semantic understanding to identify and investigate potential weaknesses in DNN models. ScrutinAI therefore includes interactive visualizations of the model's inputs and outputs, interactive plots with linked brushing, and data filtering with textual queries on descriptive meta data. The tool fosters hypothesis driven knowledge generation which aids in understanding the model's inner reasoning. Insights gained during the analysis process mitigate the ''black-box character'' of the DNN and thus support model improvement and generation of a safety argumentation for AI applications. We present a case study on the investigation of DNN models for pedestrian detection from the automotive domain.Attribution 4.0 International LicenseCCS Concepts: Human-centered computing --> Visual analytics; Interactive systems and tools; Computing methodologies --> Neural networks; Object detectionHuman centered computingVisual analyticsInteractive systems and toolsComputing methodologiesNeural networksObject detection10.2312/eurova.202210711-55 pages