Classifier-Guided Visual Correction of Noisy Labels for Image Classification Tasks

dc.contributor.authorBäuerle, Alexen_US
dc.contributor.authorNeumann, Heikoen_US
dc.contributor.authorRopinski, Timoen_US
dc.contributor.editorViola, Ivan and Gleicher, Michael and Landesberger von Antburg, Tatianaen_US
dc.date.accessioned2020-05-24T13:00:24Z
dc.date.available2020-05-24T13:00:24Z
dc.date.issued2020
dc.description.abstractTraining data plays an essential role in modern applications of machine learning. However, gathering labeled training data is time-consuming. Therefore, labeling is often outsourced to less experienced users, or completely automated. This can introduce errors, which compromise valuable training data, and lead to suboptimal training results. We thus propose a novel approach that uses the power of pretrained classifiers to visually guide users to noisy labels, and let them interactively check error candidates, to iteratively improve the training data set. To systematically investigate training data, we propose a categorization of labeling errors into three different types, based on an analysis of potential pitfalls in label acquisition processes. For each of these types, we present approaches to detect, reason about, and resolve error candidates, as we propose measures and visual guidance techniques to support machine learning users. Our approach has been used to spot errors in well-known machine learning benchmark data sets, and we tested its usability during a user evaluation. While initially developed for images, the techniques presented in this paper are independent of the classification algorithm, and can also be extended to many other types of training data.en_US
dc.description.number3
dc.description.sectionheadersMachine Learning
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume39
dc.identifier.doi10.1111/cgf.13973
dc.identifier.issn1467-8659
dc.identifier.pages195-205
dc.identifier.urihttps://doi.org/10.1111/cgf.13973
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13973
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/]
dc.subjectInformation systems
dc.subjectExpert systems
dc.subjectHuman centered computing
dc.subjectUser centered design
dc.subjectInformation visualization
dc.titleClassifier-Guided Visual Correction of Noisy Labels for Image Classification Tasksen_US
Files
Original bundle
Now showing 1 - 5 of 5
Loading...
Thumbnail Image
Name:
v39i3pp195-205.pdf
Size:
2.03 MB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
1012-file2.pdf
Size:
513.98 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
1012-file3.pdf
Size:
35.72 KB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
1012-file1.mov
Size:
62.01 MB
Format:
Video Quicktime
Loading...
Thumbnail Image
Name:
cgf13973-v39i3pp195-205.pdf
Size:
2.05 MB
Format:
Adobe Portable Document Format
Description:
with Projekt Deal funding statement
Collections