Skip to main navigation menu Skip to main content Skip to site footer

Articles

Vol. 2 No. 1 (2016)

Automated Failure Detection in Computer Vision Systems

  • H. Yan
  • A. Achkar
  • Akshaya Mishra
  • K. Naik
DOI
https://doi.org/10.15353/vsnl.v2i1.84
Submitted
September 25, 2016
Published
2016-10-03

Abstract

Human validation of computer vision systems increase their operating
costs and limits their scale. Automated failure detection can
mitigate these constraints and is thus of great importance to the
computer vision industry. Here, we apply a deep neural network
to detect computer vision failures on vehicle detection tasks. The
proposed model is a convolution neural network that estimates the
output quality of a vehicle detector. We train the network to learn
to estimate a pixel-level F1 score between the vehicle detector and
human annotated data. The model generalizes well to testing data,
providing a mechanism for identifying detection failures.