Skip to main content
EURASIP Journal on Image and Video Processing
Download PDF

A Review and Comparison of Measures for Automatic Video Surveillance Systems

EURASIP Journal on Image and Video Processing volume 2008, Article number: 824726 (2008) Cite this article

Abstract

Today's video surveillance systems are increasingly equipped with video content analysis for a great variety of applications. However, reliability and robustness of video content analysis algorithms remain an issue. They have to be measured against ground truth data in order to quantify the performance and advancements of new algorithms. Therefore, a variety of measures have been proposed in the literature, but there has neither been a systematic overview nor an evaluation of measures for specific video analysis tasks yet. This paper provides a systematic review of measures and compares their effectiveness for specific aspects, such as segmentation, tracking, and event detection. Focus is drawn on details like normalization issues, robustness, and representativeness. A software framework is introduced for continuously evaluating and documenting the performance of video surveillance systems. Based on many years of experience, a new set of representative measures is proposed as a fundamental part of an evaluation framework.

Publisher note

To access the full article, please see PDF.

Author information

Authors and Affiliations

  1. Corporate Research, Robert Bosch GmbH, D-70049, Stuttgart, Germany

    Axel Baumann, Marco Boltz, Julia Ebling, Matthias Koenig, HartmutS Loos, Marcel Merkel, Wolfgang Niem, JanKarl Warzelhan & Jie Yu

Authors
  1. Axel Baumann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Boltz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julia Ebling
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Matthias Koenig
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. HartmutS Loos
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marcel Merkel
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wolfgang Niem
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. JanKarl Warzelhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jie Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Julia Ebling.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Baumann, A., Boltz, M., Ebling, J. et al. A Review and Comparison of Measures for Automatic Video Surveillance Systems. J Image Video Proc 2008, 824726 (2008). https://doi.org/10.1155/2008/824726

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/2008/824726

Keywords

  • Ground Truth
  • Analysis Task
  • Normalization Issue
  • Video Analysis
  • Evaluation Framework