Skip to main content

Advertisement

Track and Cut: Simultaneous Tracking and Segmentation of Multiple Objects with Graph Cuts

Article metrics

Abstract

This paper presents a new method to both track and segment multiple objects in videos using min-cut/max-flow optimizations. We introduce objective functions that combine low-level pixel wise measures (color, motion), high-level observations obtained via an independent detection module, motion prediction, and contrast-sensitive contextual regularization. One novelty is that external observations are used without adding any association step. The observations are image regions (pixel sets) that can be provided by any kind of detector. The minimization of appropriate cost functions simultaneously allows "detection-before-track" tracking (track-to-observation assignment and automatic initialization of new tracks) and segmentation of tracked objects. When several tracked objects get mixed up by the detection module (e.g., a single foreground detection mask is obtained for several objects close to each other), a second stage of minimization allows the proper tracking and segmentation of these individual entities despite the confusion of the external detection module.

Publisher note

To access the full article, please see PDF.

Author information

Correspondence to Aurélie Bugeau.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Bugeau, A., Pérez, P. Track and Cut: Simultaneous Tracking and Segmentation of Multiple Objects with Graph Cuts. J Image Video Proc 2008, 317278 (2008) doi:10.1155/2008/317278

Download citation

Keywords

  • Multiple Object
  • Detection Module
  • Image Region
  • Full Article
  • Motion Prediction