# Active contours with neighborhood-extending and noise-smoothing gradient vector flow external force

- Lixiong Liu
^{1}Email author and - Alan C Bovik
^{2}

**2012**:9

**DOI: **10.1186/1687-5281-2012-9

© Liu and Bovik; licensee Springer. 2012

**Received: **15 January 2012

**Accepted: **10 May 2012

**Published: **10 May 2012

## Abstract

We propose a novel external force for active contours, which we call *neighborhood-extending and noise-smoothing gradient vector flow* (NNGVF). The proposed NNGVF snake expresses the gradient vector flow (GVF) as a convolution with a neighborhood-extending Laplacian operator augmented by a noise-smoothing mask. We find that the NNGVF snake provides better segmentation than the GVF snake in terms of noise resistance, weak edge preservation, and an enlarged capture range. The NNGVF snake accomplishes this with a reduced computational cost while maintaining other desirable properties of the GVF snake, such as initialization insensitivity and good convergences at concavities. We demonstrate the advantages of NNGVF on synthetic and real images.

### Keywords

image segmentation active contour gradient vector flow Laplacian operator neighborhood-extending and noise-smoothing gradient vector flow## 1. Introduction

D uring the last two decades, variational and PDE-based methods for image segmentation and analysis have become standard tools [1]. Active contours or snakes which have deeply influenced variational approaches to image segmentation since their introduction [2] are curves that can conform to object boundaries or other image features under the influence of internal and external forces [2]. Generally, active contours can be categorized as parametric snakes [2] or as geometric snakes [3–5] according to their representation. Parametric snakes require an explicit representation while geometric snakes are defined implicitly. Here, we show how to construct an effective external force for parametric active contour models that can also be integrated into geometric active contours using a level set formulation [4].

Since the external force defines the evolution of an active contour, many external force models have been proposed [5–14]. Among these, the gradient vector flow (GVF) [10] has been most successful, as it provides a large capture range and the ability to capture concavities by diffusing the gradient vectors of an edge map generated from the image. Although the GVF model has proved effective and has widely been used in image segmentation, it has some disadvantages, such as a high computational cost, substantial noise sensitivity, and an inability to capture and preserve weak edges. Various improved models based on the GVF have been developed. For example, generalized gradient vector flow [11], harmonic gradient vector flow [12], motion gradient vector flow [13] and generalized dynamic directional gradient vector flow [14], but none of these are able to resolve all of the problems mentioned above.

We propose a novel external force for active models, called neighborhood-extending and noise-smoothing gradient vector flow (NNGVF), which incorporates a neighborhood-extended Laplacian operator mask and modifies the mask by adding a noise-smoothing mask. The proposed NNGVF snake outperforms the GVF snake in terms of computation, capture range, noise resistance, and weak edge preserving ability, while maintaining other desirable properties of the GVF snake such as initialization insensitivity and good convergence at concavities.

## 2. Background

### 2.1. Snakes: active contours

*c*(

*s*) = [

*x*(

*s*),

*y*(

*s*)], s∊ [0, 1] which deforms to minimize the energy functional [2]:

**c**

_{s}(

*s*) and

**c**

_{ss}(

*s*) are the first and second derivative of

**c**(

*s*) with respect to

*s*weighed by positive

*α*and

*β*, respectively. A typical external force for a gray-scale image I is

*E*

_{ext}= -|∇

*G*

_{ σ }*

*I*|, where

*G*

_{ σ }is the Gaussian kernel with standard deviation

*σ*and where * denotes convolution. Using standard variational methods, the Euler equation to minimize

*E*

_{snake}is expressed

where *F*_{int} = *αc*_{ss}(*s*)-*βc*_{ssss}(*s*) and *F*_{ext} = -∇*E*_{ext}. The internal force *F*_{int} forces the snake contour to be smooth while the external force *F*_{ext} attracts the snake to the desired image features.

### 2.2. GVF: gradient vector flow external force

**v**(

*x, y*) = (

*u*(

*x, y*),

*v*(

*x, y*)) obtained by minimizing the following energy functional [15]:

*f*is the edge map of an image, and variable

*μ*is a regularization parameter. The functions

*u*(

*x, y*) and

*v*(

*x, y*) are at least

*C*

^{2}when

*E*

_{GVF}is minimized. The Euler equation to minimize

*E*

_{GVF}is:

where ∇^{2} is the Laplacian operator.

## 3. NNGVF snakes

### 3.1. Extended neighborhood

### 3.2. Decomposition of the Laplacian operator

In this model, the AP filter is the 2D linear identity (do-nothing) filter, while the RM filter is a 2D low-pass filter. The difference yields high-frequency components over a large area. Since the purpose of the AP filter is to estimate the image at the center pixel, but is highly sensitive to noise [17], it is advisable to replace the AP filter with a better designed filter that can augment edge-preservation and noise robustness.

### 3.3. The proposed NNGVF external force

In (11), NS_{24} and RM_{24} are 5 × 5 masks, which make use of larger areas of image information. Since the convolution is used in (11), the computational cost of NNGVF is greatly reduced relative to GVF.

## 4. Experimental results

Next, we demonstrate some desirable properties of the NNGVF snake and compare the performances of the NNGVF and GVF snakes. Since NNGVF is an improvement over GVF, we focus primarily on some common concerns encountered in snake-based image segmentation, which include (1) capture range enlargement and U-shape convergence, (2) weak edge preservation, (3) noise robustness, and (4) real images. The parameters for all snakes in our experiments are *α* = 0.1, *β* = 0 and time step *τ* = 1. The weight *μ* for the GVF and NNGVF snakes is set to 0.15 in all experiments unless otherwise stated.

### 4.1. Capture range enlargement and U-shape convergence

### 4.2. Weak edge preserving

### 4.3. Noise robustness

### 4.4. Real images

## 5. Conclusion

We proposed a novel external force called NNGVF for active contours. The NNGVF snake deploys the GVF as a convolution operation using a neighborhood-extending Laplacian mask, modifying the mask to improve noise-smoothing, yields a good performance in terms of capture range, weak edge preservation, and noise robustness while maintaining the other desirable properties of GVF, such as initialization insensitivity and good convergence at concavities. The experimental results showed that the NNGVF snake outperforms the GVF snake in terms of computation as well.

## Declarations

### Acknowledgements

This work is supported by the NSFC (60805004).

## Authors’ Affiliations

## References

- Aubert G, Kornprobst P:
*Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations*. 2nd edition. Springer, New York; 2006.Google Scholar - Kass M, Witkin A, Terzopoulos D: Snakes: active contour models.
*Int J Comput Vis*1988, 1(4):321-331.View ArticleGoogle Scholar - Caselles V, Catte F, Coll T, DIBOS F: A geometric model for active contours in image processing.
*Numerische Mathematik*1993, 66(1):1-31.MATHMathSciNetView ArticleGoogle Scholar - Paragios N, Mellina-Gottardo O, Ramesh V: Gradient vector flow fast geometric active contours.
*IEEE Trans Pattern Anal Mach Intell*2004, 26(3):402-407.View ArticleGoogle Scholar - Lankton S, Tannenbaum A: localizing region based active contours.
*IEEE Trans Image Process*2008, 17(11):2029-2039.MathSciNetView ArticleGoogle Scholar - Cohen LD: On active contour models and balloons.
*CVGIP: Image Understand*1991, 53(2):211-218.MATHView ArticleGoogle Scholar - Cohen LD, Cohen I: Finite-element methods for active contour models and balloons for 2-D and 3-D images.
*IEEE Trans Pattern Anal Mach Intel*1993, 15(11):1131-1147.View ArticleGoogle Scholar - Leroy B, Herlin I, Cohen LD: Multi-resolution algorithms for active contour models.
*12th International Conference on Analysis and Optimization of Systems*1996, 58-65.Google Scholar - Muralidhar GS, Bovik AC, Giese JD, Sampat MP, Whitman GJ, Haygood TM, Stephens TW, Markey MK: Snakules: an evidence-based active contour algorithm for the annotation of spicules on mammography.
*IEEE Trans Med Imag*2010, 29(10):1768-1780.View ArticleGoogle Scholar - Xu C, Prince J: Snakes, shapes and gradient vector flow.
*IEEE Trans Image Process*1998, 7(3):359-369.MATHMathSciNetView ArticleGoogle Scholar - Xu C, Prince J: Generalized gradient vector flow external forces for active contours.
*Signal Process*71: 131-139. - Wang Y, Jia Y, Liu L: Harmonic gradient vector flow external force for snake model.
*Electron Lett*2008, 44(2):105-107.MathSciNetView ArticleGoogle Scholar - Ray N, Acton ST: Motion gradient vector flow: an external force for tracking rolling leukocytes with shape and size constrained active contours.
*IEEE Trans Med Imag*2004, 23(12):1466-1478.View ArticleGoogle Scholar - Liu L, Wu Y, Wang Y: A novel method for segmentation of the cardiac MR images using generalized DDGVF snake models with shape priors.
*Inf Technol J*2009, 8(4):486-494.View ArticleGoogle Scholar - Xu C, Prince JL: Gradient vector flow: a new external force for snakes.
*IEEE Computer Society Conference on Computer Vision and Pattern Recognition*1997, 66-71.Google Scholar - Jain R, Kasturi R, Schuck BG:
*Machine Vision*. McGraw Hill; 1995.Google Scholar - Wang X: Laplacian operator-based edge detectors.
*IEEE Trans Pattern Anal Mach Intell*2007, 29(5):886-890.View ArticleGoogle Scholar - Ning J, Wu C, Liu S, Yang S: NGVF: an improved external force field for active contour model.
*Pattern Recognit Lett*2007, 28(1):58-63.View ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.