Open Access

Condensed anisotropic diffusion for speckle reducton and enhancement in ultrasonography

EURASIP Journal on Image and Video Processing20122012:12

https://doi.org/10.1186/1687-5281-2012-12

Received: 20 July 2011

Accepted: 18 June 2012

Published: 18 July 2012

Abstract

This article proposes a technique for speckle reduction in medical ultrasound (US) imaging which preserves the point and linear features with the added advantage of energy condensation regulator. Whatever be the post processing task on US image, the image should undergo a preprocessing step called despeckling. Nowadays, though the US machines are available with built-in speckle reduction facility, they are suffered by many practical limitations such as limited dynamic range of the display, limited number of unique directions that an US beam scan follow to average an image and limited size of transducer, etc. The proposed diffusion model can be used as a visual enhancement tool for interpretation as well as a preprocessing task for further diagnosis. This method incorporates two terms: diffusion and regulator. The anisotropic diffusion preserves and enhances edges and local details. The regularization enables the correction of feature broadening distortion which is the common problem in second-order diffusion-based methods. In this scheme, the diffusion matrix is designed using local coordinate transformation and the feature broadening correction term is derived from energy function. Performance of the proposed method has been illustrated using synthetic and real US data. Experiments indicate better speckle reduction and effective preservation of edges and local details.

Keywords

Speckle Filtering Anisotropic diffusion Regulator Edge enhancement

Introduction

For more than two decades, ultrasonography has been considered as one of the most powerful techniques for imaging organs and soft tissue structures in the human body. Today, it is being used at an ever-increasing rate in the field of medical diagnostic technology. Ultrasonography is often preferred over other medical imaging modalities because it is non-invasive, portable, versatile, does not use ionizing radiations, and also relatively of low-cost. The images produced by commercial ultrasound (US) systems are usually optimized for visual interpretation because of its real-time usage. However, the usefulness of medical ultrasonography is degraded by signal-dependent noise called ‘speckle’ which is multiplicative in nature.

Imaging speckle is a phenomenon that occurs when a coherent source and a non-coherent detector are used to interrogate a medium, which is rough on the scale of the wavelength. In medical images, noise suppression is particularly a delicate and difficult task. A tradeoff between noise reduction and the preservation of actual image features has to be made in a way that enhances the diagnostically relevant image content. Speckle reduction is needed for two main reasons: first is to improve the human interpretation, i.e., for visual enhancement and secondly, despeckling is the preprocessing step for many image processing tasks. Importance of despeckling is depicted in Figure 1.
Figure 1

Importance of despeckling.

Many filters have been developed to cope up with speckle, with differences lying in the assumptions about the speckle model [1]. The methods described by Lee [2], Frost et al. [3], and Kuan et al. [4, 5] are based on multiplicative model and simple logarithmic operation converts the speckle into additive noise. Filtering based on anisotropic diffusion (AD) was introduced by Perona and Malik [6] who had constituted a powerful tool for signal and image enhancement. When AD is introduced for first time an undesirable effect called “pin hole effect” may result and this is addressed by Monteil and Beghdadi [7] through optical flow technique. Later, Yu and Acton [8] have proposed a novel filtering scheme based on the filters first described by Lee and Frost. The authors find a relation between the former and the AD equation and give rise to a speckle removal filter, which they call speckle reducing anisotropic diffusion (SRAD). This filter has shown very good performance with different levels of speckle. However, SRAD tends to broaden thin linear features and point features. These features carry useful information for diagnosis and the problem need to be corrected.

To overcome the feature broadening problem, a method has been proposed by Acton [9]. This method combines the strength of SRAD and deconvolution restoration. This technique assumed that feature distortion is caused by the convolution of the point spread function of the imaging system with the underlying feature. Hence, deconvolution sharpens features, while SRAD removes the speckle. This method showed promising results on synthesized US data, although no results were reported for real data. A generic framework to find the matrix-valued counterparts of the Perona–Malik PDE with various diffusivity functions is proposed by Burgeth et al. [10].

Fourth-order partial differential equation (PDE)-based despeckling method has been proposed in [11]. This can reduces the speckle and also able to keep the image edge better, but this method requires more number of iterations to converge.

Regularization methods have been used in real-valued image restoration [12, 13], as well as image reconstruction problems such as medical tomography [14, 15] to obtain improved image estimates in the face of data degradation. The simplest and the most common approach is to use quadratic functions of the unknown quantities. These methods lead to computationally straightforward optimization problems, but they suppress useful features in the resulting imagery, such as edges. Recently, considerable effort has been spent in designing alternative, non-quadratic constraints which preserve such features. Methods based on these non-quadratic constraints have successfully been used in edge-preserving regularization in image restoration [12] and computer-assisted tomography [1316].

In this article, a new method has been proposed to reduce speckle in US images by incorporating a non-quadratic regularization into nonlinear coherent diffusion to preserve and enhance edges, local details, and to correct the feature broadening distortion. The proposed model carries two terms: the first is coherent diffusion term that reduces the speckle by nonlinear coherent diffusion, which utilizes the diffusion tensor derived from coordinate transformation. The second term is called regulator, which enhance the performance of coherent diffusion as well as it enables the correction of feature broadening distortion. Therefore, our model performs simultaneous speckle reduction, structure enhancement, and feature broadening correction with minimum computational cost.

Background of diffusion

The basic idea in the use of PDEs in image processing is to deform an image, a curve, or a surface in a PDE framework and to approach the expected result as a solution to this equation.

Let I:Ω → be a scalar-valued image (gray level image) with Ω p . Gradient of the image characterizes the difference in gray value. In Biomedical imaging, besides noise also edges result in a large gradient at fine scales. The direct approach to reduce variations in the image I would be to reduce the gradient of the image globally.

Calculus of variations is a mathematical tool with the help of which we can find the extrema of functionals.
min I : Ω E ( I ) = Ω F ( x , y , I ( x , y ) , I x ( x , y ) , I y ( x , y ) ) d Ω
(1)
Euler–Lagrange equation gives a necessary condition that must be verified by I to reach minimum of E(I). And also one can use gradient descent an iterative approach to reach such a minimum, starting from an initial image. Equation (1) can be reduced as
E ( I ) = Ω F ( x , y , I ( x , y ) , I ( x , y ) ) d Ω
(2)
where I(x, y) is 2D image by
{ F I x F I x y F I y f o r ( x , y ) Ω , I . n = 0 f o r ( x , y ) Ω
(3)

where ∂Ω is boundary of Ω and n is normal vector of boundary. Euler–Lagrange equation makes the link between PDEs evolution and gradient descent for continual minimization.

Diffusion is a physical process that equilibrates concentration differences without creating or destroying mass. This physical observation is mathematically expressed by Flick’s law as
j = D . I
(4)
This equation states that a concentration gradient I causes a flux j which aims to compensate for this gradient [17]. The relation between I and j is described by the diffusion tensor D , a positive definite symmetric matrix. The case where j and I are parallel is called isotropic. Then we may replace the diffusion tensor by a positive scalar-valued diffusivity g. In general, for anisotropic case, j and I are not parallel. Thus the diffusion only transports mass without destroying it or creating new mass. This observation is expressed by the continuity equation as
t I = d i v j
(5)
where t denotes the time. If we plug in Flick’s law into the continuity equation we end up with the diffusion equation
t I = d i v ( D . I )
(6)

This equation appears in many physical transport processes. In the context of heat transfer, it is called heat equation. In image processing, we may identify the concentration with the grey value at a certain location. If the diffusion tensor is constant over the whole image domain, one speaks of homogeneous diffusion whereas a space-dependent filtering is called inhomogeneous. Often the diffusion tensor is a function of the differential structure of the evolving image itself. Such a feedback leads to nonlinear diffusion filters. Diffusion which does not depend on the evolving image is called linear. Sometimes the computer vision literature deviates from the preceding notations, i.e., the homogeneous filtering is named isotropic and inhomogeneous blurring is called anisotropic, even if it uses a scalar-valued diffusivity instead of a diffusion tensor.

Anisotropic diffusion

A general expression of the AD equation can be written as
{ I t = I x , 0 = I 0 div F + β I 0 I
(7)
where F is the diffusion and β is a data attachment coefficient. If β = 0, particular cases of this equation are (1) the heat diffusion equation F = I, which is equivalent to a Gaussian convolution. (2) The Perona and Malik equation [6] with F = g ( I ) I , where g is diffusion function. This function has the effect of reducing the diffusion for “high” gradients, based on the threshold β on the norm of the gradient. (3) The matrix diffusion proposed in [16] uses a diffusion matrix noted D with a flux F = D.I. The matrix D can be expressed in a diagonal form with eigenvectors (v0; v1; v2) and eigen values λ0, λ1, λ2. Then the flux can be expressed as
F = D . I = i = 0 2 λ i I v i v i
(8)
where I v i = I v i is the first-order derivative of the intensity in the direction of v i . In 1990, Perona and Malik [6] proposed a PDE-based diffusion method for denoising. Their work made a great influence in this field and the diffusion equation can be expressed as
I t = . [ c ( q ) . I ]
(9)

With initial condition: I ( x , y , 0 ) = I 0 , I ( x , y , 0 ) ; 2 = + is an image in the continuous domain, where (x, y) specifies the spatial position; t is an artificial time parameter; с is the diffusion constant, and I is the image gradient. The с value is suggested to provide backward diffusion around intensity transitions and forward diffusion in smooth areas in favor of edge sharpening and noise removal. Edges and local details are the most interesting parts in diagnostic imaging for clinicians. Therefore, enhancement and preservation of edges and local details on denoising are very important. In Equation (9), с is a scalar function and I serves only as an edge detector rather than providing smoothing.

Nonlinear coherent diffusion

The diffusion coefficient is represented in tensor form by Abd-Elmoniem et.al. [18] to measure local coherence of structures. This made the diffusion process more directional in both the gradient and the contour directions as an alternative of scalar parameter-based diffusion coefficient [615]. Hence, the coherent diffusion model takes the form I ( x , y , t ) / t = div ( D I ) , where D 2 X 2 is a symmetric positive semi-definite diffusion tensor representing the required diffusion in both gradient and contour directions. There are two tensors widely used to detect the local coherence, namely, the structure tensor (also called scatter matrix or windowed second moment tensor) and the Hessian tensor, which represents the second-order derivatives. These can be expressed as follows
I x 2 I x I y I x I y I y 2 ︸ STRUCTURE MATRIX , I xx I xy I xy I yy ︸ COVARIANCE MATRIX
(10)
The Hessian matrix is more sensitive to noise; therefore, the structure tensor is favored. The following diffusion tensor is proposed in nonlinear coherent diffusion (NCD) model [18] to obtain selective smoothing along the gradient and contour direction.
J ( I ) = ω 1 ω 2 μ 1 0 0 μ 2 ω 1 T ω 2 T
(11)

where the eigen vectors ω1 and ω2 represent the directions of maximum and minimum variations and the eigen values μ1 and μ2 correspond to the strength of these variations, respectively. However, the diffusion tensor used in the nonlinear coherent diffusion model was actually depending on local statistics which are isotropic in nature, and also on the tensor provided by Gaussian smoothed image which may not effectively suppress the spatially correlated speckle noise.

Proposed technique

Condensed anisotropic diffusion

An image I can be anisotropically smoothed, i.e., denoised with preservation of discontinuities by minimizing
E diff ( I ) = Ω α 2 I I 0 2 + ϕ I d Ω
(12)
where is vector gradient norm that measures norm and orientation, i.e., global vector variation α   is fixed parameter that prevents the final solution at convergence to be too different from the original image. The function ϕ: is a diffusion function that controls the regularization behavior. To minimize the functional Ediff(I), calculate the corresponding vector Lagrangian L E diff I n
I = i = 1 n I i 2
(13)
By using a vector gradient descent: I t = L ( E diff ( I ) ) ;
{ I ( t = 0 ) = I 0 I i t = α ( I i 0 I i ) + d i v ϕ I I I i
(14)

For many years, image regularization with discontinuities (edges) preservation has been studied in the computer vision community. Image regularization with PDE is again based on a measure of local parameter variations. In Equation (14), the first term is regularization term α coupled with data attachment or fidelity term (Ii 0I i ).

By introducing orthonormal constraints in the minimization functionals equation (12) leads to the unconstrained minimization of,
E I = E 0 I + β Ω I I c γ d x
(15)
The solution of (15) in the space of equal energy function is restricted to Ω I γ d x = Ω I 0 γ d x in order to avoid trivial solution of all zeros. The condensed anisotropic diffusion (CAD) model is derived by minimizing the energy function equations (14) and (15) as
I ( x , y , t ) t = . ( D . I ) + β γ ( I c ) γ I γ 1 ( x , t )
(16)
To make the diffusion process more directional in gradient and contour direction, the diffusion coefficient can be put in tensor form [18, 19]. And the tensor should be chosen such that to make the model progress from isotropic diffusion to AD. An isotropic diffusion is required in homogeneous domain and AD is needed in the domains of edges and local details. This means diffusion do occur only along the tangent direction of edges and does not across the edges. Diffusion tensor or covariance matrix D is symmetric and semi-positive definite n × n matrix
S e m i P o s i t i v i t y : k [ 1 , n ] , λ k 0 , O r t h o g o n a l i t y ( Re a l & S y m m e t r i c ) : k , l [ 1 , n ] , u k , l = δ kl , δ kl = { 1 , i f k = l 0 , i f k l
D can be expressed with eigen values λ k and its corresponding eigen vectors u k . The meaningful information contained in D can be retrieved from its spectral decomposition
D = k = 1 n λ k u k u k T = U A U T
(17)

U = ( u 1 , u 2 , , u n ) is the n × n orthogonal matrix of the unit eigen vector columns u k , forming an orthonormal vector basis. A = diag ( λ 1 , λ 2 , , λ n ) is the corresponding diagonal matrix of the positive eigen vectors. The spectral decomposition separates the orientation features and diffusivity features A of tensor D.

For instance, to remove the noise effectively and to avoid the vision of undesired image structures, isotropic smoothing is preferred in homogeneous regions. Followed by, in order to preserve the vector edges while removing the noise, the diffusion should occur along the vector edges. And diffusion rate should be decreased in order to prevent the corner erosion. These conditions can be satisfied through the use of local coordinate transformation in the design of diffusion tensor. As shown in Figure 2, at the edge point o, for t n, n , t are unit normal and unit tangent vectors, n = I I , t = I I .
Figure 2

Decomposition of directional derivative on image edge.

Where t is tangent to the contours in the image everywhere and the set ( n , t ) is a moving orthonormal basis & configuration depends on the current coordinate (x, y). Using local coordinate transformation, the relationship between ( n , t ) and (x, y) is given as
n t = 1 I R θ x y
(18)
where R θ is rotation matrix, for 2D image Equation (18) can be written as
n t = 1 I I x I y I y I x T x y
(19)
From local coordinate transformation, the diffusion tensor becomes
D = 1 I 2 I x I y I y I x T λ 1 0 0 λ 2 I x I y I y I x
(20)
where λ1 and λ2 are diffusion coefficients along the direction of normal and tangent directions. In the NCD model [18], λ1 and λ2 are related to eigen value correspond to strength of maximum and minimum variations.
λ 1 = { α 1 A s 2 , i f A = ( μ 1 μ 2 ) s 2 0 , e l s e , λ 2 = α
(21)

In the constant regions, μ 1 μ 2 0 and λ 1 λ 2 α , which gives DαI d where, I d is identity matrix. Thus, in the constant (homogeneous) region, there is no preferred diffusion direction and the diffusion tensor is isotropic. For image contours, μ 1 > > μ 2 > > 0 and λ 2 > λ 1 > 0 , diffusion tensor is anisotropic and mainly directed by the tangent vector of the image.

In (21), λ1 is related to anisotropy of the image, i.e., A = μ 1 μ 2 , which is a monotonically decreasing function and resembles Tukey’s bi-weight robust estimator. This function preserves sharp boundaries and improves automatic stopping of diffusion in the gradient direction. s2 is the stopping level measured from the imaging system with respect to fully structured region and can be manually set. To avoid the energy loss in the image boundary during the diffusion process, the Neumann boundary condition is applied to the image border
I ( x , y , 0 ) = I 0 , n I = 0 , a n d I c = m e d i a n ( I )
(22)

The proposed CAD model is composed of two components: the nonlinear coherent diffusion component and the energy condensation component. The former accounts for speckle removal and the latter reduces the broadening distortion of point and linear features. According to the number of scatterers per resolution cell, the nature of speckle pattern is classified into three categories: Fully formed speckle (FFS) pattern [20], non-randomly distributed with long range order [21, 22], and non-randomly distributed with short range order [23]. The region corresponds to FFS carries less tissue information, i.e., small gradient variations and the diffusion must become isotropic along all directions, i.e., λ1λ2. This condition can be accomplished by setting the local coherence measured by μ1μ2 close to zero. On the other hand, the areas of edges and local details corresponding to structured tissue carries rich information about the imaged texture, i.e., big gradient variations. Therefore, the AD is needed in domains of edges and local details, which diffuse along the tangent direction of edges and not across the edges. In Equation (21), λ1 is related to big gradient variation through Tukey’s bi-weight robust estimator [18] and ( λ 1 λ 2 ) > s 2 is related to fully structured region and diffusion occurs only in contour direction that is along t. The stopping level s2 can be set manually.

To emphasize thin linear and point features in US image, which bear useful information for diagnosis, an energy condensation component is included in the proposed model. In Equation (16), I c is threshold value, which is set as mean of the image function I(x,y). The weight factor β is positive and it determines the amount of speckle smoothing, point and linear feature preservation. With γ < < 1, the proposed condenser performs the following operation: First, the bright regions correspond to II c gets fat during the diffusion process and increases the total energy rapidly. Second, the majorities of darker regions corresponding to I < I c , undergo NCD as I I c γ 0 . Thus, the condenser prevents the fattening of bright and linear structures without affecting the diffusion performed by the first term in Equation (16).

In the implementation of CAD model α = 1 , s = 70 , β = 0.05 , γ = 0.75 , I c = I are chosen. After the iteration, the energy of the updated I is rescaled by a factor of I 0 I 0 , where 〈〉 is mean value. Thus, the processed image has same energy as the input I0.

Discretization scheme

The CAD is numerically implemented using finite difference scheme because of its easy implementation for 2D digital image. The CAD model can be expressed as
I ( x , y , t ) t = . ( D . I ) + β γ I c γ I γ 1 ( x , t )
(23)
In discrete form the first AD term can be expressed as
I ( x , y , t ) t = a b c d I x I y D i f f u s s i v i t y M a t r i x D Grad i e n t V e c t o r
(24)
Using semi-implicit scheme, the CAD model can be expressed as
I i , j n + 1 I i , j n τ = D N ( N I i , j n ) + D S ( S I i , j n ) + D E ( E I i , j n ) + D W ( W I i , j n ) + β γ ( I c i , j n ) γ ( I i , j n ) γ 1
(25)
where
N I i , j n = I i 1 , j n I i , j n S I i , j n = I i + 1 , j n I i , j n E I i , j n = I i , j + 1 n I i , j n W I i , j n = I i , j 1 n I i , j n
(26)
The spatial distance between two neighboring pixels is one, i.e., h = 1 for image and τ is the time interval between the consecutive iterations. I i , j n refers to present pixel value at location (i,j) at time n, I i , j n + 1 is the pixel value at the same location at time n + 1. The diffusion coefficients D N , D S , D E , D W are calculated from formulae (14) to (16). I c i , j n is median of I i , j n . The γ value is chosen empirically as 0.75 (for γ < < 1 , β = 0 ) . After every iteration the energy is rescaled by a factor of I 0 I , where 〈〉 denotes the mean value. Therefore, the processed image remains in the same energy as the input I0. The time step is set to 0.25 such that 0 γ h 2 4 . As a result,
I i , j n + 1 = I i , j n + D N N I i , j n + D S S I i , j n + D E E I i , j n + D W W I i , j n 4 + β γ I c i , j n γ I i , j n γ 1
(27)

When β = 0, the image region undergoes nonlinear coherent diffusion. The β value should be chosen such that it prevents the fattening of bright structures without affecting normal non linear coherent diffusion in dominant image regions. The technique in [20] can be used to find the value of β.

As the diffusion process is iterative, the important task lies in deciding the stopping criteria. Several automatic optimal stopping time estimation criteria are available in the literature [2426]. In our simulation, we preferred the mean absolute error (MAE) between two adjacent steps [27] to stop the iterations.
M A E = 1 M N i = 1 M j = 1 N ( I i , j n I i , j n 1 )
(28)

where M, N are number of columns and rows in the processed image. By setting a threshold for MAE value, the diffusion process can be stopped. This threshold value can be adjusted by clinicians according to the purpose of speckle reduction. When the despeckling method is used as a visual aid to improve the interpretation, a small diffusion time is enough to remove the speckle. On the other hand, if the method is applied as a preprocessing step, a longer diffusion time can be adopted.

Proposed algorithm

An iteration k of the proposed algorithm consists of the following steps:
  • Step 1: For each point (x, y) belongs to 2D space of all real numbers ( x , y ) ? R 2 , calculate the gradient in x and y directions and estimate the absolute gradient magnitude ? I = I x 2 + I y 2 for local window of size w × w.

  • Step 2: Evaluate the diffusivity from Equation (20) and the principal components from Equations (21) and (11).

  • Step 3: Calculate the median of I for each coordinate.

  • Step 4: Solve the diffusion equation in (27) to update I i , j n + 1 from I i , j n and the calculated matrices at step n using the semi implicit scheme.

  • Step 5: Complete all the pixels in the image and check for stopping criteria as in (28) as a function of n. Loop until the stopping a criterion is satisfied for time step t = 0.25.

Experiments and results

The performance of the proposed method is evaluated using artificial image, simulated phantom, and real US image. In each study, the performance of the proposed CAD is compared with Perona and Malik diffusion (PM), adaptive weighted median filter (AWMF) [28], SRAD [8], nonlinear coherent diffusion (NCD) [18], median boosted anisotropic diffusion (MBAD) [29], and Laplacian pyramid-based nonlinear diffusion (LPND) [27].

The performance of our method is quantified using quality assessment metrics. The edge preservation ability is measured using figure-of-merit (FOM) [30, 31] and is based on three things: detection, localization, and spurious response.
F O M = 1 max N ^ , N ideal i = 1 N 1 1 + d i 2 λ
(29)

where N and Nideal are the numbers of detected and original edge pixels, respectively; d i is the Euclidean distance between the i th is a constant typically set to 1/9. Dynamic range of detected edge pixel and the nearest original edge pixel; λ FOM is based on all edges being found, all being placed in the correct location and no false alarms. The value is between the processed image and the ideal image. We used the canny edge detector [32] to find the edge in all processed results.

Second metric is mean square error in this metric, the smaller the MSE value, the better is the denoising process. The convergence rate of MSE value is depicted in Figure 3 for CAD algorithm with respect to number of iterations.
M S E = 1 M N i = 1 M j = 1 N ( I original ( i , j ) I denoised ( i , j ) ) 2
(30)
Figure 3

MSE value versus number of iterations.

Third, the quality of the image is measured using signal-to-noise ratio (SNR) [32]
SNR = 10. log 10 σ g 2 σ e 2
(31)

where σ g 2, σ e 2 are the variances of the noise free reference image, the error between the original and denoised image, respectively.

Fourth, the structural similarity index (SSIM) is preferred as a quality assessment factor [32] that characterizes the luminance, contrast, and structural changes,
SSIM ( x , y ) = ( 2 μ μ y x + C 1 ) ( 2 σ xy + C 2 ) ( μ x 2 + μ y 2 + C 1 ) ( σ x 2 + σ y 2 + C 2 )
(32)

where the standard deviation σ x = 1 N 1 i = 1 N ( x i μ x ) 2 1 / 2 and the mean intensity μ x = 1 N i = 1 N x i , covariance σ xy = 1 N 1 i = 1 N ( x i μ x ) ( y i μ y ) are calculated using local statistics within a total of N windows. Constants C1, C2 < < 1 to ensure stability and N is chosen as 32. The SSIM has values in the 0 to 1 range, with unity representing structurally identical images. The SSIM values are calculated only for simulated images for which the original is available for comparison.

For real US data set a contrast image measure is estimated as
C ( x , y ) = I max ( x , y ) I min ( x , y ) I max ( x , y ) + I min ( x , y )
(33)
In the above measure, I max ( x , y ) , I min ( x , y ) are the maximum and minimum values of the pixels in the 2n + 1 selected neighborhood. The performance of CAD model can be measured by
C = x , y Ω C ( x , y ) N
(34)

where Ω is image region, N is pixel no. in the region. For good diffusion model, the homogeneous region in the image exhibits less contrast after diffusion than compared to the original one.

The proposed CAD model and various state-of-the-art methods are applied on artificially simulated image with speckle noise of standard deviation 0.5, Field II software generated cyst and real US pediatric brain image. In this study, for PM and SRAD implementation, the time step Δt = 0.05 is chosen and 300 iterations are used. For LPND, 4 pyramid layers, 7 × 7 binomial filter for REDUCE and EXPAND operator, the Gaussian filter of σ = 0.1, Δt = 0.2, and MAE = 0.1 are set. For NCD Δt = 3, α = 1, s = 70, and β = 0.05 are selected for MBAD and AWMF, the filter mask of 5 × 5, median filter with σ = 2 and Δt = 0.2 are utilized. The execution time for each algorithm for 300 iterations is listed in Table 1.
Table 1

Execution time of compared algorithms

 

Number of iterations

Execution time (s)

PM

300

73.65

AWMF

62.95

SRAD

300

12.08

NCD

300

18.06

MBAD

300

26.82

LPND

300

20.68

CAD

300

10.34

The artificially simulated image carries intersected horizontal and vertical rectangular target, three small cysts of varying intensities and five point targets embedded in the background of varying gray levels. The results on artificial image are shown in Figure 4a–i. The original image of size 200 × 200 is artificially corrupted by speckle noise using MATLAB command (> > imnoise). The original and noisy images are shown in Figure 4a,b. The processed results of different schemes are shown in Figure 4c–i. In this example, our proposed CAD comparatively provides better visual enhancement, point feature preservation and also avoids blocky effects and feature broadening problem. The performance of our method is also quantified using image profile measured along 89th column of the test image as shown in Figure 5. In each case, the profiles of filtered images are compared with profile of the original image. In this study, the CAD gives satisfied improvement over other techniques in terms of speckle reduction and edge enhancement. The three performance metrics SNR, FOM, and MSE are computed for all the methods and listed in Table 2. The CAD that carries larger SNR value corresponds to good quality. The FOM value indicates that the CAD is better than other methods in terms of edge preserving ability.
Figure 4

Simulated B mode image and its filtered results. (a) Echogeneity map. (b) Speckled image. (c– i) Images filtered by PM, AWMF, SRAD, NCD, MBAD, LPND, and CAD.

Figure 5

Image profile along 89th column of simulated B mode image.

Table 2

Performance measures

Method

Simulated B mode image

Field II simulated foetus image

Real US image

 

 SNR

 MSE

 FOM

 SNR

 MSE

 FOM

 SNR

 FOM

Noisy

 15.867

 100.56

 0.0969

 25.538

 121.69

 0.0907

 23.718

 0.0976

PM

 19.486

 88.64

 0.1092

 28.937

 84.85

 0.1762

 25.645

 0.1792

AWMF

 20.097

 92.63

 0.2206

 29.427

 91.02

 0.2009

 27.097

 0.2461

SRAD

 24.468

 51.84

 0.3325

 32.618

 58.69

 0.3786

 29.678

 0.3357

NCD

 28.093

 76.92

 0.3768

 34.936

 78.09

 0.3868

 31.493

 0.3668

MBAD

 32.386

 58.89

 0.3976

 35.227

 62.56

 0.3902

 32.386

 0.4462

LPND

 36.753

 45.63

 0.4186

 38. 538

 58.63

 0.4409

 37.789

 0.4798

CAD

 41.923

 16.246

 0.5032

 44.419

 19.56

 0.5156

 44.087

 0.5332

The performance of proposed method and other approaches on Field II software generated cyst are shown in Figure 6a–h. The foetus phantom is an 8-bit image of size 352 × 353 pixels. The image profile along 151st row of foetus image for CAD and other filtered results are shown in Figure 7a–h. The performance metrics were also calculated and listed in Table 2. All the experiments prove that our CAD gives improved result in terms of feature preservation, speckle reduction, and edge enhancement. An US image of pediatric brain of size 460 × 312 is used to test the performance of the proposed technique for real-time application. The results are displayed in Figure 8a–h.
Figure 6

Simulated foetus image and its filtered results. (a) Noisy image. (b) Speckled image. (c–i) Images filtered by PM, AWMF, SRAD, NCD, MBAD, LPND, and CAD.

Figure 7

Image profile along 151st row of simulated Field II foetus image.

Figure 8

Real US pediatric image and its filtered results. (a) Noisy image. (b–h) Images filtered by PM, AWMF, SRAD, NCD, MBAD, LPND, and CAD.

This study depicts that LPND shows sharper but jagged edges and gives a relatively low contrast. AWMF does not give satisfactory speckle suppression. NCD enhances edges, but it does not keep correct edge locations. PM and SRAD dilate bright regions and erode dark regions. With the SRAD, the boundaries of bright regions are broadened and those of dark regions are shrunk. MBAD enhances the edge coherence but cannot suppress enough noise. The profile along 240th column of the real US image is shown in Figure 9. The image profile of original noisy image and filtered result of CAD are compared. The performance metrics for Field II simulated image and real US data are listed in Table 2. The experimental results show that our proposed CAD method provides better speckle reduction, edge enhancement, and feature preservation. It also avoids blocky effects and point/linear feature broadening problems.
Figure 9

Image profile along 240th column of real US image.

SSIM values for different algorithms are calculated by using the constant values as referred in [32] for simulated phantom and Field II generated image for which the original images are accessible. The values are listed in Table 3. In this comparison, the proposed CAD exhibits comparatively high SSIM value for both the cases. For US image, the original noise-free image is not available and in this case, the contrast to noise ratio is calculated for two homogeneous regions in each case as shown in Figure 10. Contrast value of the homogeneous region should decrease after diffusion depending upon the quality of diffusion. Measured values of contrast for all three images for two different regions are listed in Table 3. In this study also our proposed CAD provides lower value of CNR compared to other state of the art algorithms (Table 4).
Table 3

SSIM value for the compared algorithms

Method

SSIM value

 

Simulated B mode image

Field II simulated foetus image

Noisy

    0.3512

     0.2289

PM

    0.6584

     0.5709

AWMF

    0.6987

     0.5987

SRAD

    0.7529

     0.7297

NCD

    0.8028

     0.7832

MBAD

    0.8163

     0.8652

LPND

    0.8209

     0.8704

CAD

    0.9567

     0.9643

Figure 10

Simulated phantom, Field II generated foetus, and Real US image with two selected regions for contrast measure.

Table 4

CNR value for the compared algorithms

 

Simulated B mode image

Field II simulated foetus image

Real US image

 

Region 1

Region 2

Region 1

Region 2

Region 1

Region 2

Original (Noisy)

  0.7862

  0.7382

  0.6489

  0.6821

  0.5656

  0.5365

PM

  0.5289

  0.4987

  0.5332

  0.5903

  0.4087

  0.4008

AWMF

  0.6032

  0.5037

  0.5123

  0.5952

  0.4239

  0.4107

SRAD

  0.3185

  0.3065

  0.4165

  0.4360

  0.3543

  0.3365

NCD

  0.2568

  0.2167

  0.3085

  0.2987

  0.2987

  0.2754

MBAD

  0.2367

  0.1754

  0.2234

  0.2145

  0.1967

  0.1965

LPND

  0.0938

  0.0838

  0.1045

  0.1467

  0.1245

  0.1376

CAD

  0.0023

  0.0021

  0.0043

  0.0035

  0.0024

  0.0032

The performance of PM, AWMF, SRAD, NCD, MBAD, LPND, and CAD methods are compared in terms of SNR, SSIM, and FOM. Comparative results are shown in Figure 11 that clearly indicates that our proposed model gives superior result over the above-mentioned state-of-the-art methods. In terms of SNR criterion, our proposed CAD model gives about 23, 22, 17, 14, 9, and 5 dB improvement over PM, AWMF, SRAD, NCD, MBAD, LPND, respectively, for artificially simulated image with speckle of σ = 0.5, about 15, 12, 9, and 5 dB improvement over PM, AWMF, SRAD, NCD, MBAD, LPND, respectively, for Field II simulated image, about 15, 12, 9, and 6 dB improvement over PM, AWMF, SRAD, NCD, MBAD, and LPND, respectively, for real US image. Our proposed model gives 360, 128, 51, 33.5, 26.5, and 20% improvement for artificially simulated image, 192, 156, 36, 33, 32, and 17% improvement for Field II simulated image, 197, 117, 59, 45, 19.5, and 11% improvement for real US image over PM, AWMF, SRAD, NCD, MBAD, and LPND, respectively.
Figure 11

Performance comparisons of various methods in terms of (a) SNR (b) FOM.

Conclusions

In this article, we propose a new diffusion model called CAD that reduces speckle, preserves information carrying features and also avoids blocking effects, point, and linear feature broadening problems. The new CAD model carries two terms: one is coherent diffusion term for speckle reduction and for structured region, organ surface preservation. The second term is a regulator term that condenses the diffusion and emphasizes thin linear and point features. In this scheme, the diffusion matrix is designed using local coordinate transformation and the feature broadening correction term is derived from energy function. The median filter is used as a smoothing operator. In CAD, the structured tissues which carry rich of information undergo AD and the speckle pattern undergo isotropic diffusion; this flow can be controlled by setting the local coherence value close to zero. The energy condensation component is included to emphasize the information carrying point/linear features, which controls the feature fattening, effectively for bright regions. In the implementation, we have used. The MAE value is set to 0.1 for artificial and simulated data and 0.2 for real US image. The simulation takes ≈ 300 iterations to converge to a stationary solution. Thus, the proposed method can be implemented practically to enhance the visual interpretation ability of radiologist with minimum cost and this method can also be used as a pre processing tool for many image processing task such as segmentation, feature extraction, etc.

Declarations

Acknowledgement

The author would like to thank Dr. Senthilvelmurugan, Radiologist from Kauvery Medical Centre Hospital, Trichirappalli, Tamilnadu and Dr. G. Jayakumar from Sarani clinic, Pudansandhai, Tamilnadu for their support and thoughtful comments.

Authors’ Affiliations

(1)
Department of Electronics and Communication Engineering, TRP Engineering College (SRM Group)
(2)
Department of Electronics and Communication Engineering, Government College of Engineering

References

  1. Touzi R: A review of speckle filtering in the context of estimation theory. IEEE Trans. Geosci. Remote Sens. 2002, 40(11):2392-2404. 10.1109/TGRS.2002.803727View ArticleGoogle Scholar
  2. Lee J: Digital image enhancement and noise filtering using local statistics. IEEE Trans. Pattern Anal. Mach. Intell. 1980, PAMI-2(2):165-168.View ArticleGoogle Scholar
  3. Frost V, Stiles J, Shanmugan K, Holzman J: A model for radar images and its application to adaptive digital filtering of multiplicative noise. IEEE Trans. Pattern Anal. Mach. Intell. 1982, PAMI-4(2):157-166.View ArticleGoogle Scholar
  4. Kuan DT, Sawchuk AA, Strand TC, Chavel P: Adaptive noise smoothing filter for images with signal-dependent noise. IEEE Trans. Pattern Anal. Mach. Intell. 1985, PAMI-7(2):165-177.View ArticleGoogle Scholar
  5. Kuan DT, Sawchuk AA, Strand TC, Chavel P: Adaptive restoration of images with speckle. IEEE Trans Acoust. Speech Signal Process. 1987, ASSP-35(3):373-383.View ArticleGoogle Scholar
  6. Perona P, Malik J: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 1990, 12(7):629-639. 10.1109/34.56205View ArticleGoogle Scholar
  7. Monteil J, Beghdadi A: A new interpretation and improvement of the nonlinear anisotropic diffusion for image enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21(9):940-946. 10.1109/34.790435View ArticleGoogle Scholar
  8. Yu Y, Acton T: Speckle reducing anisotropic diffusion. IEEE Trans. Image Process. 2002, 11(11):1260-1270. 10.1109/TIP.2002.804276MathSciNetView ArticleGoogle Scholar
  9. Acton ST: Deconvolutional speckle reducing anisotropic diffusion. IEEE International Conference on Image Processing, ICIP 2005, 1: 5-8.Google Scholar
  10. Burgeth B, Didas S, Florack L, Weickert J: A generic approach to diffusion filtering of matrix-fields. Computing 2007, 81: 179-197. 10.1007/s00607-007-0248-9MATHMathSciNetView ArticleGoogle Scholar
  11. You Y-L, Kaveh M: Fourth-order partial differential equations for noise removal. IEEE Trans. Image Process. 2009, 9(10):1723-1730.MathSciNetView ArticleGoogle Scholar
  12. Banham MR, Katsaggelos AG: Digital image restoration. IEEE Signal Process 1997, 14: 24-41. MagView ArticleGoogle Scholar
  13. Vogel CR, Oman ME: Fast, robust total variation-based reconstruction of noisy, blurred images. IEEE Trans. Image Process 1998, 7: 813-824. 10.1109/83.679423MATHMathSciNetView ArticleGoogle Scholar
  14. Charbonnier P, Blanc-Féraud L, Aubert G, Barlaud M: Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Process 1997, 6: 298-310. 10.1109/83.551699View ArticleGoogle Scholar
  15. Coupe P, Hellier P, Kervrann C, Barillot C: Nonlocal means-based speckle filtering for ultrasound images. IEEE Trans. Image Process. 2009, 18(10):2221-2229.MathSciNetView ArticleGoogle Scholar
  16. Delaney AH, Bresler Y: Globally convergent edge-preserving regularized reconstruction: an application to limited-angle tomography. IEEE Trans. Image Process. 1998, 7: 204-221. 10.1109/83.660997View ArticleGoogle Scholar
  17. Weickert J: Anisotropic Diffusion in Image Processing. Teubner-Verlag, Stuttgart; 1998.MATHGoogle Scholar
  18. Abd-Elmoniem KZ, Youssef AM, Kadah YM: Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion. IEEE Trans. Biomed. Eng. 2002, 49(9):997-1014. 10.1109/TBME.2002.1028423View ArticleGoogle Scholar
  19. Feddern C, Weickert J, Burgeth B, Welk M: Curvature driven PDE methods for matrix valued images. Int. J. Comput. Vis. 2006, 69(1):91-103.View ArticleGoogle Scholar
  20. Wagner RF, Smith SW, Sandrik JM: Statistics of speckle in ultrasound B-scans. IEEE Trans. Sonics Ultrason. 1983, 30(3):156-163.View ArticleGoogle Scholar
  21. Karmeshu , Agrawal R: Study of ultrasonic echo envelope based on Nakagami-inverse Gaussian distribution. Ultrasound Med. Biol. 2003, 32: 371-376.View ArticleGoogle Scholar
  22. Shankar PM: Ultrasonic tissue characterization using a generalized Nakagami model. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2001, 48(4):1716-1720.View ArticleGoogle Scholar
  23. Eltoft T: Modeling the amplitude statistics of ultrasonic images. IEEE Trans. Med. Imag. 2006, 25(2):229-240.View ArticleGoogle Scholar
  24. Gennert MA, Yuille AL: Determining the optimal weights in multiple objective function optimization. International Conference on Computer Vision 1988, 87-89.Google Scholar
  25. Weickert J: Coherence-enhancing diffusion of colour images. Image Vis. Comput. 1999, 17(3):201-212. 10.1016/S0262-8856(98)00102-4View ArticleGoogle Scholar
  26. Mrázek P, Navara M: Selection of optimal stopping time for nonlinear diffusion filtering. Int. J. Comput. Vis. 2003, 52: 189-203. 10.1023/A:1022908225256View ArticleGoogle Scholar
  27. Zhang F, Koh LM, Yoo YM, Kim Y: Nonlinear diffusion in Laplacian pyramid domain for ultrasonic speckle reduction. IEEE Trans. Med. Imag. 2007, 26(2):200-211.View ArticleGoogle Scholar
  28. Loupas T, McDicken WN, Allan PL: An adaptive weighted median filter for speckle suppression in medical ultrasound images. IEEE Trans. Circ. Syst. 1989, 36(1):129-135. 10.1109/31.16577View ArticleGoogle Scholar
  29. Yang Z, Fox MD: Speckle reduction and structure enhancement by multichannel median boosted anisotropic diffusion. EURASIP J. Appl. Signal Process. 2004, 16: 2492-2502.View ArticleGoogle Scholar
  30. Michailovich OV, Tannenbaum A: Despeckling of medical ultrasound images. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2006, 53(1):64-78.View ArticleGoogle Scholar
  31. Pratt WK: Digital Image Processing. Wiley, New York; 1978.Google Scholar
  32. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13(4):600-612. 10.1109/TIP.2003.819861View ArticleGoogle Scholar

Copyright

© Shanmugam and RSD; licensee Springer. 2012

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.