Condensed anisotropic diffusion for speckle reducton and enhancement in ultrasonography
© Shanmugam and RSD; licensee Springer. 2012
Received: 20 July 2011
Accepted: 18 June 2012
Published: 18 July 2012
This article proposes a technique for speckle reduction in medical ultrasound (US) imaging which preserves the point and linear features with the added advantage of energy condensation regulator. Whatever be the post processing task on US image, the image should undergo a preprocessing step called despeckling. Nowadays, though the US machines are available with built-in speckle reduction facility, they are suffered by many practical limitations such as limited dynamic range of the display, limited number of unique directions that an US beam scan follow to average an image and limited size of transducer, etc. The proposed diffusion model can be used as a visual enhancement tool for interpretation as well as a preprocessing task for further diagnosis. This method incorporates two terms: diffusion and regulator. The anisotropic diffusion preserves and enhances edges and local details. The regularization enables the correction of feature broadening distortion which is the common problem in second-order diffusion-based methods. In this scheme, the diffusion matrix is designed using local coordinate transformation and the feature broadening correction term is derived from energy function. Performance of the proposed method has been illustrated using synthetic and real US data. Experiments indicate better speckle reduction and effective preservation of edges and local details.
KeywordsSpeckle Filtering Anisotropic diffusion Regulator Edge enhancement
For more than two decades, ultrasonography has been considered as one of the most powerful techniques for imaging organs and soft tissue structures in the human body. Today, it is being used at an ever-increasing rate in the field of medical diagnostic technology. Ultrasonography is often preferred over other medical imaging modalities because it is non-invasive, portable, versatile, does not use ionizing radiations, and also relatively of low-cost. The images produced by commercial ultrasound (US) systems are usually optimized for visual interpretation because of its real-time usage. However, the usefulness of medical ultrasonography is degraded by signal-dependent noise called ‘speckle’ which is multiplicative in nature.
Many filters have been developed to cope up with speckle, with differences lying in the assumptions about the speckle model . The methods described by Lee , Frost et al. , and Kuan et al. [4, 5] are based on multiplicative model and simple logarithmic operation converts the speckle into additive noise. Filtering based on anisotropic diffusion (AD) was introduced by Perona and Malik  who had constituted a powerful tool for signal and image enhancement. When AD is introduced for first time an undesirable effect called “pin hole effect” may result and this is addressed by Monteil and Beghdadi  through optical flow technique. Later, Yu and Acton  have proposed a novel filtering scheme based on the filters first described by Lee and Frost. The authors find a relation between the former and the AD equation and give rise to a speckle removal filter, which they call speckle reducing anisotropic diffusion (SRAD). This filter has shown very good performance with different levels of speckle. However, SRAD tends to broaden thin linear features and point features. These features carry useful information for diagnosis and the problem need to be corrected.
To overcome the feature broadening problem, a method has been proposed by Acton . This method combines the strength of SRAD and deconvolution restoration. This technique assumed that feature distortion is caused by the convolution of the point spread function of the imaging system with the underlying feature. Hence, deconvolution sharpens features, while SRAD removes the speckle. This method showed promising results on synthesized US data, although no results were reported for real data. A generic framework to find the matrix-valued counterparts of the Perona–Malik PDE with various diffusivity functions is proposed by Burgeth et al. .
Fourth-order partial differential equation (PDE)-based despeckling method has been proposed in . This can reduces the speckle and also able to keep the image edge better, but this method requires more number of iterations to converge.
Regularization methods have been used in real-valued image restoration [12, 13], as well as image reconstruction problems such as medical tomography [14, 15] to obtain improved image estimates in the face of data degradation. The simplest and the most common approach is to use quadratic functions of the unknown quantities. These methods lead to computationally straightforward optimization problems, but they suppress useful features in the resulting imagery, such as edges. Recently, considerable effort has been spent in designing alternative, non-quadratic constraints which preserve such features. Methods based on these non-quadratic constraints have successfully been used in edge-preserving regularization in image restoration  and computer-assisted tomography [13–16].
In this article, a new method has been proposed to reduce speckle in US images by incorporating a non-quadratic regularization into nonlinear coherent diffusion to preserve and enhance edges, local details, and to correct the feature broadening distortion. The proposed model carries two terms: the first is coherent diffusion term that reduces the speckle by nonlinear coherent diffusion, which utilizes the diffusion tensor derived from coordinate transformation. The second term is called regulator, which enhance the performance of coherent diffusion as well as it enables the correction of feature broadening distortion. Therefore, our model performs simultaneous speckle reduction, structure enhancement, and feature broadening correction with minimum computational cost.
Background of diffusion
The basic idea in the use of PDEs in image processing is to deform an image, a curve, or a surface in a PDE framework and to approach the expected result as a solution to this equation.
Let I:Ω → ℜ be a scalar-valued image (gray level image) with Ω ⊂ ℜ p . Gradient of the image characterizes the difference in gray value. In Biomedical imaging, besides noise also edges result in a large gradient at fine scales. The direct approach to reduce variations in the image I would be to reduce the gradient of the image globally.
where ∂Ω is boundary of Ω and n is normal vector of boundary. Euler–Lagrange equation makes the link between PDEs evolution and gradient descent for continual minimization.
This equation appears in many physical transport processes. In the context of heat transfer, it is called heat equation. In image processing, we may identify the concentration with the grey value at a certain location. If the diffusion tensor is constant over the whole image domain, one speaks of homogeneous diffusion whereas a space-dependent filtering is called inhomogeneous. Often the diffusion tensor is a function of the differential structure of the evolving image itself. Such a feedback leads to nonlinear diffusion filters. Diffusion which does not depend on the evolving image is called linear. Sometimes the computer vision literature deviates from the preceding notations, i.e., the homogeneous filtering is named isotropic and inhomogeneous blurring is called anisotropic, even if it uses a scalar-valued diffusivity instead of a diffusion tensor.
With initial condition: is an image in the continuous domain, where (x, y) specifies the spatial position; t is an artificial time parameter; с is the diffusion constant, and ∇I is the image gradient. The с value is suggested to provide backward diffusion around intensity transitions and forward diffusion in smooth areas in favor of edge sharpening and noise removal. Edges and local details are the most interesting parts in diagnostic imaging for clinicians. Therefore, enhancement and preservation of edges and local details on denoising are very important. In Equation (9), с is a scalar function and ∇I serves only as an edge detector rather than providing smoothing.
Nonlinear coherent diffusion
where the eigen vectors ω1 and ω2 represent the directions of maximum and minimum variations and the eigen values μ1 and μ2 correspond to the strength of these variations, respectively. However, the diffusion tensor used in the nonlinear coherent diffusion model was actually depending on local statistics which are isotropic in nature, and also on the tensor provided by Gaussian smoothed image which may not effectively suppress the spatially correlated speckle noise.
Condensed anisotropic diffusion
For many years, image regularization with discontinuities (edges) preservation has been studied in the computer vision community. Image regularization with PDE is again based on a measure of local parameter variations. In Equation (14), the first term is regularization term α coupled with data attachment or fidelity term (Ii 0 − I i ).
is the n × n orthogonal matrix of the unit eigen vector columns u k , forming an orthonormal vector basis. is the corresponding diagonal matrix of the positive eigen vectors. The spectral decomposition separates the orientation features and diffusivity features A of tensor D.
In the constant regions, , which gives D ≈ αI d where, I d is identity matrix. Thus, in the constant (homogeneous) region, there is no preferred diffusion direction and the diffusion tensor is isotropic. For image contours, , diffusion tensor is anisotropic and mainly directed by the tangent vector of the image.
The proposed CAD model is composed of two components: the nonlinear coherent diffusion component and the energy condensation component. The former accounts for speckle removal and the latter reduces the broadening distortion of point and linear features. According to the number of scatterers per resolution cell, the nature of speckle pattern is classified into three categories: Fully formed speckle (FFS) pattern , non-randomly distributed with long range order [21, 22], and non-randomly distributed with short range order . The region corresponds to FFS carries less tissue information, i.e., small gradient variations and the diffusion must become isotropic along all directions, i.e., λ1 ≈ λ2. This condition can be accomplished by setting the local coherence measured by μ1 − μ2 close to zero. On the other hand, the areas of edges and local details corresponding to structured tissue carries rich information about the imaged texture, i.e., big gradient variations. Therefore, the AD is needed in domains of edges and local details, which diffuse along the tangent direction of edges and not across the edges. In Equation (21), λ1 is related to big gradient variation through Tukey’s bi-weight robust estimator  and is related to fully structured region and diffusion occurs only in contour direction that is along t. The stopping level s2 can be set manually.
To emphasize thin linear and point features in US image, which bear useful information for diagnosis, an energy condensation component is included in the proposed model. In Equation (16), I c is threshold value, which is set as mean of the image function I(x,y). The weight factor β is positive and it determines the amount of speckle smoothing, point and linear feature preservation. With γ < < 1, the proposed condenser performs the following operation: First, the bright regions correspond to I ≥ I c gets fat during the diffusion process and increases the total energy rapidly. Second, the majorities of darker regions corresponding to I < I c , undergo NCD as . Thus, the condenser prevents the fattening of bright and linear structures without affecting the diffusion performed by the first term in Equation (16).
In the implementation of CAD model are chosen. After the iteration, the energy of the updated I is rescaled by a factor of , where 〈〉 is mean value. Thus, the processed image has same energy as the input I0.
When β = 0, the image region undergoes nonlinear coherent diffusion. The β value should be chosen such that it prevents the fattening of bright structures without affecting normal non linear coherent diffusion in dominant image regions. The technique in  can be used to find the value of β.
where M, N are number of columns and rows in the processed image. By setting a threshold for MAE value, the diffusion process can be stopped. This threshold value can be adjusted by clinicians according to the purpose of speckle reduction. When the despeckling method is used as a visual aid to improve the interpretation, a small diffusion time is enough to remove the speckle. On the other hand, if the method is applied as a preprocessing step, a longer diffusion time can be adopted.
Step 1: For each point (x, y) belongs to 2D space of all real numbers , calculate the gradient in x and y directions and estimate the absolute gradient magnitude for local window of size w × w.
Step 3: Calculate the median of I for each coordinate.
Step 4: Solve the diffusion equation in (27) to update from and the calculated matrices at step n using the semi implicit scheme.
Step 5: Complete all the pixels in the image and check for stopping criteria as in (28) as a function of n. Loop until the stopping a criterion is satisfied for time step t = 0.25.
Experiments and results
The performance of the proposed method is evaluated using artificial image, simulated phantom, and real US image. In each study, the performance of the proposed CAD is compared with Perona and Malik diffusion (PM), adaptive weighted median filter (AWMF) , SRAD , nonlinear coherent diffusion (NCD) , median boosted anisotropic diffusion (MBAD) , and Laplacian pyramid-based nonlinear diffusion (LPND) .
where N and Nideal are the numbers of detected and original edge pixels, respectively; d i is the Euclidean distance between the i th is a constant typically set to 1/9. Dynamic range of detected edge pixel and the nearest original edge pixel; λ FOM is based on all edges being found, all being placed in the correct location and no false alarms. The value is between the processed image and the ideal image. We used the canny edge detector  to find the edge in all processed results.
where σ g 2, σ e 2 are the variances of the noise free reference image, the error between the original and denoised image, respectively.
where the standard deviation and the mean intensity, covariance are calculated using local statistics within a total of N windows. Constants C1, C2 < < 1 to ensure stability and N is chosen as 32. The SSIM has values in the 0 to 1 range, with unity representing structurally identical images. The SSIM values are calculated only for simulated images for which the original is available for comparison.
where Ω is image region, N is pixel no. in the region. For good diffusion model, the homogeneous region in the image exhibits less contrast after diffusion than compared to the original one.
Execution time of compared algorithms
Number of iterations
Execution time (s)
Simulated B mode image
Field II simulated foetus image
Real US image
SSIM value for the compared algorithms
Simulated B mode image
Field II simulated foetus image
CNR value for the compared algorithms
Simulated B mode image
Field II simulated foetus image
Real US image
In this article, we propose a new diffusion model called CAD that reduces speckle, preserves information carrying features and also avoids blocking effects, point, and linear feature broadening problems. The new CAD model carries two terms: one is coherent diffusion term for speckle reduction and for structured region, organ surface preservation. The second term is a regulator term that condenses the diffusion and emphasizes thin linear and point features. In this scheme, the diffusion matrix is designed using local coordinate transformation and the feature broadening correction term is derived from energy function. The median filter is used as a smoothing operator. In CAD, the structured tissues which carry rich of information undergo AD and the speckle pattern undergo isotropic diffusion; this flow can be controlled by setting the local coherence value close to zero. The energy condensation component is included to emphasize the information carrying point/linear features, which controls the feature fattening, effectively for bright regions. In the implementation, we have used. The MAE value is set to 0.1 for artificial and simulated data and 0.2 for real US image. The simulation takes ≈ 300 iterations to converge to a stationary solution. Thus, the proposed method can be implemented practically to enhance the visual interpretation ability of radiologist with minimum cost and this method can also be used as a pre processing tool for many image processing task such as segmentation, feature extraction, etc.
The author would like to thank Dr. Senthilvelmurugan, Radiologist from Kauvery Medical Centre Hospital, Trichirappalli, Tamilnadu and Dr. G. Jayakumar from Sarani clinic, Pudansandhai, Tamilnadu for their support and thoughtful comments.
- Touzi R: A review of speckle filtering in the context of estimation theory. IEEE Trans. Geosci. Remote Sens. 2002, 40(11):2392-2404. 10.1109/TGRS.2002.803727View ArticleGoogle Scholar
- Lee J: Digital image enhancement and noise filtering using local statistics. IEEE Trans. Pattern Anal. Mach. Intell. 1980, PAMI-2(2):165-168.View ArticleGoogle Scholar
- Frost V, Stiles J, Shanmugan K, Holzman J: A model for radar images and its application to adaptive digital filtering of multiplicative noise. IEEE Trans. Pattern Anal. Mach. Intell. 1982, PAMI-4(2):157-166.View ArticleGoogle Scholar
- Kuan DT, Sawchuk AA, Strand TC, Chavel P: Adaptive noise smoothing filter for images with signal-dependent noise. IEEE Trans. Pattern Anal. Mach. Intell. 1985, PAMI-7(2):165-177.View ArticleGoogle Scholar
- Kuan DT, Sawchuk AA, Strand TC, Chavel P: Adaptive restoration of images with speckle. IEEE Trans Acoust. Speech Signal Process. 1987, ASSP-35(3):373-383.View ArticleGoogle Scholar
- Perona P, Malik J: Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 1990, 12(7):629-639. 10.1109/34.56205View ArticleGoogle Scholar
- Monteil J, Beghdadi A: A new interpretation and improvement of the nonlinear anisotropic diffusion for image enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21(9):940-946. 10.1109/34.790435View ArticleGoogle Scholar
- Yu Y, Acton T: Speckle reducing anisotropic diffusion. IEEE Trans. Image Process. 2002, 11(11):1260-1270. 10.1109/TIP.2002.804276MathSciNetView ArticleGoogle Scholar
- Acton ST: Deconvolutional speckle reducing anisotropic diffusion. IEEE International Conference on Image Processing, ICIP 2005, 1: 5-8.Google Scholar
- Burgeth B, Didas S, Florack L, Weickert J: A generic approach to diffusion filtering of matrix-fields. Computing 2007, 81: 179-197. 10.1007/s00607-007-0248-9MATHMathSciNetView ArticleGoogle Scholar
- You Y-L, Kaveh M: Fourth-order partial differential equations for noise removal. IEEE Trans. Image Process. 2009, 9(10):1723-1730.MathSciNetView ArticleGoogle Scholar
- Banham MR, Katsaggelos AG: Digital image restoration. IEEE Signal Process 1997, 14: 24-41. MagView ArticleGoogle Scholar
- Vogel CR, Oman ME: Fast, robust total variation-based reconstruction of noisy, blurred images. IEEE Trans. Image Process 1998, 7: 813-824. 10.1109/83.679423MATHMathSciNetView ArticleGoogle Scholar
- Charbonnier P, Blanc-Féraud L, Aubert G, Barlaud M: Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Process 1997, 6: 298-310. 10.1109/83.551699View ArticleGoogle Scholar
- Coupe P, Hellier P, Kervrann C, Barillot C: Nonlocal means-based speckle filtering for ultrasound images. IEEE Trans. Image Process. 2009, 18(10):2221-2229.MathSciNetView ArticleGoogle Scholar
- Delaney AH, Bresler Y: Globally convergent edge-preserving regularized reconstruction: an application to limited-angle tomography. IEEE Trans. Image Process. 1998, 7: 204-221. 10.1109/83.660997View ArticleGoogle Scholar
- Weickert J: Anisotropic Diffusion in Image Processing. Teubner-Verlag, Stuttgart; 1998.MATHGoogle Scholar
- Abd-Elmoniem KZ, Youssef AM, Kadah YM: Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion. IEEE Trans. Biomed. Eng. 2002, 49(9):997-1014. 10.1109/TBME.2002.1028423View ArticleGoogle Scholar
- Feddern C, Weickert J, Burgeth B, Welk M: Curvature driven PDE methods for matrix valued images. Int. J. Comput. Vis. 2006, 69(1):91-103.View ArticleGoogle Scholar
- Wagner RF, Smith SW, Sandrik JM: Statistics of speckle in ultrasound B-scans. IEEE Trans. Sonics Ultrason. 1983, 30(3):156-163.View ArticleGoogle Scholar
- Karmeshu , Agrawal R: Study of ultrasonic echo envelope based on Nakagami-inverse Gaussian distribution. Ultrasound Med. Biol. 2003, 32: 371-376.View ArticleGoogle Scholar
- Shankar PM: Ultrasonic tissue characterization using a generalized Nakagami model. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2001, 48(4):1716-1720.View ArticleGoogle Scholar
- Eltoft T: Modeling the amplitude statistics of ultrasonic images. IEEE Trans. Med. Imag. 2006, 25(2):229-240.View ArticleGoogle Scholar
- Gennert MA, Yuille AL: Determining the optimal weights in multiple objective function optimization. International Conference on Computer Vision 1988, 87-89.Google Scholar
- Weickert J: Coherence-enhancing diffusion of colour images. Image Vis. Comput. 1999, 17(3):201-212. 10.1016/S0262-8856(98)00102-4View ArticleGoogle Scholar
- Mrázek P, Navara M: Selection of optimal stopping time for nonlinear diffusion filtering. Int. J. Comput. Vis. 2003, 52: 189-203. 10.1023/A:1022908225256View ArticleGoogle Scholar
- Zhang F, Koh LM, Yoo YM, Kim Y: Nonlinear diffusion in Laplacian pyramid domain for ultrasonic speckle reduction. IEEE Trans. Med. Imag. 2007, 26(2):200-211.View ArticleGoogle Scholar
- Loupas T, McDicken WN, Allan PL: An adaptive weighted median filter for speckle suppression in medical ultrasound images. IEEE Trans. Circ. Syst. 1989, 36(1):129-135. 10.1109/31.16577View ArticleGoogle Scholar
- Yang Z, Fox MD: Speckle reduction and structure enhancement by multichannel median boosted anisotropic diffusion. EURASIP J. Appl. Signal Process. 2004, 16: 2492-2502.View ArticleGoogle Scholar
- Michailovich OV, Tannenbaum A: Despeckling of medical ultrasound images. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 2006, 53(1):64-78.View ArticleGoogle Scholar
- Pratt WK: Digital Image Processing. Wiley, New York; 1978.Google Scholar
- Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13(4):600-612. 10.1109/TIP.2003.819861View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.