- Open Access
Structure-based level set method for automatic retinal vasculature segmentation
EURASIP Journal on Image and Video Processing volume 2014, Article number: 39 (2014)
Segmentation of vasculature in retinal fundus image by level set methods employing classical edge detection methodologies is a tedious task. In this study, a revised level set-based retinal vasculature segmentation approach is proposed. During preprocessing, intensity inhomogeneity on the green channel of input image is corrected by utilizing all image channels, generating more efficient results compared to methods utilizing only one (green) channel. A structure-based level set method employing a modified phase map is introduced to obtain accurate skeletonization and segmentation of the retinal vasculature. The seed points around vessels are selected and the level sets are initialized automatically. Furthermore, the proposed method introduces an improved zero-level contour regularization term which is more appropriate than the ones introduced by other methods for vasculature structures. We conducted the experiments on our own dataset, as well as two publicly available datasets. The results show that the proposed method segments retinal vessels accurately and its performance is comparable to state-of-the-art supervised/unsupervised segmentation techniques.
Published ophthalmology studies reveal that there are often significant differences in clinical diagnosis of retinal diseases among medical experts. Some of these approaches involve tedious processes. Manual segmentation has become more and more time consuming with the increasing amount of patient data. An automatic retinal vasculature segmentation method may become an integral part of a computer-based image analysis and diagnosis systems with improved accuracy and consistency.
Considering the conducted research, literature is full of examples[3–10] on vasculature segmentation, detection, and other kinds of analysis employing especially supervised/unsupervised classification of pixels in retinal fundus images[11–19]. Marin et al. and Soares et al. presented two different supervised methods for segmentation of retinal vasculature by using moment invariant-based features and 2-D Gabor filters, respectively. Staal et al. proposed a retinal vasculature segmentation method using centerlines of a vessel base that are extracted by using image ridges. Budai et al. presented an improved approach using Frangi’s method. Other studies have employed centerline tracing methods and principal curves[19, 20]. The reader may refer to for more related studies in the literature.
Level set-based methods have been widely used for image segmentation[22–34]. In general, these methods can be classified under two categories: (i) edge-based[22–30] and (ii) region-based[31–34] methods. However, level set-based methods have not been extensively employed in retinal vasculature segmentation. To the best of our knowledge, there have been only a few studies in the literature proposing methods based on level sets to trace vasculature in retinal fundus images. This is due to challenges of vessel shapes in level set-based image segmentation methods. Major challenges posed by the very thin and elongated structure of retinal vessels are further compounded by poor contrast in regions of interest for level set-based segmentation methods. In one of those studies, the level set-based method is applied only on a selected region of images by implementing a non-automatic initialization of zero-level contours. These regions do not have any non-uniform intensity values. The method in also employs edge information based on phase map and uses a re-initialization process to regularize the level set function, which is a problem in level set-based framework. Moreover, this process requires complex discretization especially for re-initialization of the level set function. In addition, the method employs fixed filter coefficients to generate image features such as edges by using the log-Gabor filter, which does not generate a proper output to trace extremely thin retinal vessels in fundus images smoothly. The level set segmentation method proposed by Pang et al. requires the selection of initial contour in the form of long strips in the vertical direction, and this is not an optimal selection. This selection leads to an increase in the number of iterations to generate the results. According to the accuracy metric, the method produces poor results quantitatively on a non-pathological fundus image. Although they claim to present a fully automated method, the system requires mask images from the user. There are other level set approaches[27–29, 31–34] that focus on segmenting other vasculature structures in different image modalities such as ultrasound images and magnetic resonance images (MRIs). However, these region-based methods[32, 33] cannot be used extensively in segmentation of retinal fundus images due to the form of vascular structures. Another method presented for retinal vessel segmentation employs region-based level sets and region growing approaches, simultaneously.
In this paper, we present an improved and automatic level set-based method for retinal vasculature segmentation. The presented method utilizes a robust phase map to determine image structures and seed points around the vessels in the initialization of the level set function. The performed tests on pathological and non-pathological fundus images demonstrate that the proposed method performs better than the existing approaches based on level sets.
The organization of the paper is structured as follows. 'Section 2’ introduces the general information about retinal fundus images and level set-based methods developed for segmentation. 'Section 3’ explains the proposed method and compares it with the existing approaches in the literature. Experimental results are given in 'Section 4.’ Finally, 'Section 5’ presents a conclusion and possible future work in the field.
Let I: Ω → ℝ3 be a color image defined on domain Ω → ℝ2, and let I i : Ω → ℝ represent the i th color channel of the image I. Let p = (x, y) ∈ Ω, denote any point in Ω. Digital images have two additive components: structure part and texture part. These can be visualized as the cartoon version with sharp edges and noisy/textured version of the original image, respectively[35–37].
2.1 Characteristics of retinal fundus images
Retinal fundus images can be generated in color or grayscale format in digital media. The pixels of a retinal fundus image are represented as color values in RGB color space as seen in Figure 1a,b. In terms of representation of retinal vessels, these images have mostly structure information but also a texture part (noise, defects, etc.). The retinal fundus images can be split into two categories, namely the pathological retinal fundus images and the non-pathological ones. The aim of segmentation methods for retinal fundus images is to separate vasculatures from other regions as can be seen in Figure 1c,d. However, due to the structure of the optic disk and macula, segmentation of blood vessels of retinal images is difficult. These regions have a more prominent intensity inhomogeneity compared to other parts of retinal images. Furthermore, pathological images may contain defects and disorders such as drusen, geographic atrophy (GA), and non-uniform intensities. Such disorders also make the process of segmentation complicated.
As shown in Figure 2, each color channel in RGB color space can be separated and treated as an independent grayscale image. Considering those channels, the green channel component of the retinal image gives the best structure information to be processed[15, 19] even though some regions such as the optic disk and macula in this channel component have non-uniform intensity levels. Let us use I instead of I2 to represent the green channel component of the given image. In this case, the model would be as in I = bJ + noise (defects), where bJ and noise are considered as the structure component and the texture component, respectively. The green channel of the given image has some noises but no defects such as drusen, GA, etc.; the noise can be reduced using a convolution with a Gaussian filter G σ of standard deviation σ. In the above equation, J is the true image, which consists of almost all constant values in an image region such as the optic disk, and b is referred to as the intensity inhomogeneity (shading artifact), which changes slowly throughout that image region.
2.2 Edge-based level set segmentation approach
In this section, we give brief information about segmentation of object and background using edge-based level set methods. Let C be a closed subset of Ω, that is, the union of a finite set of smooth Jordan curves C i . Let Ω i be the connected regions of Ω\C bounded by C i . C can be expressed as the zero-level contour of some scalar Lipschitz continuous function Φ: Ω → ℝ. The level set evolution equation of the curve C with the speed function F is as given in Equation 1:
Iterations of level set evolution are adversely affected by numerical errors and other factors that cause irregularities. Therefore, a frequent re-initialization process, formulated as ∂Φ/∂t = sign(Φ0) (1 - ||∇Φ||), could be included to restore the regularity of the level set function, establishing a stable level set evolution. Here, Φ0 is the level set function to be re-initialized and sign(.) stands for signum function. Re-initialization is performed by interrupting the evolution periodically and correcting irregularities of the level set function using a signed distance function. Even with a re-initialization process, in most of the level set methods such as the geodesic active counters (GAC) model, irregularities can still emerge. Therefore, Li et al. introduced a new energy term called level set function regularization.
Image segmentation based on level set methods typically consists of two additively combined energy terms, which are the length regularization term and the speed term related to the weighted area. The model is defined as E(Φ) = μR(Φ) + ϑL(Φ) + αA(Φ), where R(.), L(.), and A(.) are the level set function regularization term, the zero-level contour regularization term, and the term adjusting the speed of motion to zero-level contour, respectively. Here, μ, ϑ, and α are weighting parameters.The level set function can be initialized in three different ways. In order to demonstrate the effect to the segmentation results, instead of a retinal fundus image, we employ a synthetic image that comprises artificially similar vessels and defects (Figure 3).
Edge-based level set methods have some drawbacks. Sometimes, a global minimum cannot be found and the methods tend to be slower than other segmentation methods. The global minimum can be correctly obtained if the initial contour is set properly. Level set-based methods also run faster when a narrow band approach is employed in the segmentation process.
3 The proposed method
Our method can be considered in three main steps as outlined in Figure 4:
Modified phase map estimation
Structure-based level set segmentation
More details about these steps are given in the following subsections of 3.1, 3.2, and 3.3.
3.1 Preprocessing for correction of non-uniform intensity
A preprocessing step is employed for the correction of intensity inhomogeneity of retinal fundus images. Firstly, we apply a trace-based method to reduce noise and then a shock filter is applied to sharpen the image. Both filters work based on color information and give more robust results compared to the scalar approaches presented in[19, 38]. Secondly, the green channel of the filtered image is extracted. Thirdly, two different images are generated by applying adaptive histogram equalization on the green channel image and then by applying a classical median filter on the equalized histogram image. Lastly, depending on the case (intensity inhomogeneity), one of the following is executed to produce the corrected image:
If the input image does not have intensity inhomogeneity, only the histogram-equalized green channel image in the previous step is taken into account as a corrected image.
Otherwise, the corrected image is produced by division of those generated images.
To apply the trace-based method on color images, the local geometry for the color image I is obtained by computing the field K of geometry tensors. K is the gradient of. Moreover, K is expressed as the following for I in RGB color space:
The positive eigenvalues λ± and the orthogonal eigenvectors φ± of K are calculated as
K σ = K * G σ is obtained by eliminating noise via the Gaussian filter G σ , and a more stable geometry is generated. Here, * is the convolution operator. K σ is a good predictor of the local geometry of I. The spectral elements of K σ give the color-valued variations such as edge strength by means of the eigenvalues λ±, and they also give the corners and edge directions of the local image structures by means of the eigenvectors φ- ⊥ φ+ (Figure 5). More clearly, eigenvalues λ± give some information about the active point as follows:
If λ + ≅ λ - ≅ 0, then the point may be in a homogenous region.
If λ + ≫ λ -, then the point may be on an edge.
If λ + ≅ λ - ≫ 0, then the point may be on a corner.
Tschumperlé et al. suggested designing a particular field T: Ω → P(2) of diffusion tensors to define the specification of the local smoothing method for the regularization process. It should be noticed that T, depended on the local geometry of I, can be defined in terms of the spectral elements λ± and φ± of K σ .
Here, s±: ℝ2 → ℝ are smoothing functions (along φ±), and they change depending on the type of application. Sample functions for image smoothing are proposed in as and. The goals of smoothing operation are
To process pixels on image edges along the φ - direction (anisotropic smoothing)
To process pixels on homogeneous regions on all possible directions (isotropic smoothing). In this case, T ≅ identity matrix and then the method behaves as a heat equation
The regularization approach presented by Tschumperlé et al. is used to obtain the local smoothing geometry T, based on the trace operator:
where H i is the Hessian matrix of I i :
To sharpen the color images, the shock filter is applied on each image channel I i only in one direction φ+ of the vector discontinuities. Moreover, a weighting function is added to enhance color image structure without changing the flat regions. As depicted in Figure 6, such a filter is formulized as follows:
Here, s+: ℝ2 → ℝ, s+(.) = (1 + λ+ + λ-)-0.5 is a decreasing function, and sub-indexes b and f stand for backward and forward finite differences, respectively.
The methods based on color information are compatible with all local geometric properties expressed above: I(t + 1) = I(t) + τ1∂I(t)/∂t, where τ1 is an adapting time step. The adapting time step τ1 is set by the following inequality: τ1 ≤ 20/max(max p (∂I(t)(p)/∂t), min p (∂I(t)(p)/∂t)).
3.2 Modified phase map estimation
Another important step followed in preprocessing retinal fundus images is developing an efficient method for estimation of the image structures in cases, for instance, where retinal vessel network contains slim and lengthy vessels with weak edge intensities. According to our experiment, edge-based level set image segmentation methods give the best results on images that have only structure information in the segmented regions. Although the method described above could segment objects in MRIs and other common medical image formats with reasonable success, it may fail to segment retinal vasculature successfully, due to vessels with weak edge properties. Therefore, an alternative image structure based on the phase map of the image is employed. It should be noted that neither the phase congruency-based method nor the phase map-based approach (see Figure 7) generates adequate structure information for segmentation of vasculature in fundus images. Therefore, we combine these two methods as described below to improve the phase map.
The log-Gabor filter can efficiently extract image features such as edges and corners without missing any weak object boundaries. This filter, generated in frequency domain, is a version of logarithmic transformation of the Gabor filter, and it has no DC component. In polar coordinates, the filter consists of two components, the radial part and the angular part. These two components are combined to create the log-Gabor filter, which is the transfer function formulated as follows:
Here, (r, θ) stands for the polar coordinates, f0 is the center frequency, θ0 is the orientation angle (direction), σ r = log(υ/f0) defines the scale bandwidth, and σ θ defines the angular bandwidth. In order to keep the shape ratio of the filter constant, the term υ/f0 must also be kept constant for varying f0.
The log-Gabor filter can be efficiently used to generate the phase map instead of the gradient norm in image segmentation[24, 40]. The image is filtered at different scales in at least three uniformly distributed directions to grab the poor contrast and vasculature with varying width. The filter output is complex in the time domain, where real and imaginary parts consist of line and edge information, respectively. Filter responses in each scale for all directions must be combined to obtain a rotationally invariant phase map. The absolute value of the imaginary parts is taken to avoid an elimination. With these in mind, the modified phase map q is obtained as in Equation 4:
Here,, O is the number of the orientation angles, S is the number of the scales, is the filter response based on the corrected phase, and β is a weighting parameter. The normalization is also used to regularize the phase map. Here, σ q stands for a threshold used to reduce noise effect. Since edges align with the zero crossings of the real part of the phase map, the function can be used to estimate image edges as in. Moreover, gives image lines, and the norm of the filter response, formulated as, gives the strength of the image structure. So, the image structures of the green channel of retinal fundus images are estimated efficiently and correctly by using the log-Gabor filter as seen in Figure 8.
3.3 Structure-based level set segmentation method
A novel structure-based variational method is proposed in this study in order to trace retinal vasculature. The level set function in can be discretized more easily compared to other methods in the literature since it has a level set regularization term. The discretization process uses center/forward difference model instead of other complex discretization schemes[23, 24]. For instance, in the GAC model in, the upwind method is used for the calculation of the gradient norm of the level set function Φ, and for the re-initialization of the level set function Φ, essentially non-oscillatory (ENO) scheme is employed. Therefore, the same level set function regularization term of the DRLSE method is used in the proposed method.
In the DRLSE method, the formulas of R(Φ) = ∫ΩP(Φ)d p, L(Φ) = ∫Ωgδ ϵ (Φ)||∇Φ||d p and A(Φ) = ∫ΩgH ϵ (-Φ)d p are employed for segmentation. Here, P(.) is a potential function. The length functional L(.) smoothes the zero-level contour. The area functional A(.) helps accelerate the level set evolution when the initial contour is located far away from the object boundaries. For demonstration, see Figure 9.
In edge-based level set approaches, a smooth edge indicator function is generally obtained from the gradient norm of the Gaussian-filtered image. One choice is g = (1 + ||∇(G σ * I)||2)-1. The edge indicator function g carries key information to locate the zero-level contour. are finite-width approximations of the Heaviside function and Dirac-delta for ϵ:
where, in general, the parameter ϵ is set to 1.5.
The level set function regularization term should have a minimum to maintain the signed distance property of ||∇Φ|| = 1 in a band region around the zero-level contour as depicted in Figure 9i, instead of the heat equation that enforces ||∇Φ|| = 0, eventually. So, the solution, based on the potential function P1(||∇Φ||) = 0.5(||∇Φ|| - 1)2, is formulated as follows:
The sign of D(||∇Φ||) = 1 - (1/||∇Φ||), where D(x) = x-1 ∂P(x)/∂x indicates the property of the diffusion term based on anisotropic regularization in the following two cases:
For ||∇Φ|| > 1, the diffusion rate μD(.) is positive and the diffusion is forward, which decreases the term ||∇Φ||
For ||∇Φ|| < 1, the diffusion is backward, which increases the term ||∇Φ||
However, this regularization term may cause an unsatisfactory result on the level set function when ||∇Φ|| is close to 0 outside the band region as shown in Figure 9e,f. So, as given in Figure 9g,h, a corrected potential function is given as follows:
In the proposed method, the initial contours have to be set automatically around vessels in order to find the global minimum in a segmented image correctly. Sometimes, there is a risk of getting stuck in a local minimum due to the fact that retinal fundus images include defects such as drusen, GA, etc. So, seed points should be chosen around vessel regions to generate a desirable result. Note that the seed points can be set in or out of vessel areas, but they should be very close to the vessel structures (compare Figures 9 and10). There is another approach, called the ARLS method in the literature, utilizing automatic initial contours based on Laplacian of Gaussian (LoG) filter. This method is not proper for segmenting retinal vasculature, as the filter is very sensitive to noise, and there is a risk in the automatic initial contours if the retinal fundus image contains pathological regions. On the contrary, in the proposed method, the real part of the modified phase map has zero-crossing boundaries, and the method ensures to find the global minimum if the initial contour is selected around vasculature regions (Figure 9a,b,c,d,e,f,g,h). Therefore, we improve the speed term based on the area functional A(.) as follows:
In our method, iso-contours automatically shrink when the contour is outside the object due to the functional of A(.) returning a positive contribution, or they automatically expand with a negative value in A(.) when the contour is inside, regardless of the sign of α values as in the existing method (Figure 9j,k).
To eliminate staircasing effect and not to miss weak object boundaries, a potential function based on weighted total variation (WTV) model is used as. Here, s: ℝ → [1,2) is a monotonically decreasing function[27, 28, 41]. Such a function used in the ARSL method is not capable of regularizing zero-level contours because of the smoothed gradient norm which cannot generate image structure. Furthermore, the total variation (TV) model, presented in the PBLS method, will not smooth zero-level contours completely, generating unsatisfactory results. Therefore, we suggest a modified oriented Laplacian flow as in Equation 7, originally employed in image denoising[39, 42], in order to regularize the zero-level contour:
where, Φ ζζ = ζTH ζ, Φ ηη = ηTH η, and H is the Hessian of Φ. The unit vectors η and ζ are represented by the gradient direction and the tangential (its orthogonal) direction, respectively. Here, η = ∇Φ/||∇Φ|| and ζ = η⊥. s(.) depends on the value of the strength of the image structure, which is generated from phase map. So, along the zero-level contour, the oriented Laplacian flow has a strong smoothing effect. As a result, our approach is more efficient compared to the PBLS method to regularize zero-level contours.
3.4 Proposed segmentation method
The proposed method accepts a retinal fundus image in RGB color space as input. Firstly, a simple mask is obtained to exclude the exterior parts of the fundus where the color is in the 0-U interval in all three channels (generally very dark regions). Also, an iterated erosion operator whose structure element is is applied on the mask for proper execution. Secondly, a preprocessing step is employed to obtain a corrected image in terms of intensity inhomogeneity. Thirdly, we compute the phase map by using the corrected image as input. Afterwards, to eliminate some small non-blood vessels region, Otsu’s method is applied on the processed image. As a result of these processes, a skeleton-based image giving the centerlines of the vasculature is generated with the following steps: (i) remove disconnected pixels, (ii) obtain skeleton-based image, (iii) find junctions, (iv) trace lines (centerlines) and label them, and (v) clean short lines. Here, a threshold value is used to eliminate tiny little short lines called artifacts.
In order to set the optimum initialization of the zero-level contour, seed points have to be selected around the vasculature according to the centerline obtained based on phase map properties. Here, a morphological dilation operator whose structure element is, is performed on the centerlines to generate a proper initial contour. Finally, the proposed method creates the output by using the structure-based level set method. Our level set function is minimized by using Euler Lagrange and the iterative gradient descent procedure as follows:
Note that values of the edge indicator function g, used in, are in the [0,1] interval. In the proposed method, the sign of the coefficient α in the level set energy functional can always remain positive in contrast to the earlier method since the function obtained from the phase map has a different sign around object boundaries.
The proposed level set evolution equation culminates in Φ(t + 1) = Φ(t) + τ2∂Φ(t)/∂t where τ2 is a time step, which is set by τ2 ≤ (4 μ)-1 based on Courant-Friedrichs-Lewy (CFL) condition with 4-neighbor connectivity[25, 44].The initialization of level set function is important. If the seed points are selected away from the vessel centers and close to pathological regions, the proposed method can fail (wrongly segmenting the pathological region, as well) as shown in Figure 10d.
4 Experimental results
The proposed method is tested on DRIVE, STARE, and our own datasets[2, 19] for this study. Our 34 wide-angle fundus images are grabbed from premature infants supplied by the RetCam II camera and delineated by medical experts. The images from different experts are combined to create one ground truth image for each one of the fundus image[1, 2]. Some methods used in this study are summarized in Table 1. The chosen parameters of the algorithm are given in Table 2. Eight uniformly distributed angle directions and three image re-sampling scales for the log-Gabor filter are used in the method. The maximum number of iterations for the main algorithm depends on the radii of the vessel, and for this study, it is experimentally set as 60 + 1 (extra regularization of the zero-level contour via level set evolution with α = 0). The threshold values of U for creating mask images are set to 40, 40, and 45, for DRIVE dataset, our dataset, and STARE dataset, respectively. Moreover, small gaps in the created mask image for STARE dataset are filled using a morphological closing operator whose structure element is a disk of radius 10. In order to eliminate the out of fundus image region, the numbers of iterated erosion operator are set to 8, 8, and 2 for DRIVE dataset, our dataset, and STARE dataset, respectively. The threshold values of short line length are set as 15, 35, and 15 for DRIVE dataset, our dataset, and STARE dataset, respectively. c0 values for initializing of level set functions are set to 5, 5, and 2 for DRIVE dataset, our dataset, and STARE dataset, respectively. Here, in all cases except for the 20th image from STARE dataset, second selection is used for preprocessing. First selection is used for preprocessing on 20th image from STARE dataset because this image does not have intensity inhomogeneity. The Neumann boundary condition is employed to solve Equation 8.
The results of the preprocessing step for some test images from DRIVE dataset are seen in Figures 11 and12. Using the segmented image, on which a scalar approach[19, 38] is applied for the preprocessing step, the vasculature cannot be traced truly. This does not happen in our method because we use a trace-based method to smoothen and then a shock filter to sharpen the given image. Both filters work based on the color information unlike the ones in the scalar approach presented in[19, 38]. Therefore, the image, obtained by our method, is denoised more efficiently and segmented more correctly. While our method produces promising results, we should also indicate that there are still missed retinal vessels. Those missed vessels are very thin with weak edge properties. There are regular retinal vessels with normal dimensions wholly missed with the preprocessing step presented in. Such a region is marked with a blue circle as shown in Figure 11f. In Figure 12b, a difference image between input color image and smoothed version of the input image is shown. The blue channel has noise and seems to contain higher frequencies compared to Figure 11b. Furthermore, images that could not be segmented using the proposed structure-based level set segmentation method without preprocessing are shown in Figure 12g,h.
Figure 13 demonstrates the results of the level set function evolution based on setting the coefficient values ϑ and α used in the length term regularizing zero-level contour and the speed term accelerating the level set function evolution. ϑ is set to 0.4, 0.8, and 1, and α is set to 1.5, 2.5, and 3, respectively, as shown Figure 13a,b,c. However, some retinal vessels (marked with a blue circle) are still not connected. Therefore, in order to generate a good result as seen in Figure 12f, ϑ and α are set to 0.6 and 3, respectively.
Our segmentation process illustrated in Figure 14 employs the skeletonized version of the input image on which a morphological dilation operator is performed only once to initialize the level set function. The proposed method generates good results; some very thin retinal vessels with poor contrast are still missed due to the fact that our method is unable to produce a proper phase map. However, unlike previous works[24, 25], the method can trace retinal vessels efficiently, since the structure-based level set segmentation method is able to shrink or expand automatically as displayed in Figure 14h where the level set function is initialized inside the vessels in some regions and outside the vessels in some regions.The test results of preprocessing operations on our dataset are shown Figure 15. The non-uniform intensities in the given image are estimated and corrected properly.A sample vessel segmentation result for a non-pathological fundus image from our dataset is shown in Figure 16. Here, the approach cannot trace some vessels with poor contrasts as seen in Figure 16h. Also, the image could not be segmented employing the proposed segmentation method without preprocessing as depicted in Figure 16g.Another sample vessel segmentation result for a non-pathological fundus image from STARE dataset is depicted in Figure 17. Here, the vessels can be traced properly using the method.The results of other test images in DRIVE, our images, and STARE datasets are given in Figures 18,19 and20. Some segmentation results for pathological images include artifact, and they are marked with blue circles. These regions have also poor contrast, and retinal vessels in these regions are very thin.
Figure 21 depicts another case, for which both methods described in earlier work[24, 25] failed especially at regions with poor contrast. However, the proposed method is able to properly track the vessels in those regions as shown in Figure 21e. Although the PBLS method presented in runs faster than ours since it employs a narrow band implementation, that faster method is unable to trace retinal vessels properly due to the fact that the phase map of the method is not estimated correctly in the regions with thin vessels and poor contrasts. Also, the DRLSE method proposed in does not expand the vessels if the initialization starts inside the vessel. On the other hand, if initialization starts outside the vessel and the image is in poor contrast, the DRLSE method over-segments the vessels because it uses the image gradient instead of the phase map. Instead of a TV approach, if an oriented Laplacian flow approach, ∂Φ L /∂t = ϑδ ϵ (Φ)(Φ ζζ + gΦ ηη ), proposed in our work, is employed in the DRLSE method to smooth zero-level contours, the results may visually seem to be like over-smoothing as displayed in Figure 21b,c. But, as depicted in Figure 21e, this disadvantage turns into an advantage if the modified oriented Laplacian flow approach,, is employed in our method, since it eliminates the expansion of segmented vessel areas. As shown in Figure 21d, the expansion is not completely eliminated if a modified TV approach,, is used in our method. Also, the vessels could be traced more properly in the proposed method, if the iteration number is increased, but this increases the cost. The result of our method seems to be more efficient compared to the existing methods[24, 25] in the literature since it has a novel zero-level contour regularization term and it employs a modified phase map.
Lastly, the segmentation results of the non-pathological image generated by the region-based level set evolution method (RBLSE) are given in Figure 22. The most important advantage of this method is that the initialization may start on any region of the fundus image instead of around vessels by a simple selection. The segmentation of vessels can be done in the fundus images without poor contrast in the initialization phase. After that, while some segmented vessels are combined, some gradually disappeared in later iterations. But surprisingly, after the 42nd iteration, all segmented vessels are gone and only the boundary of the retina remains as segmented as presented in Figure 22c.
Quantitative results are obtained for both datasets where manual vessel segmentation labeling was performed and verified by medical experts. Comparing the results with manual delineations, we obtain overall statistical quality metrics such as sensitivity Se, specificity Sp, positive predictive value Ppv, negative predictive value Npv, accuracy Acc, and kappa κ. These measures are given as follows:
Here, TP refers to a pixel labeled as vessel by both the algorithm and the medical experts’ ground truth data, while TN refers to a pixel that is deemed to be non-vessel by both. FN refers to pixels of vessels (according to ground truth data) missed by the algorithm, and FP refers to pixels falsely categorized by the algorithm as vessel. In order to compare the proposed method, the same statistical metrics for supervised and unsupervised methods[11, 14–17] on DRIVE dataset, our dataset, and STARE dataset are also reported in Tables 3,4,5, and6. Here, it should be addressed that, although vascular segmentation has been achieved in countless studies, some of which even have better results in the literature, it has not been done so far using structure-based level set approach. In addition, for instance, while the unsupervised method has good accuracy metric results, it generates occasional artifacts, such as false vessels, next to the optic disks. The results of our method are promising due to the fact that the method does not use any training algorithm compared to the supervised methods presented in[14–17]. As can be seen in Table 6 from the Acc and κ metrics, for instance, when compared with PBLS method, our method fairs better quantitatively.The methods are implemented using MATLAB R2010a. The programs are executed on a laptop with a Pentium 2.20-GHz processor and a 2-GB RAM. The segmentation of the retinal fundus image with a size of 565 × 584 pixels, as depicted in Figure 12f, lasts 61 iterations and 92.69 s. Note that the run time of the program may vary according to structure and size of the retinal fundus image.
We present a structure-based level set method with automatic seed point selection for segmentation of retinal vasculature in fundus images. Extensive experiments employing the proposed algorithms using datasets indicate that the algorithm performs well and favorably compared to the already existing level set-based methods in the literature. Developing strategies to improve inconsistencies in clinical diagnosis is an important challenge in ophthalmology. The segmentation methods described in this study may provide a basis for the development of computer-based image analysis algorithms. Future work will involve quantitative feature extraction from segmented retinal vessels, followed by implementation of these image analysis algorithms for image-based diagnostic assistance.
We plan to extend the study in order to improve the results especially for pathological regions such as drusen, GA, etc. Moreover, we will investigate how to use all color channels of the given image interactively in an efficient manner in order to trace retinal vasculature more properly. In addition to this, we plan to do a narrow band implementation in order to accelerate the run time of the proposed method.
Chiang MF, Jiang L, Gelman R, Du YE, Flynn JT: Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch. Ophthalmol 2007, 125: 875-880. 10.1001/archopht.125.7.875
Gelman R, Jiang L, Du YE, Martinez-Perez ME, Flynn JT, Chiang MF: Plus disease in retinopathy of prematurity: pilot study of computer-based and expert diagnosis. JAAPOS 2007, 11(6):532-540.
Osareh A, Shadgar B: An automated tracking approach for extraction of retinal vasculature in fundus images. J. Opthalmic. Vis. Res. 2010, 5: 20-26.
Wu D, Zhang M, Liu JC, Bauman W: On the adaptive detection of blood vessels in retinal images. IEEE Trans. Biomed. Eng. 2006, 53: 341-343. 10.1109/TBME.2005.862571
Azemin MZC, Kumar DK, Wong TY, Kawasaki R, Mitchell P, Wang JJ: Robust methodology for fractal analysis of the retinal vasculature. IEEE Trans. Med. Imaging 2011, 2(30):243-250.
Mahadevan V, Narasimha-Iyer H, Roysam B, Tanenbaum HL: Robust model-based vasculature detection in noisy biomedical images. IEEE Trans. Inf. Technol. Biomed. 2004, 8(3):360-376. 10.1109/TITB.2004.834410
Narasimha-Iyer H, Mahadevan V, Beach JM, Roysam B: Improved detection of the central reflex in retinal vessels using a generalized dual-Gaussian model and robust hypothesis testing. IEEE Trans. Inf. Technol. Biomed. 2008, 3(12):406-410.
Tobin KW, Chaum E, Govindasamy VP, Karnowski TP: Detection of anatomic structures in human retinal imagery. IEEE Trans. Med. Imaging 2007, 26(12):1729-1739.
Niemeijer M, Xu X, Dumitrescu AV, Gupta P, van Ginneken B, Folk JC, Abramoff MD: Automated measurement of the arteriolar-to-venular width ratio in digital color fundus photographs. IEEE Trans. Med. Imaging 2011, 11(30):1941-1950.
Wang L, Bhalerao A, Wilson R: Analysis of retinal vasculature using a multiresolution Hermite model. IEEE Trans. Med. Imaging 2007, 2(26):137-152.
Hoover A, Kouznetsova V, Goldbaum M: Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans. Med. Imaging 2000, 19(3):203-210. 10.1109/42.845178
Jiang X, Mojon D: Adaptive local thresholding by verification-based multithreshold probing with application to vessel detection in retinal images. IEEE Trans. Pattern. Anal. Mach. Intell. 2003, 25(1):131-137. 10.1109/TPAMI.2003.1159954
Martinez-Perez ME, Hughes AD, Thom SA, Bharath AA, Parker KH: Segmentation of blood vessels from red-free and fluoresce in retinal images. Med. Image Anal. 2007, 11(1):47-61. 10.1016/j.media.2006.11.004
Marin D, Aquino A, Arias GME, Bravo JM: A New supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features. IEEE Trans. Med. Imaging 2011, 30(1):146-158.
Soares JVB, Leandro JJG, Jr Cesar RM, Jelinek HF, Cree MJ: Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans. Med. Imaging 2006, 25(9):1214-1222.
Staal J, Abramoff MD, Niemeijer M, Viergever MA, van Ginneken B: Ridge-based vessel segmentation in color images of the retina. IEEE Trans. Med. Imaging 2004, 23: 501-509. 10.1109/TMI.2004.825627
Budai A, Bock R, Maier A, Hornegger J, Michelson G: Robust vessel segmentation in fundus images. Int. J Biomed. Imaging 2013., 2013:
Frangi AF, Niessen WJ, Vincken KL, Viergever MA: Multiscale Vessel Enhancement Filtering (Springer. Germany, Heidelberg; 1998.
You S, Bas E, Erdogmus D, Kalpathy-Cramer J: Principal curve based retinal vessel segmentation towards diagnosis of retinal diseases. Proc. Healthcare Inform, Imaging Sys. Biol. (HISB) 2011, 331-337. San Jose, California, USA, (2011)
Erdogmus D, Ozertem U: Self-consistent locally defined principal surfaces. Proc. ICASSP 2007, Vol. 2: II.549-II.552. Honolulu, Hawaii, USA
Kirbas C, Quek F Proceedings of the Third IEEE Symposium on BioInformatics and BioEngineering (BIBE’03), 238-245. In Vessel Extraction Techniques and Algorithms: a Survey. Bethesda, Maryland, USA; 2003.
Vese L, Chan T: A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. J. Comput. Vis. 2002, 50(3):271-293. 10.1023/A:1020874308076
Caselles V, Kimmel R, Sapiro G: Geodesic active contours. Int. J. Comput. Vis. 1997, 22(1):61-79. 10.1023/A:1007979827043
Lathen G, Jonasson J, Borga M: Blood vessel segmentation using multi-scale quadrature filtering. Pattern Recogn. Lett. 2010, 31: 762-767. 10.1016/j.patrec.2009.09.020
Li C, Xu C, Gui C, Fox MD: Distance regularized level set evolution and its application to image segmentation. IEEE Trans. Image Process. 2010, 19(12):3243-3254.
Pang KY, Iznita L, Fadzil A, Hanung AN, Hermawan N, Vijanth SA: Segmentation of Retinal Vasculature in Colour Fundus Images. Conference on Innovation Technologies in Intelligent Systems and Industrial Applications (CITISIA, Malaysia; 2009:398-401.
Zhou B, Mu C: Level set evolution for boundary extraction based on a p-Laplace equation. Appl. Math. Mod 2010, 34(12):3910-3916. 10.1016/j.apm.2010.04.003
Meng L, Chuanjiang H, Yi Z: Adaptive regularized level set method for weak boundary object segmentation. Math. Probl. Eng 2012, 2012(369472):16. doi:10.1155/2012/369472
Belaid A, Boukerroui D, Maingourd Y, Lerallut J-F: Phase based level set segmentation of ultrasound images. IEEE Trans. Inform. Tech. Biomed 2011, 15(1):138-147.
Dizdaroğlu B, Ataer-Cansizoglu E, Kalpathy-Cramer J, Keck K, Chiang MF, Erdogmus D 2012 IEEE International Workshop On Machine Learning For Signal Processing. In Level Sets for Retinal Vasculature Segmentation Using Seeds from Ridges and Edges from Phase Maps. Santander, Spain; 2012.
Yu G, Lin P, Li P, Bian Z: Region-based vessel segmentation using level set framework. Int. J. Control. Autom. Syst. 2006, 4(5):660-667.
Li C, Kao C, Gore JC, Ding Z: Minimization of region-scalable fitting energy for image segmentation. EEE Trans. Image Proc. 2008, 17(10):1940-1949.
Li C, Huang R, Ding Z, Gatenby C, Metaxas DN, Gore JC: A level set method for image segmentation in the presence of intensity inhomogeneities with application to MRI. IEEE Trans. Image Proc. 2011, 20(7):2007-2016.
Zhao YQ, Wang XH, Wang XF, Shih FY: Retinal vessels segmentation based on level set and region growing. Pattern Recognition. 2014, 47(7):2437-2446. 10.1016/j.patcog.2014.01.006
Bertalmio M, Vese L, Sapiro G, Osher S: Simultaneous structure and texture image inpainting. IEEE Trans. Image Process. 2003, 12: 882-889. 10.1109/TIP.2003.815261
Buades A, Le TM, Morel J-M, Vese LA: Fast cartoon + texture image filters. IEEE Trans. Image Process. 2010, 19(8):1978-1986.
Dizdaroğlu B: An image completion method using decomposition. EURASIP J. Advanc. Signal Proc 2011, 2011(831724):15. doi:10.1155/2011/831724
Black MJ, Sapiro G, Marimont DH, Heeger D: Robust anisotropic diffusion. IEEE Trans. Image Process. 1998, 7(3):421-432. 10.1109/83.661192
Tschumperlé D: PDE’s based regularization of multi-valued images and applications, PhD thesis. Université de Nice-Sophia Antipolis, France; 2002.
Kovesi P: Phase congruency: a low-level image invariant. Psychological Research 2000, 64(2):136-148. 10.1007/s004260000024
Blomgren P, Chan TF, Wong CK: Total variation image restoration: numerical methods and extensions. Proc. IEEE Int. Conf Image Proc 1997, 3: 384-387.
Kornprobst P, Deriche R, Aubert G: Image Restoration via PDE’s. First Annual Symposium on Enabling Technologies for Law Enforcement and Security - SPIE Conference 2942: Investigative Image Processing, Boston, Massachusetts, USA; 1996.
Otsu N: A threshold selection method from gray-level histogram. IEEE Trans. Syst. Man Cybern 1979, 9(1):62-66.
Courant R, Friedrichs K, Lewvy H: Über die partiellen Differenzengleichungen der mathematischen Physik. Math. Ann. 1928, 100(1):32-74. 10.1007/BF01448839
Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics 1977, 33: 159-174. 10.2307/2529310
This work is partially supported by grants from TUBITAK (grant no. 1059B191000548), NSF, and NIH.
The authors declare that they have no competing interests.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
- Color retinal fundus images
- Phase map
- Segmentation of retinal vasculature
- Structure and texture parts of retinal fundus image
- Structure-based level set method