 Research
 Open access
 Published:
Stopping criterion for linear anisotropic image diffusion: a fingerprint image enhancement case
EURASIP Journal on Image and Video Processing volumeÂ 2016, ArticleÂ number:Â 6 (2016)
Abstract
Images can be broadly classified into two types: isotropic and anisotropic. Isotropic images contain largely rounded objects while anisotropics are made of flowlike structures. Regardless of the types, the acquisition process introduces noise. A standard approach is to use diffusion for image smoothing. Based on the category, either isotropic or anisotropic diffusion can be used. Fundamentally, diffusion process is an iterated one, starting with a poor quality image, and converging to a completely blurred meanvalue image, with no significant structure left. Though the process starts by doing a desirable job of cleaning noise and filling gaps, called undersmoothing, it quickly passes into an oversmoothing phase where it starts destroying the important structure. One relevant concern is to find the boundary between the undersmoothing and oversmoothing regions. The spatial entropy change is found to be one such measure that may be helpful in providing important clues to describe that boundary, and thus provides a reasonable stopping rule for isotropic as well as anisotropic diffusion. Numerical experiments with real fingerprint data confirm the role of entropychange in identification of a reasonable stopping point where most of the noise is diminished and blurring is just started. The proposed criterion is directly related to the blurring phenomena that is an increasing function of diffusion process. The proposed scheme is evaluated with the help of synthetic as well as the real images and compared with other stateoftheart schemes using a qualitative measure. Diffusions of some challenging lowquality images from FVC2004 are also analyzed to provide a reasonable stopping rule using the proposed stopping rule.
1 Introduction
In image processing problems, many times one comes across the task to enhance flowlike structures, for instance, the automatic assessment of wood surfaces or fabrics, fingerprint image analysis, scientific image processing in oceanography [1], seismic image analysis [2], or sonogram image interpolated for Fourier analysis [3]. All images as mentioned above have one thing common; they contain elongated structures [4â€“6]. Such images can be referred to as anisotropic. The isotropic, by contrast, is an image category having largely round objects. The isotropic as well as anisotropic images, once acquired from their respective sources are mostly noisy. The noise treatment is different based on the category they belong. The case of noise smoothing for anisotropic images is more interesting and is the focus of research presented here.
Classifying images into their category will help to devise a proper noise removal strategy for them. The authors in [7] suggested to use local anisotropy strength as a measure for an image to classify as anisotropic or isotropic. They later extended their anisotropy strength definition to construct a complete flowcoordinate system for anisotropic images. Their proposed anisotropy strength measure computation can be summarized as follows. First, the image L(x,y) is smoothed with a Gaussian of small standard deviation. The result C(x,y) is then differentiated in x and y direction to form C _{ x }(x,y) and C _{ y }(x,y), respectively. Next the covariance matrix components J _{1}(x,y)=2C _{ x }(x,y) and \(J_{2}(x,y) = {C_{x}^{2}}(x,y) {C_{y}^{2}}(x,y)\), and \(J_{3}(x,y)= \sqrt {{C_{x}^{2}}(x,y) +{C_{y}^{2}}(x,y)}\) are computed. The components are smoothed again with a larger Gaussian. The local orientations and their anisotropy strength measure are computed as
and
Applying this definition to our test images, that is, Blackball and Curves image, will result in a graphical display as shown in Fig. 1. The local flow directions are depicted by the orientations of the small needles superimposed on the image. The length of each needle is drawn proportional to the amount of local anisotropy at that pixel point. It is noted that the Blackball image is largely isotropic with no preferred local directions, whereas the Curves image showed a profound anisotropic character, largely in the vicinity of the elongated structures. This justifies labeling Blackball image as isotropic and the Curves image as anisotropic.
The rest of this paper is organized as follows. In Section 3, a discrete image as a spatial distribution is discussed. The spatial entropy of linear isotropic diffusion process is described in Section 4. Section 5 talks about spatial entropy of a linear anisotropic diffusion process followed by results and discussion in Section 6. Finally, the paper is concluded in Section 7.
2 Related work
The research concerned here is to smooth noise present in fingerprint images (a representative of anisotropic class) without affecting their ridge/valley pattern. This aim can be conveniently served in a scalespace construction. A scalespace framework describes a noisy image as a stack of progressively evolving many smooth images, each one with their corresponding scale [8]. The stack is ordered in increasing smoothness scale, where the scale varies in finetocoarse. The finetocoarse transformation is implemented, in general, by a linear isotropic diffusion process, governed by a partial differential equation (PDE) as follows.
Let L(x,y) denote a noisy grayscale input image and L(x,y;t) be an evolving image at scale t, initialized with L(x,y;0)=L(x,y). Then, the linear isotropic diffusion process can be defined by the equation
This equation appears in many physical processes [9, 10]. In the context of heat transfer, it is referred to as the famous heat equation. For image processing, the amount of heat is replaced with the intensity value at a certain location. The diffusivity parameter c is constant across the image, making it a linear isotropic equation. The linear isotropic equation has an elegant solution \(L(x,y;t)= G_{\sqrt {2ct}}(x,y) \ast L(x,y)\), where \(G_{\sigma }= \frac {1}{2 \pi \sigma ^{2}} \exp \left ( \frac {x^{2}+y^{2}}{2 \sigma ^{2}}\right)\). This solution provides the required interpretation in the form of lowpass filtering. Due to lowpass nature of this diffusion, as it progresses from fine scale images to coarser images, the blurring intensifies and may result in removing significant image structure, typically edges, lines, or other details, well before it had taken care of the noise. To protect the structure in a diffusion process, the diffusivity parameter should be made dependent on some characterization of image structure. This results in the famous nonlinear isotropic diffusion process, proposed by [11]. The diffusivity now becomes a function of gradients, so at the edge point the diffusion is completely inhibited and in smooth regions diffusion is allowed. However, computing gradients for a noisy image is an illposed problem. A remedy was pointed out by [12], that suggests the use of Gaussian smoothing before computing gradients. This modification lays the foundation for a wellbehaved nonlinear isotropic diffusion process. Later on, instead of inhibiting diffusion at edge points, it was thought of to steer the diffusion in the direction parallel to the edge [13â€“16] rather than across it. This paved the way for the use of the diffusion matrix. This evolved the current form of nonlinear anisotropic diffusion. The diffusion matrixbased equation is defined as
where D is the 2Ã—2 diffusion matrix. The eigenvectors of the diffusion matrix provide the required steering while the eigenvalues as a function of gradients, add the nonlinearity character. In our wish to keep connected with the Gaussian convolution interpretation that provides a mathematical tractability to the whole process, the research reported here is restricted to the linear anisotropic diffusion case. For that, the eigenvalues of the diffusion matrix are kept fixed. It is found that the Gaussian convolution connection is also useful for linking anisotropic diffusion with its earlier counterpart isotropic diffusion in a more natural way. The support for this modification came from the argument made in [14], that a nonuniform Gaussian can act as a solution of the Anisotropic Gaussian scalespace as long as the diffusion matrix is spatially constant, i.e., it does not depend on (x,y) spatial location. Keeping in line with this argument, only spatiallyinvariant diffusion matrix is used; however, the steering was allowed. This leaves us with the socalled linear anisotropic diffusion process. The constant eigenvalues are responsible for the linear part of the name, while the steering of the eigenvectors is what provided the word anisotropic in the nomenclature. The linear anisotropic diffusion equation has a convolution solution with a nonuniform Gaussian of the form:
where (u,v) are the rotated coordinates obtained using eigenvectors of the diffusion matrix. The eigenvalues Î» _{ u }, Î» _{ v } represent the standard deviations of the Gaussian in u and v direction, respectively. Normally, for noisy images, one of the eigenvalues is set to be much smaller than the other one, resulting in a nonuniform Gaussian function with more generalized elliptical support.
Searching for a suitable linear anisotropic diffusion strategy for noisy images in literature, we stumble upon considerable activity regarding the impact of a nonlinear anisotropic diffusion equation on noisy images. The nonlinear anisotropic literature is used as a stepping stone to reach a linear anisotropic diffusion strategy. The idea of nonlinear anisotropic diffusion was pioneered by Nitzbeg et al. [17] and Cottet et al. [12]. Later on, Weickert [3] put forward a formal method for enhancing the elongated structure, referred to as coherenceenhanced diffusion (CED). The CED works by steering the diffusion process in a particular direction with the help of a spatially varying diffusion matrix. The design was further generalized by adopting a diffusion matrix to learn the local structure iteratively [18]. Since smoothing elongated structure is desired, the CED procedure comes in handy. The CED is adopted as it is, but with one major modification. That is, the eigenvalues are forced to be independent of spatial position without disturbing the eigenvectors. Thus, our proposed linear anisotropic diffusion process will steer the nonuniform Gaussian to lay along the structure, but its size will remain constant regardless of the position. Towards the end, we will desribe another variant of CED, where even the steering part of the diffusion matrix will also be precomputed and kept constant throughout the evolution process. This is referred to as the linearoriented diffusion process.
The suggested linear anisotropic process for anisotropic images are confronted with one basic problem: when to stop the diffusion. For the case of a noisy image, the diffusion process initializes with an undersmooth situation that ultimately turns into an oversmooth one (the meanvalue image at the end with no structure). Overestimating stopping time will result in an oversmoothed blurry image while underestimating may leave significant noise in the image. Therefore, it is crucial that an appropriate time is selected in an automatic way. The literature activity in this respect can be divided into two broad categories. One that deals with stopping criterion selection in additive noise model setting. These methods adopt the stopping time by treating the noisy image as the result of a noise addition, where the correlation between the diffused image and the initial noisy image minimized [3]. The authors in [19] introduced a multigrid algorithm using a normalized cumulative periodogram. A frequency approach to the problem was presented in [20]. Whereas, [21] uses the extent of noise smoothing in every iteration as a stopping parameter for diffusion. Later on, a spatiallyvarying stopping method was introduced that increased the computational cost significantly [22]. By identifying it as a Lyapunov functional of a large class of scalarvalued nonlinear diffusion filters, Weickert [23] introduced decreasing the variance of an evolving image as a stopping tool.
Since additive noise model may break down for some realworld images, where noise manifests itself in the form of gaps in regular ridge structures. Therefore, a second category of stopping rule was evolved. The category deals with examining entropy profile of the diffused image and proposed stopping criterion for the evolving image entropy distance from that of the entropy of the original noisy image [3]. The idea of local image entropy was introduced in [24], where the measure of local entropy defines the segmentation boundaries in multipleobject images. Local image entropy definition can be extended to define a global characteristic of the scalespace image, that is spatial entropy [25].
The research work reported here takes an investigative look at the stopping rule concerning the change in spatial entropy of an image as it goes through diffusion process. The connection, between last peak in spatial entropy curve and the size of the image structure, is found to be related to the start of significant information loss. This observation paves the way to the hypothesis that peak entropy change will happen at the time instant on diffusion time axis when dominant image structures just start blending with the background right at their boundaries. This finding, substantiated by extensive empirical evidence provided here, motivated us to put forward the idea that a maximum entropy change may well be posed as a good stopping time for the diffusion process.
3 A discrete image as spatial distribution
Consider a discrete fingerprint image \(L\left ({x,y} \right)\), where x is the row index and y is the column index. This discrete image can be realized as spatially distribution light intensity [26]. Each spatial location that is (x,y) in the image registers the number of light quantumhit. In this way, we may define
This spatial probability perspective was found to correspond very nicely with the theory of scalespace [27]. As we move higher in scalespace for an image, and the spatial smoothing is high, or equivalently, the spatial uncertainty increases. In the limit, the spatial distribution, becomes close to uniform distribution. The spatial entropy of an image is given as
As stated in [26], the spatial entropy of the image increases monotonically towards an equilibrium state \(\log N\), where N is dimension N=r o w sÃ—c o l u m n s.
4 Spatial entropy of linear isotropic diffusion process
The linear diffusion process implemented by socalled heat equation is the oldest and wellinvestigated noisesmoothing process in the image processing domain. The linear diffusion process can be visualized as an evolution process with an artificial variable t denoting the diffusion time, where the noisy input image is repeatedly smoothed at a constant rate in all directions. No preference to any direction is what justifies the name isotropic. This evolution results in scale space representation of the noisy image. As we move up to coarser scales, the evolving images become more and more simplified since the diffusion process removes the image structures present at finer scales. In the process, noise also gets smoothed as it is considered a smaller size object while diffusion just reaches the point of touching the boundaries of the large dominating structure.
During the process of diffusion from finescale image to the higher coarser scale images, the mean of the resulting image remains constant with a monotonic decrease in variance (a secondorder statistic [13]). Later on, it was found that spatial entropy associated with linear isotropic diffusion process also rises smoothly in a monotonic fashion [25]. Motivated by the smoothness of the spatial entropy graph for the diffusion process, the first derivative of the entropy function on natural scale parameter \(\tau = \log (t)\) was investigated. It was shown that entropy change graph do show important peaks related to dominating structures present in the original fine scale image. However, their experiments did not involve smoothing noisy images, and the authors fell short of suggesting to use these peaks as stopping criterion. The empirical evidence is provided here to show that once a linear isotropic diffusion process is involved in smoothing noisy images, these peaks will come at a much later stage in diffusion time. Therefore, most of the noise being low size structure already wiped by the process, and thus the peaks could be regarded as a suitable stopping time. This proposition is tested by tracking experimental data.
To provide a quantitative measure for checking our test results, two binary statistical measures are used: sensitivity and specificity. This is due to the use of a binary image as input test, and the final diffused image is thresholded to come up with the final binary output image. Since we are dealing with binary images, the two measures suit us. The measures deal with comparing the output binary image A with a standard ground truth image B. Let us first define four related quantities: true positive (TP) (the black pixels in image A are also black in image B), false positive (FP) (the black pixels in image A are white pixels in image B), false negative (FN) (the black pixels of image B are identified as white in image A, that is we missed the true black pixels), and true negative (TN) (the white pixels in image A are same as white pixels in image B). Sensitivity is given by
Specificity is more concerned with
First, a linear isotropic diffusion process is conducted for the image without noise. Figure 2 b shows the entropy curve with natural scale parameter. The monotonic behavior of entropy curve is noted. The curve starts increasing from a low value and moves onwards to an almost stable asymptotic value on a much larger scale. The regularity of the entropy curve motivates us to compute its derivative on the natural scale parameter. The entropy change curve for this image diffusion process is depicted in Fig. 2 c. One clear peak in the graph is observed, corresponding well with the radius of the black balls. If the linear diffusion process is stopped at a scale where the peak in entropychange happens, then output resulting diffused image is displayed in Fig. 2 d. It is observed that diffused image is still intact with all the black balls showing their characteristic black colors, with diffusion just started at the boundaries of these balls. Hoping that this peak in entropy change will remain fixed at this scale with the noise added to the image, the best possible stopping time will be the scale of the peak. The sensitivity and specificity numbers for the comparison of the output diffused binary image with the original are 88 and 96 %.
To investigate the shape and location of the peaks in entropy change with noiseadded images, we start with lower SNR images. The black balls image is considered with Gaussian noise added, such that its SNR reduces to 2. The black ball image with SNR = 2 dB is depicted in Fig. 3 a. The linear diffusion process was conducted for this noisy image to mitigate the effect of Gaussian noise. The resulting entropy change graph is displayed in Fig. 3 b. We see two peaks in the graph. The first peak is largely the contribution of the noise added to the image. The second peak is due to the presence of black balls, at the same location where we saw it before in the clean image entropychange graph. This validated the claim made in [25], that peaks in entropy change graphs are representative of the corresponding sizes of the structures present in the images. The linear diffusion process can be stopped at the location of the second peak, the resulting output diffused image is shown in Fig. 3 c. The image clearly shows a diffused image where largely the noise is smoothed with the black balls still intact. The diffused image can be binarized by using its histogram, clearly showing a valley between black and white bars. Doing so, the image of Fig. 3 d is reached, with sensitivity and specificity numbers being 85 and 91 %.
To further investigate the entropy change graph of a noisy image, the black ball imaged are severely degraded with a large amount of Gaussian noise till its SNR drops to âˆ’3 dB. The noisy black ball image is depicted in Fig. 4 a. The linear diffusion process is applied to this noisy image, with the resulting entropy change graph displayed in Fig. 4 b. The presence of two peaks is observed, as previously did in a less noisy image. However, this time, the peak associated with noise is much large in amplitude to the peak of the black balls. This clearly is the outcome of a large amount of noise added to the image pixels. The second peak, though small in amplitude, is still present at the same location as that of clean image entropychange graph. By stopping the linear diffusion process at the second peak location, we get the diffused image is shown in Fig. 4 c. By converting this diffused image by selecting a threshold from its histogram, we reach the binary result as displayed in Fig. 4 d, having sensitivity and specificity numbers as 78 and 88 %.
5 Spatial entropy of a linear anisotropic diffusion process
In this section, spatial entropy analysis is carried out for the anisotropic diffusion process. What we are looking for is the finding whether we will get a smooth spatial entropy increasing function, and then will we get a distinct peak in the entropy change curve for the anisotropic diffusion process.
The anisotropic scalespace for the image L(x,y) can be constructed by the diffusion equation
where D is the 2Ã—2 diffusion matrix, adapted to the local image structure, via a structural descriptor, called the secondmoment matrix Î¼, defined as
where \({L_{x}^{2}}\), L _{ x } L _{ y }, and \({L_{y}^{2}}\) represent the second order Gaussianderivative filters, in the x and y directions. This symmetric 2Ã—2 matrix has two eigenvalues Î» _{1} and Î» _{2}, given by:
where
The secondmoment matrix comes with two eigenvectors. The first normalized eigenvector can be written as \((\cos \theta, \,\, \sin \theta)^ T\), and the second orthogonal eigenvector comes out to be as \(( \sin \theta,\,\, \cos \theta)^ T\). One of these eigenvectors is parallel, and the other is perpendicular to the structure. The parameter Î¸ represents the local orientations of the given image. What is observed here is that eigenvalues are dependent on the local structure. In order to transform CED process into a linear anisotropic process, fixed values are assigned to the eigenvalues. Specifically, the eigenvalue associated with eigenvector that goes parallel to the structure has given a larger value than that of the eigenvalue of an eigenvector that is perpendicular to the structure boundary. Our specific choice of Î» _{1} and Î» _{2} for this experiment are
with a step size of 0.01 to provide a stable diffusion process.
The diffusion matrix D can now be reconstructed with help of its structureinvariant eigenvalues and structuredependent eigenvectors as
Once the diffusion matrix is constructed, the evaluation process is set to start. The diffusion process proceeds in four steps.

1.
Calculate the secondmoment matrix for each pixel.

2.
Construct the diffusion matrix for each pixel.

3.
Calculate the change in intensity for each pixel as \( \nabla \left ({D\nabla L} \right)\).

4.
Update the image using the diffusion equation as
$$ L^{t+\bigtriangleup t}= L^{t}+ \bigtriangleup t \times \nabla\left({D\nabla L} \right). $$((16))
This monotonic decreasing behavior of the image variance is also evident in the graph depicted in Fig. 5 when we are diffusing our fingerprint image shown in Fig. 5. What can be seen from the graph is that it is fast decreasing in the beginning, but towards the end, it becomes saturated, providing convergence. Thus, by bounding the relative change in the variance, one can define the diffusion stopping rule. However, this rule does not guarantee an optimal time to stop the process. It is based on the userdefined ratio of diffused image variance to that of initial image variance. This ratio might be useful if we want to compare various diffusion schemes. Its utility to provide a welldiffused image with all the important structure cleaned but intact may be limited.
Under the CED process, the fingerprint image becomes strongly coherent as the number of iterations increased. In other words, as the scale increases, the image becomes diffused with a corresponding change in its spatial distribution. Taking \(p_{t} \left ({x,y} \right) = \frac {{L\left ({x,y;t} \right)}}{{\sum \limits _{x} {\sum \limits _{y} {L\left ({x,y;t} \right)}} }}\) and \(C = \sum \limits _{x} {\sum \limits _{y} {L\left ({x,y;t} \right)}},\) we get
Now, we track the change in entropy with respect to natural scale parameter \(\tau = \log t\). The natural scale parameter is defined in [28]. The entropy change is thus,
After some mathematical manipulations, reach to the equation
Using chain rule \(\tau = \log t\) and \(d\tau = \frac {1}{t}dt\)
Now, as \( p_{t} \left ({x,y} \right) = \frac {{L\left ({x,y;t} \right)}}{{\sum \limits _{x} {\sum \limits _{y} {L\left ({x,y;t} \right)}} }} = \frac {{L_{t} \left ({x,y} \right)}}{C}\)
The Eq. (20) lends itself now as
The rate of change in the entropy for the linear isotropic diffusion case is the special case of 26, and this happens when the diffusion matrix D is replaced by a scalar diffusivity, say c. Spatial entropy change for linear isotropic diffusion process is given by
For both, anisotropic as well as isotropic cases, the spatial entropy change equation contains the same constant \(k=1\log C\).
The same tests, as were performed earlier for linear isotropic diffusion process, are conducted for linear anisotropic diffusion process. The test anisotropic image for this purpose consists of three curves, as shown in Fig. 6. At the heart of the anisotropic process is the construction of diffusion matrix D. The diffusion matrix handles steering the elliptical Gaussian to go around the structure. The geometric visualization in the form of ellipses corresponding to pointwise diffusion matrix is displayed in Fig. 6, where it can be seen that they align well with the local flow of the curve. The diffusion parallel to the edges is enabled due to the large eigenvalue while avoiding the crossover edge problems due to small eigenvalues. The linear anisotropic diffusion character is made evident by having constant eccentricity for all the ellipses across the image. The term anisotropic used here is related to changing direction of the ellipse at each pixel due to the diffusion matrix eigenvector adaptability with the given local structure. Therefore, with each iteration, the ellipse does grow without changing the eccentricity ratio and for a given diffusion time, the size of the ellipse remains constant throughout the image. Since the major axis of the ellipse is parallel to the edge of the curve, so no harm in increasing it. The minor axis of the ellipse is aligned with the width of the curve. So increasing the ellipse minor axis will eventually make the ellipse protrude outside the boundary of the curve, and the disturbed structure is obtained, and that is precisely where the diffusion should stop eventually.
First, linear anisotropic diffusion process was applied to a clean curve image. The entropy and entropy change graphs as depicted in Fig. 7 b,c. Both graphs are smooth and wellbehaved, validating the notion that the linear anisotropic diffusion process is a lot like their isotropic counterparts. A prominent peak is located at Ï„=4 in the entropy change graph, representing the characteristic width of the curves present in the image. By stopping the diffusion process by that peak location, the diffused image is shown in Fig. 7 d. The image is largely undisturbed with small diffusion effects at the boundaries and ends of the curves. The quantitative measures, of sensitivity and specificity, for the output image, are computed as 82 and 89 %. The peak in entropy change graph, thus, presents itself as a suitable stopping time for the linear anisotropic diffusion process.
The experiment for linear anisotropic diffusion process was also conducted for an extremely noise situation. A Gaussian noise is added to the original curve image such that the resulting SNR is lowered to become âˆ’10 dB. The noisy curve image is displayed in Fig. 8 a. After the completion of the linear anisotropic diffusion process, the entropy change graph is obtained as depicted in Fig. 8 b,c, respectively. It is clearly observed that the curve for entropy change is steeply coming down in the beginning and then hits a bottom. After the minimum is reached, it rises again to display a peak at the characteristic width of the curves in the noisy image. The noise can be largely curtailed by stopping the diffusion process at the peak. The diffused image stopped by the peak is shown in Fig. 8 d. The image does show a large smoothing of the noise with minimum disturbance to the structure of interest. Thresholding the image by Otsu method, a final binarized image is obtained, as shown in Fig. 8 e. The quantitative measures of sensitivity and specificity for the binarized output image are recorded as 75 and 84 %.
6 Results and discussion for real fingerprint images
This section deals with real fingerprint images. We look into their acquisition process then process them for uniform background and later investigate their spatial entropy characteristic as the image evolves under linear anisotropic process. The first test that we performed is to check the anisotropic strength measure for the acquired fingerprint. Figure 9 shows the results of the test. It is observed that the regular ridge/valley pattern found in the fingerprint image is largely anisotropic in nature. This justifies the employment of linear anisotropic diffusion process for smoothing these images.
The acquired fingerprint images often show important illumination variations, poor contrast in some areas, and gaps in ridge/valley regions. To reduce the illumination imperfections and generate images more suitable for enhancement and minutia extraction, a preprocessing comprising the nonuniform illumination correction is applied. It occurs due to the very process of scanning a finger. The middle finger surface is thicker as compared to the surrounding region. This results in blocking the light in the middle while the outer surface is fairly highly illuminated. The fingerprint scanner registers this uneven illumination. Consequently, background variation will add bias for different regions of the same image to disturb the ridge/valley contrast. Since the ridge/valley pattern is identified and classified by its graylevel profile, this effect may worsen the performance of diffusion and disturb our spatial entropy analysis. With the purpose of removing this disturbing factor from our experimental analysis, a homomorphic filtering approach is adopted. The process is described below.
In basic terms, homomorphic filtering assumes that an image can be represented in terms of product of illumination and reflectance. That is
where L(x,y) is the fingerprint image, i(x,y) is the background illumination image, and r(x,y) is the reflectance image [29]. Reflectance r arises due to the object itself, but the illumination image i is independent of the object, is a pure representation of lighting conditions at the time of the image capture. To compensate for the nonuniform illumination, the illumination image part has to be made constant. Illumination is assumed to be slowly varying lending itself in the lowfrequency region as compared to the reflectance image that contains abrupt changes, showing a considerable highfrequency attitude.
For implementing homomorphic filtering, we first transform the multiplicative model of image formation to additive model by moving to the log domain.
Then, a lowfrequency filter is used with an appropriate cutoff to get a background illumination image i(x,y) estimate. The difference d(x,y) between original image L(x,y) and background illumination i(x,y) is calculated for every pixel,
To this respect, literature reports illuminationcorrection methods based on the subtraction of the background illumination image from the original image [30â€“32]. The background image is shown in Fig. 10. After subtraction, a grayish look image is obtained, as depicted in Fig. 10 b. Finally, an illuminatedcorrected image is obtained by transforming linearly new image pixels into the whole range of possible gray levels [0â€“1] using the linear stretch. Figure 10 c shows the new image corresponding to stretched and uniformly illuminated image. The proposed illumination correction algorithm is observed to reduce background intensity variations and enhance contrast in the middle region than the original fingerprint image. The method was validated for all the images that were processed in the database.
To validate the effect of the homomorphic filtering, the histogram analysis is investigated before and after homomorphic filtering stage. Histogram of an image represents the relative occurrences of the graylevel present in an image. According to [29, 33], the nonuniform illumination will modify the histogram of an image in a way that it can not be binarized by a single global threshold. For this purpose, the Otsu method [34] is used, which chooses the threshold to minimize the intraclass variance of the background and foreground, to compute the binary threshold for the original fingerprint and that of the uniformly illuminated image. The results are displayed in Fig. 11.
The uniformly illuminated fingerprint image is now fed to the linear anisotropic diffusion process. The image went through diffusion evolution process from a small scale \(\tau = \log (t)=3\) till \(tau = \log (t)=5\). The normal width of the ridges was found to be 9, with half the width equal to 4.5. The spatial entropy graph is depicted in Fig. 12. We see a smooth curve with ever increasing entropy values. The entropy change graph in Fig. 12 b displays a clear peak at \(\tau =\log (t)=1\), that results in t=2.13. The scale value t in fingerprint images is linked to the width of the ridges as proposed in [14]. By stopping the process at Ï„=1, a diffused image is obtained as shown in Fig. 12 c. If we let the diffusion process continue for long time (Ï„=5), we get a mean image as shown in Fig. 12 d.
What remains to be tested is the comparison of entropychange based stopping criterion with that of correlationbased method, presented in [35]. If the unknown additive noise n is uncorrelated with the unknown signal u(t), it could be reasonable to minimize the covariance of the noise u(0)âˆ’u(t) with the signal u(t). The covariance is represented by the correlation coefficient and is given by,
and choose the stopping time T so that the expression 31 is as small as possible.
Later on, the authors in [36] proposed to use the quality of the edges in the process of finding the optimal time to stop the diffusion process. To assess the quality of our fingerprint edge structures, the edge contrast measure is used which is defined in [37]. The edge quality index is referred to as the edge based contrast measure (EBCM). The EBCM is based on the observation that human perception mechanisms are very sensitive to contours (or edges). The larger the width of the edge pixels, the larger will be this quality index. In our diffusion process, the edges are larger in width due to the poor image quality, so this EBCM is larger at the beginning of the diffusion process. After certain iterations, the smoothness of the noise happens, and the edges improve with less width and a lower value for the EBCM. After reaching a certain minimum, the edges again starts to widen due to oversmoothing, and the corresponding EBCM values increase. The best stopping time could be the minimum of the EPCM values, as shown in Fig. 13.
Image enhancement for fingerprint images is essentially to raise the contrast of ridge/valley structure, such that enhanced version is more suitable for binarization that will eventually be used for automated identification system. To perform the evaluation of the real fingerprint image after diffusion, the third party minutia extractor as provided in [38] is used. The noisy acquired images were stopped at three different time instants due to correlation method, EPCM, and the proposed entropychange based, and the resulting three output diffused images were then compared quantitatively. Analysis of the diffused image yields a list of candidate minutiae. However, due to the use of nonoptimal stopping time, there are usually a large proportion of false minutiae, i.e. points that have been incorrectly identified as minutiae. This diffusion process directly affects the binarization which creates wrong minutiae, as shown in Fig. 14. Therefore, the total number of candidate minutiae detected in three types of diffused images indicate the relative degree of noisiness still present in them, and will cause false minutiae. Figure 15 depicts a comparison of fake minutiae of the proposed method with correlationbased and EBSM method. A Table 1 has been generated for the six test images from the university campus students, that indicate that correlation based stopping method and EPSMbased stopping criterion had detected considerable more minutiae, indicating the immature diffusion of the noisy input image. The correlationbased stopping generated on the average 350 minutiae per image (4 times the ground truth image) while EPSM provided 210 minutiae per image (2.4 times the ground truth). The proposed entropychange generated 145 minutiae per image (1.65 time ground truth).
Another set of experiments was conducted to assess the suitability of proposed stopping criterion for some extremely lowquality fingerprint images present in the FVC2004 database to assess the ultimate strength of the proposed stopping rule. One such challenging image is displayed in Fig. 17 c. The fingerprint shows broken ridges, salt and pepper noise, nonuniform illumination, and on top of it a dark square patch right at the center. The image was preprocessed first with small median filter of size 3Ã—3 to tackle salt and pepper noise, and was then made to go through homomorphic filtering to eliminate to a larger extent the nonuniform background variations.
After initial treatments, the image was passed on to a linear diffusion process to join broken ridges while avoiding the mixing of ridge/valley pattern. A modified coherence enhancing diffusion (CED) as suggested earlier in linear anisotropic section proves to be of little success for diffusing lowquality fingerprints. This is due to the finding that our earlier attempts at introducing constant eigenvalues with CED process (to transform CED into a linear anisotropic process) seems to inadequate for lowquality fingerprint image diffusions. The spatial entropy curve was found to be increasing in the beginning but show a dip in spatial entropy values towards the end (large logarithmic scales). A search was conducted to look into some recent robust variant of CEDs while dealing with lowquality fingerprints. The search culminated into a new class of diffusion process that was developed specifically for lowquality challenging fingerprints. The new process deploys a precomputed orientation field to transform the Coherenceenhancing diffusion process into that of linear oriented diffusion process [39], much more robust to the extremely noisy situations. The new process was studied with special care for its spatial entropy behavior while smoothing lowquality fingerprints. The spatial entropy was found to be monotonically growing quantity as a function of increasing logarithmic scale. This desirable behavior was found to be consistent across many database images that were tested here. The large part of the stable behavior for entropy graph can be attributed to the injection of precomputed orientation filed that was extremely helpful to steer the diffusion matrix in right direction in sensitive later stages of diffusion process, where large scales were involved. Specifically, the linear oriented diffusion process was adopted for experimentation here with two fixed eigenvalues as Î» _{1}=0.01 and Î» _{2}=1âˆ’0.01. The diffusion matrix was constructed as before:
but with one major change that is Î¸ is now precomputed orientation field from the use of directional filter bank framework for the image [40]. The orientation field Î¸ was kept constant in the whole evolution process. The diffusion process was evolved starting from scale \(\tau _{i}= \log (t=\exp (3))\) and reaching final scale\(\tau _{f}=\log (t=\exp (5.5))\) (providing mean value image) with a step size of \(t=\exp (3)\). The spatial entropy was computed along the way and reported to be growing entity with steady value at the end, as depicted in Fig. 16 d. The entropy graph contains a multitude of discontinuities corresponding to a small leftover noise particles in the fingerprint after preprocessing. The curve can be smoothed by fitting a piecewise spline while caring for some real big discontinuities. To do so, a smoothing spline function was fitted to the noisy entropy curve with a coarser soothing parameter of value 0.95 on a scale of [0,1]. The entropy change curve is constructed from fitted spline curve and is depicted in Fig. 16 e. It shows a number of peaks representing different structures dominating at different scales. There may well be some small broken parts of otherwise long ridges. The last peak at the farthest end represents the largest dominating structure that may be linked tom average ridge width of the fingerprint. By stopping the linear diffusion process at that peak Ï„=3.2, the diffused image is displayed in Fig. 16 f. The uneven image contrast can be straightforwardly improved using wellknown blockbased contrast enhancement scheme such as contrast limited adaptive histogram equalization (CLAHE) [41], to provide evenlycontrasted image, as in Fig. 16 g. The contrastadjusted image was then binarized with a blockbyblock process to result in Fig. 16 h. The binarized result shows a clear fingerprint with ridge/valley structure largely intact (minimum mixing of nearby ridges) with greatly diminishing the intensity of noise. Most of the genuine minutia points (ridge ending and bifurcation points) are still valid and can be easily detected by the subsequent extraction process.
To quantitatively assess the performance of proposed stopping rule for image diffusion, a measure goodness index (GI), was adopted from an earlier fingerprint image enhancement [42]. This goodness index (GI) is defined as follows:
where, p represents the paired minutiae (between the manually extracted and machine extracted), a represents the missing minutiae, b represents the spurious minutiae and t represents the true minutiae. The measure is suppose to give a number between 0 and 1. This goodness index is applied on Fig. 17 c. The GI without enhancement is found to be 0.34, with enhancing using CED [18] is 0.45 and after applying the proposed method is 0.52. A larger test is performed on the 40 images of FVC2000 DB4_B (101 to 105). The averaged GI without enhancement comes out to be 0.26, with enhancing using CED [18] is 0.37 and after applying the proposed method is 0.43.
The proposed stopping rule being an iterated process can be analyzed with its computation complexity profile. The stopping rule involves three nested loops. First one is the dowhile loop that let the process runs till it reaches the farthest peak in the entropy change graph, and the remaining two are FOR loops that span the dimensionality of the fingerprint. Therefore, an estimate of the computational complexity associated with the proposed stopping rule can be described as a product NÃ—MÃ—I T E R A T I O N S, where N and M represents the rows and columns of the fingerprint and ITERATIONS are the count of repetitions to reach the required peak. Since the peaks represent the dominating structure, which is this case is the width of the ridges, an experiment was conducted to see that linkage more explicitly. A sequence of same dimension fingerprint images was created by increasing zoom values and center cropping the resultant image. For each of these images, an identical linear diffusion scheme with precomputed orientation filed was run to locate the desired peak in their respective entropychange graphs. A plot in Fig. 17 is shown connecting logarithmic scale at which the process stopped and the average width of the ridges in the respective zoomed images. The graph in fig shows the dots, obtained from this experiment, and were fitted with a linear curve having 95 % confidence interval. The logarithmic scale, at which the diffusion process stopped, in turn, can provide the number of iterations knowing the step size involved in the diffusion process. Thus, given dimension of the input fingerprint and an estimate of the average ridge width, a reasonable guess at the computation complexity of the proposed stopping rule can be reached.
7 Conclusions
In this paper, the entropychange for an anisotropic diffusion of a fingerprint image is investigated. a unique peak is found, associated with blurring of the dominant structure. This provides a reasonable stopping rule for the anisotropic diffusion process, whose goal is to smooth the image without disturbing the structural information. The numerical results validated the existence of the boundary between undersmooth and oversmooth regions of anisotropic diffusion.
References
J Bernd, SpatioTemporal Image Processing, 1st, vol. 751 (SpringerVerlag, Berlin Heidelberg, 1993).
AZ Averbuch, FG Meyer, JO Stromberg, RR Coifman, A Vassiliou, Low bitrate efficient compression for seismic data. IEEE Trans. Image Process. 10(12), 1801â€“1814 (2001).
J Weickert, Coherence enhancing diffusion of colour images. Image Vis. Comput. 17:, 201â€“212 (1999).
TM Khan, MA Khan, Y Kong, Boosting CED using robust orientation estimation. Int. J. Multimedia Appl. 6(2) (2014).
MAU Khan, TM Khan, Fingerprint image enhancement using data driven Directional Filter. Bank. OptikIn. J. Light Electron Optics. 124(23), 6063â€“6068 (2013).
MAU Khan, A Khan, TM Khan, M Abbas, N Mohammad, in International Conference on Information and Emerging Technologies (ICIET). Fingerprint image enhancement using principal component analysis (PCA) filters (IEEEKarachi, 2010), pp. 1â€“6.
M Kaas, A Witkin, Analyzing oriented patterns. Comput. Vis. Graphics Image Process. 37:, 362â€“385 (1987).
MAU Khan, TM Khan, O Kittaneh, Y Kong, Stopping criterion for anisotropic image diffusion. OptikInt. J. Light Electron Optics. 127(1), 156â€“160 (2016).
G Hellwig, Partial differential equations (Teubner, Stuttgart, 1977).
IG Petrowsk, Vorlesungen uber partielle Differentialgleichungen (Teubner, Leipzig, 1955).
P Perona, J Malik, Scalespace and edge detection using anisotropic diffusion. IEEE Transa. Pattern Anal. Mach. Intell. 12(7), 629â€“639 (1990).
GH Cottet, L Germain, Image processing through reaction combined with nonlinear diffusion. Math. Comput. 61:, 659â€“673 (1993).
J Weickert, Anisotropic Diffusion in Image Processing (ECMI Series, TeubnerVerlag, Stuttgart, Germany, 1998).
A Almansa, LT Indeberg, Fingerprint enhancement by shape adaptation of scalespace operators with automatic scale selection. IEEE Trans. Image Process. 9:, 2027â€“2041 (2000).
TM Khan, MA Khan, Y Kong, Fingerprint image enhancement using multiscale DDFB based diffusion filters and modified Hong filters. OptikInt. J. Light Electron Optics. 125(16), 4206â€“4214 (2014).
MAK Khan, TM Khan, SA Khan, in 7th International Conference on Emerging Technologies. Coherence enhancement diffusion using MultiScale DFB (IEEEIslamabad, 2011), pp. 1â€“6.
M Nitzberg, T Shiota, Nonlinear image filtering with edge and corner enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 14:, 826â€“833 (1992).
J Weickert, Coherenceenhancing diffusion filtering. Int. J. Comput. Vis. 31:, 111â€“127 (1999).
D Chen, MacS Lachlan, M Kilmer, Iterative parameterchoice and multigrid methods for anisotropic diffusion denoising. SIAM J. Sci. Comput. 33:, 2972â€“2994 (2011).
A Ilyevsky, E Turkel, Stopping criteria for anisotropic PDEs in image processing. J. Sci. Comput. 45:, 333â€“347 (2010).
G Gilboa, N Sochen, YY Zeevi, Estimation of optimal PDEbased denoising in the SNR sense. IEEE Trans. Image Process. 15(8), 2269â€“2280 (2006).
G Gilboa, Nonlinear scale space with spatially varying stopping time. IEEE Trans. Pattern Anal. Mach. Intell. 30:, 2175â€“2187 (2008).
J Weickert, Scalespace properties of nonlinear diffusion filtering with a diffusion tensor Report No. 110 (Laboratory of Technomathematics, University of Kaiserslautern, P.O. Box 3049, 67653 Kaiserslautern, Germany, 1994).
M Ferraro, G Boccignone, T Caelli, On the representation of image structures via scale space entropy conditions. IEEE Trans. Pattern Anal. Mach Intell. 21(11), 1199â€“1203 (1999).
J Sporring, in Proceeding of ICPRâ€™96. The entropy of scalespace (SpringerWashington DC, 1996), pp. 900â€“9004.
J Sporring, The entropy of scalespace. Department of Computer Science / University of Copenhagen Universitetsparken 1 / DK2100 Copenhagen East Denmark, (1996).
AP Witkin, in Proc. of International Joint Conference on Arti?cial Intelligence (IJCAI). Scale space filtering, (1983).
JJ Koenderink, The structure of images. Biol. Cybernet. 50(5), 363â€“370 (1984).
RC Gonzalez, RE Woods, Digital Image Processing, 3rd ed (PrenticeHall, Inc., Upper Saddle River, NJ, USA, 2006).
AJ Frame, PE Undrill, MJ Cree, JA Olson, KC McHardy, PF Sharp, JV Forrester, A comparison of computer based classification methods applied to the detection of microaneurysms inophthalmic fluorescein angiograms. Comput. Biol. Med. 28(3), 225â€“238 (1998).
M Niemeijer, B van Ginneken, JJ Staal, MSASSMD Abramoff, Automatic detection of red lesions in digitalcolor fundus photographs. IEEE Trans. Med. Imaging. 24(5), 584â€“592 (2005).
B Zhang, X Wu You, Q Li, F Karray, Detection of microaneurysms using multiscale correlation coefficients. Pattern Recognit. 43:, 2237â€“2248 (2010).
M Sharma, A Kumar, Non uniform background illumination removal (NUBIR) from microscopic images. Int. J. Adv. Res. Technol. Eng. Sci. 1(2), 23â€“29 (2014).
N Otsu, A threshold selection method from graylevel histograms. IEEE Trans. Syst. Man Cybernet. 9(1), 62â€“66 (1979).
P Mrazek, Selection of optimal stopping time for nonlinear diffusion filtering. Int. J. Comput. Vis. 52(2), 189â€“203 (2003).
C Tsiotsios, M Petrou, On the choice of the parameters for anisotropic diffusion in image processing. Pattern Recognit. 46(5), 1369â€“1381 (2013). Article in Press.
A Beghdadi, AL Negrate, Contrast enhancement technique based on local detection of edges. Conpu. Vis. Graphics Image Process. 46:, 162â€“174 (1989).
MATLAB, MATLAB Central; 20015. MATLAB Central  MathWorks.
C Gottschlich, CBS Nlieb, Oriented diffusion filtering for enhancing lowquality fingerprint images. IET Biometrics. 1:, 105â€“113 (2012).
MAU Khan, K Ullah, A Khan, IU Islam, Robust multiscale orientation estimation: Directional filter bank based approach. Elsevier J. Appl. Math. Comput. 242:, 814â€“824 (2014).
K Zuiderveld, Contrast limited adaptive histogram equalization (Academic Press Professional, Inc., San Diego, CA, USA, 1994).
L Hong, Y Wan, A Jain, Fingerprint image enhancement: algorithm and performance evaluation. IEEE Trans. Pattern Anal. Mach. Intell. 20:, 777â€“789 (1998).
Acknowledgements
The authors would like to acknowledge the support of the Department of Engineering, Macquarie University, Sydney, Australia for the work presented in this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
All the authors of this paper declare that they have no significant competing financial, professional, or personal interests that might have influenced the performance or presentation of the work described in this manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Khan, T.M., U. Khan, M.A., Kong, Y. et al. Stopping criterion for linear anisotropic image diffusion: a fingerprint image enhancement case. J Image Video Proc. 2016, 6 (2016). https://doi.org/10.1186/s136400160105x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s136400160105x