 Research
 Open Access
 Published:
Segmentation method based on multiobjective optimization for very high spatial resolution satellite images
EURASIP Journal on Image and Video Processing volume 2017, Article number: 26 (2017)
Abstract
In this paper, a new multicriterion segmentation method has been proposed to be applied to satellite image of very high spatial resolution (VHSR). It is consisted of the following process: For each region of the grayscale image, a center of gravity has been calculated and it has been also selected a threshold for its histogram. According to a certain criteria, this approach has been based on the separation of the different classes of grayscale in an optimal way. The proposed approach has been tested on synthetic images, and then has applied to an urban environment for the classification of data in Quickbird images. The selected zone of study has been laid in SkhirateTémara province, northwest of Morocco. Which is based on the Levine and Nazif criterion, this segmentation technique has given promising results compared those obtained using OTSU and Kmeans methods.
Introduction
Segmentation is the technique and procedure used to divide the image into different nonoverlapping regions according to their characteristics. The pixel values in the same region have similar attributes while the pixel values from diverse regions have various features. Various methods have been developed and used with a relative success. They can be roughly classified into several categories according to the dominant features they employ, such as edgebased method [1], regiongrowing method [2], neural networks method, physicsbased method [3,4,5], and histogram thresholds method [6].
However, in some practical situations, solving segmentation problems need more information than what is contained in onesingle image band. In these cases, the use of several image color components or a multispectral image is necessary [7,8,9]. In practice, the application of such method, on a VHSR image, leads to inaccurate results. In certain specific cases, variant region of interest are classified to be homogenous, this is due to two main critical issues in color image segmentation: (1) what's the way segmentation method should be used?; and (2) what's the way color space should be adopted? [10]. It demonstrated that, for unsupervised classification problems, histogram thresholding is a suitable method for achieving good segmentation results with a low computation complexity for a wide class of images [4, 10].
In this case, a number of classification algorithms, based on 2D histogram analysis, are obtained by multidimensional histogram projection which are focused on two color procedures. These algorithms have been elaborated and used successfully [7,8,9, 11].
This work proposes a method that focuses on the separation of different classes of grayscale in an optimal way according to some criterion, using typical techniques of image segmentation. We calculate the center of gravity for each region of the grayscale image and the threshold of its histogram [7,8,9]. In order to show the feasibility of the proposed method, firstly, we will compare our approach with OTSU and Kmeans methods by testing and applying them on synthetic images. Secondly, we will evaluate our algorithm on land cover and land use classification using a satellite image of a selected urban zone.
This task confirm that the segmentation technique provides better results when it is established on a combination of criteria. Thus, the diversity of images to which it could be applied successfully. At the same time, it reveals the weakness of the criteria when it' s used separately, without being combined.
The first chapter of this article presents the proposed multicriteria segmentation approach. The second one describes the multiobjective function. The third one presents the VHSR satellite image we used in this study. The fourth chapter introduces the criterion of Levine and Nazif, and the last one reveals the experimental outcomes and the discussion.
Description of the method
Multiobjective optimization extends from the theory of optimization by allowing several design goals to optimize simultaneously. A multiobjective optimization problem is solved in a way similar to the simple objective classic problem. The goal is to find a set of values for the design variables that simultaneously optimize several objective functions (or costs). In general, the solution obtained by the separated optimization of each objective (simple objective optimization) does not represent a possible solution for the multiobjective problem.
The proposed approach in [12] is justified by the simple reason that, in almost all cases, the segmentation process, based on the optimization of one criterion only, does not work very well for many images. Frequently, the optimal value of the threshold for each criterion does not produce satisfactory image segmentation. Here, we propose optimal thresholds that allow optimizing a set of criteria. The method of thresholding was based on three criteria:

1.
The modified withinclass variance criterion,

2.
The overall probability of error criterion, and

3.
The entropy criterion.
The identification of these three criteria in the thresholding algorithm requires the introduction of three parameters: w _{1} , w _{2} , and w _{3}, see eq. (7) and the detail of which we shall see later.
Our aim is to increase the information about the position of the optimal threshold that allows us to obtain the correct segmentation.
In this subsection, we present the different criteria that we will minimize later for the process of multilevel image thresholding. Functions (criteria) that we chose are the modified withinclass variance, the overall probability of error and the entropy.
Modified withinclass variance criterion
Thresholding based on withinclass variance tends to classify an image as the object and the background of similar sizes. In order to overcome this drawback, an objective function was derived from the classical withinclass variance criterion; some a priori knowledge about the characteristics of the resulting segmentation, such as uniformity or homogeneity, of the regions and simplicity of the interiors of the regions was introduced. The proposed modification consists, in the integration in the criteria, of the ideal segmentation properties. The criterion expressing the uniformity and the homogeneity of the regions is the withinclass variance criterion, defined as follows:
And we assume that the number NR of regions is two.
α is given by \( \frac{1}{10000\mathbf{XM}}\sqrt{\mathbf{NR}} \) where M is the image size.
\( {\boldsymbol{\beta}}_{\boldsymbol{j}}=\frac{1}{1+\mathrm{Log}\left({\boldsymbol{N}}_{\boldsymbol{j}}\right)} \), N _{ j } denotes the number of pixels in the region j.
\( {\boldsymbol{\gamma}}_{\boldsymbol{j}}={\left(\frac{\boldsymbol{R}\left({\boldsymbol{N}}_{\boldsymbol{j}}\right)}{{\boldsymbol{N}}_{\boldsymbol{j}}}\right)}^2 \), and R(N _{ j }) is the number of the regions of which cardinal is equal to N _{ j }.
Var(j) is defined as (www.cpe.eng.cmu.ac.th/wpcontent/uploads/CPE752_08.pdf):
With
j is the number of region; P _{ j } is the probability of class j; m _{ j } is mean intensity of the pixels in class j; m _{ G } is the global mean; p _{ i } is the probability density function of different pixels of the image; h(i) is the number of occurrences of the gray level of pixel i ∈ [0, L − 1], and L is the total number of grayscales.
Overall probability of error criterion
We assume that the histogram is properly set up using the Gaussian probability density function. Then, the optimal threshold is determined by minimizing the overall error probability. For two successive Gaussian probabilities of density functions, the function was been given by
i = 1; 2;…; d−1 with respect to the threshold T _{ i },
Then, the overall probability to minimize is
Where T is the vector of thresholds: 0 < T1 < T2 < … < Td−1 < 255.
Entropy criterion
The entropy of the two classes A and B are defined by
and the total entropy is
The first problem with this approach, highlighted by Pal [13], is that the entropy Shannon is not defined for probability densities including zero probabilities. Pal and Pal then proposed a new definition of entropy based on exponential gain information:
Objective function
The multiobjective function applied to two thresholds images (like medical images) by Nakib [12] is defined as follows:
Obviously, this function has certainly been successful but it showed its limits. For that reason, we thought about introducing another factor such as entropy.
Therefore, for the multithreshold images, we propose to modify this objective function (6) by introducing the entropy information, which we can take into account as follows:
Where T is the vector of thresholds: 0 < T_{1} < T_{2} < … < T_{d1} < 255.
In addition, the weighting parameters given by

○ For the function MOBJ1 (6): w _{1} = 1 − w _{2}

○ For the function MOBJ2 (7): w _{1} = 1 − w _{2} − w _{3}
Where d is the number of the Gaussians; σ _{ i } is the standard deviation of the ith Gaussian probability density function; and σ _{Histogram} is the standard deviation of the original histogram. The weighting parameters (w _{1} , w _{2} , and w _{3}) allow touching the boundary of the feasible domain. This operation was used when the goal of the segmentation is to extract the target from the original image.
Quickbird image data
The Quickbird image (Figs. 1 and 2) retained for this work is a selected urban zone of the SkhirateTémara province, in the northwest of Morocco, delimited by longitude φ _{1} = 6°57′58.87″ W and latitude λ _{1} = 33°55′35.99″ N and covers about 90 Km^{2}. This image was captured on June 15, 2006. We used the panchromatic band and the multispectral band (see the characteristic in Table 1).
Levine and Nazif evaluation of criteria
One of the most intuitive criterions being able to quantify the quality of a segmentation result is the intraregion uniformity. Weszka and Rosenfeld [14] propose such a criterion with thresholding that measures the effect of noise to evaluate some thresholded images. Based on the same idea of intraregion uniformity, Levine and Nazif [15] also defined a criterion that calculates the uniformity of a region characteristic based on the variance of this characteristic [16]:
Where

(I).
I _{ R } corresponds to the segmentation result of the image in a set of regions R = {R _{1},…,R _{NR}} having N _{ R } regions,

(II).
Card(I) corresponds to the number of pixels of the image I,

(III).
g _{ I }(s) corresponds to the graylevel intensity of the pixels of the image I and can be generalized to any other characteristic (color, texture …).
Sezgin and Sankur [17] proposed a standardized uniformity measure. Based on the same principle, the measurement of homogeneity of Cochran [18] gives a confidence measure on the homogeneity of a region. However, this method requires a threshold selection that is often arbitrarily is done, limiting thus the proposed method. Another criterion to measure the intraregion uniformity is developed by Pal and Pal [19]. It is based on a thresholding that maximizes the local secondorder entropy of regions in the segmentation result. In the case of slightly textured images, these criteria of intraregion uniformity prove to be effective and very simple to use. However, the presence of textures in an image often generates improper results due to the over influence of small regions.
Complementary to the intraregion uniformity, Levine and Nazif [15] defined a disparity measurement between two regions to evaluate the dissimilarity of regions in a segmentation result. The formula of total interregion disparity was defined as follows:
where \( {w}_{R_k} \) is a weight associated to R _{ k } that can be dependent of its area, for example, \( \overline{g} \) k is the average of the graylevel of R _{ k }. \( {\overline{g}}_I\left({R}_k\right) \) can be generalized to a feature vector computed on the pixel values of the region R _{ k } such as for LEV1. \( {p}_{R_k\backslash {R}_j} \) Corresponds to the length of the perimeter of the region R _{ k } common to the perimeter of the region R _{ j }. This type of criterion has the advantage of penalizing the over segmentation. (Formula intrainter region)
Note that the intraregion uniformity can be combined with the interregion dissimilarity by using the following formula:
where \( {C}_{N_R}^2 \) is number of combinations of two regions among N _{ R }.
This criterion [20] combines intra and interregion disparities. Intraregion disparity is computed by the normalized standard deviation of gray levels in each region. The interregion disparity computes the dissimilarity of the average gray level of two regions in the segmentation result.
Haralick and Shapiro [21] consider that

(I).
The regions must be uniform and homogeneous,

(II).
The interior of the regions must be simple without too many small holes,

(III).
The adjacent regions must present significantly different values for the uniform characteristics, and

(IV).
Boundaries should be smoothed and accurate.
Contribution of the new multiobjective function
The improvement of the objective function requires on the way to identify the contribution of our method. We precede by a comparison between two eqs. (6) and (7).
So, in this section, we will compare our new multiobjective function MOBJ2 with that of Nakib MOBJ1 so the introduction of entropy in the multiobjective function, and after several test of this function on synthetic images and on high spatial resolution images, clearly, we could observe the positive contribution to the segmentation process. The result of the segmentation is obviously amazing (see Fig. 3), and this is well justified of course through the assessment criteria obtained in Table 2.
Experimental results and discussion
Thresholding based on withinclass variance tends to classify an image as the object. The experiments presented here concern the pixel classification of both a synthetic image and the classification of our Quickbird image in the different land cover and land use classes.
In order to evaluate the proposed technique, we conducted the first phase of experimentation on synthetic images. We have chosen a first image, which contains a texture to study the influence of small regions. We noticed that the interregion, the intraregion, and the intrainterregion criterion values of our proposed method are lower than those provided by Otsu’s one. The same findings were obtained when processing other synthetic images having different morphological properties. Figure 4 presents the segmented results for synthetic images, and Fig. 5 presents the segmented results for panchromatic images. Also, to evaluate the proposed technique, we have used the Levine and Nazif evaluation of criteria. From Table 3, it can be seen that the proposed method performs better than Otsu’s method.
The second phase of experimentation was conducted on a set of summary images with a VHSR (panchromatic image with a spatial resolution of 0.61m × 0.61m). While adjusting the threshold and the filter coefficients to segment each image, we also calculated their centers of gravity as well as their uniformity criterion of intraregion and intrainter region of Levine and Nazif. This was done for the multicriteria method and the Otsu method.
To evaluate quality of segmentation results in the case of real images, which usually contains several unknown degradations, the second phase of this comparative experimental study conducted as a result and evaluated using a real gray level image and a set of VHSR satellite images. We could infer from obtained evaluation criterion values (Table 3), which remains constantly inferior to those obtained when using Otsu’s algorithm, that the multiobjective optimization method provides more stable and reliable results especially in the case of highresolution satellite images.
Conclusions
In this work, we proposed a new multicriterion segmentation method based on the separation of different classes of gray levels in an optimal way according to certain criteria and applied it to VHSR satellite images. Therefore, we implemented a segmentation method based on multiobjective optimization function MOBJ2 developed and take account of entropy. We tested the function with respect to that of Nakib MOBJ1 while appealing to Levine and Nazif evaluation criteria and gave good results.
We applied the MOBJ2 according to the segmentation of multiclass images such as synthetic images and samples of panchromatic image of VHSR in order to assess the MOBJ2 function compared to that of the OTSU and the Kmeans available MATHLAB. The evaluation of the segmentation by introducing Levine and Nazif assessment criteria shows that the multiobjective function developed is better than the OTSU method and the Kmeans.
Abbreviations
 LEV1:

The formula that calculates the uniformity of intraregion based on the variance of this characteristic
 LEV2:

The formula that calculates the interregion disparity total
 LEV3:

The formula that calculates the combination of the intraregion uniformity and the interregion disparity
 MOBJ1:

The multiobjective function applied to two threshold images by Nakib
 MOBJ2:

Our multiobjective function applied to images with at least two thresholds
 VHSR:

Very high spatial resolution
References
 1.
B. A. Maxwell and S.A. Shafer, Physics based segmentation: looking beyond color, Proceedings of Image Understanding Workshop, 1996
 2.
B Bouda, L Masmoudi, D Aboutajdine, CVVEFM: Cubical voxels and virtual electric field model for detection in color images. Signal Process. 88, 905–915 (2008). Elsevier
 3.
M Ortega, Y Rui, K Chakrabarti, A Warshavsky, S Mehrotra, TS Huang, Supporting ranked boolean similarity queries in MARS. IEEE Trans. Knowl. Data Eng. 10(6), 905–925 (1998)
 4.
A Clement, B Vigouroux, Unsupervised segmentation of scenes containing vegetation (Forsythia) and soil by hierarchical analysis of bidimensional histograms. Pattern Recogn. Lett. 24, 1951–1957 (2003)
 5.
L Vincent, P Soille, Watersheds in digital spaces: an efficient algorithm based on immersion simulation. IEEE Trans. Pattern Anal. Mach. Intell. 13(6), 583–598 (1991)
 6.
CM Onyango, JA Marchant, Physics based color image segmentation for scenes containing vegetation and soil. Image Vis. Comput. 19, 523–538 (2001)
 7.
R Zennouhi, L Masmoudi, A new 2Dhistogram scheme for colour image segmentation. Imaging Sci. J. 57, 260–365 (2009)
 8.
S Mechkouri, R Zennouhi, L Masmoudi, J Gonzalez, Colour image segmentation using hierarchical analysis of 2Dhistograms: application to urban land cover and land use classification. Geo Observateur 18, 43–57 (2010)
 9.
S Mechkouri, R Zennouhi, S El Joumani, L Masmoudi, J Gonzalez, Quantum segmentation approach for very high spatial resolution satellite image: application to Quickbird image. J. Theor. Appl Inf Technol 62(2), 539–545 (2014)
 10.
HD Cheng, XH Jiang, Y Sun, J Wang, Color image segmentation: advances and prospects. Pattern Recogn. 34, 2259–2281 (2001)
 11.
O Lezoray, H Cardot, Hybrid color image segmentation using 2D histogram clustering and region merging, in ICISP, vol. 1, 2003, pp. 22–29
 12.
A Nakib, H Oulhadj, P Siarry, Image histogram thresholding based on multiobjective optimization. Signal Process. 87, 2516–2534 (2007)
 13.
NK Pal, SK Pal, Entropy: a new definition and its applications. IEEE Trans. Syst. Man. Cybern. 21, 1260–1270 (1991)
 14.
JS Weszka, A Rosenfeld, Threshold evaluation techniques. IEEE Trans. Syst. Man. Cybern. 8(8), 622–629 (1978)
 15.
MD Levine, AM Nazif, Dynamic measurement of computer generated image segmentations. IEEE Trans. Pattern Anal. Mach. Intell. 7(2), 155–164 (1985)
 16.
S Chabrier, B Emile, C Rosenberger, H Laurent, Unsupervised performance evaluation of image segmentation, Special Issue on Performance Evaluation in Image Processing. EURASIP J. Appl. Signal Process. Vol. 2006 Article ID 96306, 112, (2006)
 17.
M Sezgin, B Sankur, Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imaging 13(1), 146–168 (2004)
 18.
WG Cochran, Some methods for strengthening the common X ^{2} tests. Biometrics 10, 417–451 (1954)
 19.
NR Pal, SK Pal, Entropic thresholding. Signal Process. 16(2), 97–108 (1989)
 20.
C Rosenberger, Mise en œuvre d’un système adaptatif de segmentation d’images, PhD. thèses (Université de Rennes1, Rennes, 1999)
 21.
RM Haralick, LG Shapiro, Image segmentation techniques. Comput Vis Graph Image Process 29(1), 100–132 (1985)
 22.
The sample images are taken from the website: http://pages.upf.pf/Sebastien.Chabrier/ressources.php, http://pages.upf.pf/Sebastien.Chabrier/download/ImSynth.zip
Acknowledgements
Since 2007, this satellite image has been used for several research projects. Consequently, all LETS/Geomatic PhD students who use this satellite image in their research work always express their thanks to the Spanish Agency for International Cooperation which has financed the acquisition of this image in 2007.
Funding
We do not have any funding for this work.
Authors’ contributions
The authors’ contributions for this work are as follows: OE suggests the multiobjective function idea and participates at the automatization program. SE and SEM carried out the development of image segmentation algorithm based on the revised multiobjective function (MOBJ1 and MOBJ2) and participated in the design of the study, and performed the experimentation of this algorithm for the assessment of the multiobjective function. RZ carried out the algorithm of thresholding program and helped for the choice of the evaluation criteria. SEM conceived of the study and participated in its design and coordination, and helped to draft the manuscript. Moreover, of course, the work conducted under the direction of our Professor LM. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Author information
Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
El Joumani, S., Mechkouri, S.E., Zennouhi, R. et al. Segmentation method based on multiobjective optimization for very high spatial resolution satellite images. J Image Video Proc. 2017, 26 (2017). https://doi.org/10.1186/s1364001601612
Received:
Accepted:
Published:
Keywords
 Segmentation
 Multicriterion
 Entropy
 Otsu
 Kmeans
 Satellite image VHSR (Quickbird)
 Levine and Nazif criterion