Skip to main content

Segmentation of epithelial human type 2 cell images for the indirect immune fluorescence based on modified quantum entropy

Abstract

The autoimmune disorders such as rheumatoid, arthritis, and scleroderma are connective tissue diseases (CTD). Autoimmune diseases are generally diagnosed using the antinuclear antibody (ANA) blood test. This test uses indirect immune fluorescence (IIf) image analysis to detect the presence of liquid substance antibodies at intervals the blood, which is responsible for CTDs. Typically human alveolar epithelial cells type 2 (HEp2) are utilized as the substrate for the microscope slides. The various fluorescence antibody patterns on HEp-2 cells permits the differential designation-diagnosis. The segmentation of HEp-2 cells of IIf images is therefore a crucial step in the ANA test. However, not only this task is extremely challenging, but physicians also often have a considerable number of IIf images to examine.In this study, we propose a new methodology for HEp2 segmentation from IIf images by maximum modified quantum entropy. Besides, we have used a new criterion with a flexible representation of the quantum image(FRQI). The proposed methodology determines the optimum threshold based on the quantum entropy measure, by maximizing the measure of class separability for the obtained classes over all the gray levels. We tested the suggested algorithm over all images of the MIVIA HEp 2 image data set.To objectively assess the proposed methodology, segmentation accuracy (SA), Jaccard similarity (JS), the F1-measure,the Matthews correlation coefficient(MCC), and the peak signal-to-noise ratio (PSNR) were used to evaluate performance. We have compared the proposed methodology with quantum entropy, Kapur and Otsu algorithms, respectively.The results show that the proposed algorithm is better than quantum entropy and Kapur methods. In addition, it overcomes the limitations of the Otsu method concerning the images which has positive skew histogram.This study can contribute to create a computer-aided decision (CAD) framework for the diagnosis of immune system diseases

1 Introduction

In recent years, much automation machinery was designed for all the most important steps in the IIf images analysis [18]. Classification models and techniques are used to recognize the mitotic cells, quantify the fluorescence intensity, and categorize the fluorescent patterns. Image segmentation is one of the first important and difficult steps during a computer-system diagnostic system using the IIf images. The approaches of cell HEp-2 segmentation is divided into 3 classes. The first class is the simplest procedure; it is supported by a thresholding result from morphological operations [9, 10]. This method has restricted accuracy in the cells detection with non-uniform intensity patterns (e.g., light and dark areas in the same cell). The second class tries to overcome the limitation of the first class by splitting segmentation method into two or several steps (see [3, 5, 8]) or by utilizing the watershed algorithm [6]. In these approaches, there are several parameters dependent on the data sets, and they do not address the segmentation of complex models [3, 11]. Finally, the third proposed approach is primarily based on the strategies of machine learning classification [7]. Generally, the techniques of Cell HEp-2 segmentation are evaluated on IIf images, which have complete distinct characteristics regarding the resolution, the contrast, and the level of noise and fluorescent patterns. In [7], the most significant segmentation techniques are assessed on IIf image database. The results of the assessments show that the segmentation accuracy of HEp-2 cells with completely distinct intensity levels and fluorescence patterns remain challenging. Several studies confirmed that diagnostic responsibility is severely affected by judgment, and also the variability of human analysis, thus requiring automatic identification techniques [1214]. Quantum computing (QC) is a novel field that combines information processing and physics. The difficult task is the secret writing data of quantum objects (called qubits). Nowadays, the quantum computer is far from complete. That being said, several existing classical computation algorithms can be improved by quantum computing, as it is. New techniques for quantum information processing are based on quantum machine learning, such as quantum state classification. It is one among quantum computing perspective [15]. The quantum information system (QIS) is a domain which becomes visible from previous the science of information and physics. Besides, QIS has transformed information science [16]. Existing algorithms for image processing can be improved by quantum mechanics of mathematical modeling [17]. The power of quantum computation can help to overcome many difficult tasks for classical computers. The information theory can consider as quantum computation applications [18]. Image processing has been studied extensively in classical computers [19]. Due to quantum parallelism, quantum computers could reduce the time complexity of linear, or even exponential algorithms that are run on classical computers [2025]

In the literature, most research is concerning the image process operations, such as, representation, image retrieval [26], and storage and geometric transformations [27, 28]. In [29], the author proposed an algorithmic program based on the quantum signal process to find the image edge in a medical image. Also, Chenggang Yan et al. [30] proposes a method for estimating 2D layout and estimating 3D layout. The 2D layout estimation, is essentially a semantic edge detection based on the Pyramid Scene Parsing Network (PSPNet) [31]. The 2-layout estimation proposed as a regression problem of three types of edges. In [30], the authors confirmed that the results of their method are sharper than that of semantic transfer [32]. In [33, 34], Eldar and Oppenheim are first instructed quantum signal process systems. The entropy is a tool to measure the data information in a digital image from the perspective of quantum informatics. In [21] the author proposed an algorithm for image thresholding using quantum entropy (QE). Additionally, the authors show that the advantages of quantum entropy than Shannon entropy. Also, QE is more accurate than Shannon entropy to measure image information.

The authors in [35] developed a new approach to image edge detection based on quantum entropy. When we tested the same methodology to segment the H2p-cells, we had unsatisfactory results which is clear in our simulations examples. Then, we developed another methodology based on quantum entropy modified with a new criteria (function) (equations 20 and 21). The new proposed methodology gave a good result compared to the other classical methods such as the Otsu and Kapur method. This study is structured as follows. In Section 2, digital images quantization (quantum entropy measures, optimal threshold selecting utilizing the proposed criterion, quantum state description for a gray scale image) was presented. Materials and methods (image segmentation algorithm base on modified quantum entropy, description of MIVIA HEp2 set, performance measures) are presented in Section 3. In Section 4, experimental results and discussion (numerical examples) the optimal are presented. Finally, Section 5 concludes with a summary of our work.

2 Digital image quantization

Quantum computing manipulates and analyses quantum objects (qubits) to solve computational problems. Quantum theory explains our observations at the quantum level when Newton’s mechanics prove to be insufficient. Quantum computing utilizes the electrons, and photons which allows for more efficient of data handling on a tiny scale [18, 36]. Qubits are quantum objects, which have two distinct states and can also be in both states at the same time (principle of superposition).A bit in a classical computer is analogous to a qubit in a quantum system. In the notation of the quantum states, the general noiseless qubits look like:

$$ |\psi\rangle = \alpha |0\rangle + \beta|1\rangle $$
(1)

where α and β, are arbitrary complex numbers with |α|2+|β|2=1 α, β are probability amplitudes and ψ is arbitrary superposition (linear combinations) of the twos states |0〉 and |1〉. Using the Dirac notation, |0〉 and |1〉 states are called kets. There are a number of quantum image representations that a quantum computer may use. Similar to pixel representations on traditional computers, quantum computers use flexible representation of quantum images (FRQI), multi-channel representation for quantum image (MCQI), and novel enhanced quantum representation of digital images (NEQR) to convert an image into quantum representation [3641]. In [21], the author presents a novel technique that uses maximum quantum entropy to detect of suspicious regions in digital mammograms; in [35], the authors developed a new approach to image edge detection based on quantum entropy. In this paper, we used the FRQI to represent an image. We keep that line of research and developed a modified of quantum entropy to segment the HEp2 cell images. This technique helps store classical images in quantum computer representations that recognize the colors and the corresponding positions of the image’s pixels. A flexible representation of a quantum image (FRQI) has proposed by the authors [36]. This is an essential step to being able to use quantum techniques on any classical image. FRQI is define as:

$$ \begin{aligned} | \psi \rangle & = \frac { 1} { 2^{ n} } \sum\limits_{ i = 0 }^{ 2^{ 2 n} - 1} \left| c_{ i} \right\rangle \otimes | i \rangle \\ & = \frac { 1} { 2^{ n} } \sum\limits_{ i = 0 }^{ 2^{ 2 n} - 1} \left(\cos \theta_{ i} | 0 \rangle + \sin \theta_{ i} | 1 \rangle \right) \otimes | i \rangle \end{aligned} $$
(2)

In this process, the qubits in the quantum image correspond to the pixels by:

$$ \| | \psi \rangle \| = \frac { 1} { 2^{ n} } \sqrt { \sum\limits_{ i = 0 }^{ 2^{ 2 n} - 1} \left(\cos^{ 2} \theta_{ i} + \sin^{ 2} \theta_{ i} \right)} = 1, $$
(3)

where \( \theta = \left (\theta _{ 1}, \theta _{ 2}, \ldots, \theta _{ 2^{ 2 n} } - 1 \right)\) and θi[0,π/2] is the angle vector that encodes the color information. The color of each pixel in an image is:

$$ \left| c_{ i} \right\rangle = \left(\cos \theta_{ i} | 0 \rangle + \sin \theta_{ i} | 1 \rangle \right) $$
(4)

and the states

$$ | i \rangle = | 0 \rangle, | 1 \rangle, | 2 \rangle, \downarrow, \cdot, \left| 2^{ 2 n} - 1 \right\rangle $$
(5)

represent the position in a sequences of base state of number of qubits. Now, we show how to use the FRQI model in a normalized wave function |ψ〉 and obtain the density matrix ρ, from which we are able to calculate the von Neumann entropy. According to this model, the wave function is composed of the qubit of color qc characterized by the parameter θ[0,π/2] and the mesh of qubits of position |i>. Using a transformation [0,255] to the domain [0,π/2], we have \(\theta _{ i} = (\text { color})_{ i} \times \frac { \pi } { 2} \times \frac { 1} { 255 }\) and qc=|ci〉= sin(θi)|1〉+ cos(θi)|0〉. In this process, a qubit in the quantum image corresponds to a pixel by:

$$ |(\psi\rangle = \cos(\theta_{m}) |0\rangle + \sin(\theta_{m})|1\rangle $$
(6)

where \( \theta _{m} \in \left [0,\frac {\pi }{2}\right ],m=o,1,\ldots,2n-1\). The Bloch sphere representation of a qubits. Suppose f(i,j) are normalize pixels values of the original gray scale image. \(f\left (i,j\right)\in \left [0,\frac {\pi }{2}\right ]\), where (i,j) are pixels coordinates, with \(\theta _{m}=\frac {\pi }{2} f\left (i,j\right) \) equation 6 can be rewritten as:

$$ |\left(\psi\rangle = \cos\left(\frac{\pi}{2} f\left(i,j\right)\right)|0\rangle + \sin\left(\frac{\pi}{2}f\left(i,j\right)\right)\right) + |1\rangle $$
(7)

We can represent any gray scale image as a two-level quantum system using Eq. 7. This allows us to use any quantum algorithms on the image.

2.1 Quantum entropy measures

Quantum entropy measures (QEM) estimate the the uncertainty of a quantum state. Shannon entropy used to measure the amount of information for a variable. Given a quantum system, Ψ> that has N states |ψ1〉,|ψ2〉,….|ψN〉 where the N states have probabilities P1,P2,…,PN, quantum information system can be communicated as:

$$ |\psi_{1}\rangle,|\psi_{2}\rangle,\ldots.|\psi_{N} \rangle \\ \text{with}\,\, P_{1},P_{2},\ldots,P_{N} $$
(8)

The density operator of a quantum information system is given by:

$$ \rho=\sum\limits_{i=1}^{N} P_{i} | \psi_{i} \rangle \langle \psi_{i}|. $$
(9)

Quantum entropy for a quantum information system Ψ〉 is given by [42, 43]:

$$ S(\rho)=-tr(\rho\log(\rho)) $$
(10)

where |> is the ket of Dirac notations and ρ indicates the density matrix of the quantum |Ψ〉 system. With 0 log0=0 when ρ=0, quantum entropy (QE) can measure the non-neighborhood relationship between quantum frameworks or quantum bases. The Shannon entropy is not as accurate as quantum entropy (QE), where Shannon entropy is defined by:

$$ H(X)=H(p_{1},p_{2},\ldots,p_{N})=\sum\limits_{j=1}^{N}p_{j}\log(p_{j}) $$
(11)

where p1,p2,…,pN are probabilities of the variable X. We consider the connections between the pixels in digital images as the cross-correlations of qubits in quantum systems. The quantum entropy of the digital image can take relationship properties among pixels into the calculation whereas Shannon entropy is powerless [35, 44]. The quasi-threshold that leads to maximum quantum entropy converges to the perfect threshold, where the maximum sum of information obtained under these conditions.

2.2 Optimal threshold selecting utilizing the proposed criterion

Accept that the 8-bit profundity interesting gray-scale image comprises of pixels. The pixels found at (i,j) positions with its gray scale value. Probabilities of each gray scale are calculated as:

$$ p_{i}=\frac{{\sum\nolimits}_{i=1}^{L}f_{i}}{MN} $$
(12)

where L,indicate numbers of the pixels and fi are the gray scale values of pixel i. At that point, 256 angles are characterized as taking after to encode 256 gray scales.

$$ \theta_{m}=\frac{\pi}{2}p_{m}=\frac{\pi{\sum\nolimits}_{j=1}^{m}f_{j}}{2 N M} $$
(13)

QE of the jth quasi-segment is gotten by S(ρ)=−tr(ρ log(ρ)) and the esteem of QE of quasi-segments is:

$$ S(\rho)=\sum\limits_{m=1}^{j-1}S(\rho_{m}) $$
(14)

2.3 Quantum state description for a gray scale image

Let us take n is the quasi-segments and the quasi-thresholds are signified by t1,t2,…,tn−1. In this case the quantum state of the mth quasi-segment is

$$ |I_{m}(\theta)\rangle= \sum\limits_{j=0}^{m-1}{\cos(\theta_{j})|\rangle+|\sin\left(\theta_{j}\right)|\rangle} $$
(15)

where m=1,2,…,2n−1, and density operator of the mth quantum state is calculated as:

$$ \rho_{m}=P_{m}|I_{m}(\theta)\rangle\langle I_{m}(\theta)| $$
(16)

where \(P_{m}={\sum \nolimits }_{i=1}^{m}p_{i}\), and pi calculate by Eq. 12. QE of the mth quasi-segment, specifically, S(ρm) is accomplished by Eq. 13, and gross value of QE of these m quasi-segments is accomplished as:

$$ S(\rho)=\sum\limits_{j=1}^{m}S(\rho_{j}) $$
(17)

Then values of final thresholds t1,t2,…,tn are obtained from quasi-thresholds which lead to the maximum esteem of S(ρ), namely, values of final thresholds Tj=tj if and only if the condition of S(ρ)=max(Sρ) is satisfied. Let IM denote a gray scale image with M gray levels [0,1,…,M-1]. The number of pixels with gray level i denoted by ni and N equal to the total number of pixels (N=n0+n1+….+nM). The probability of gray level j showed up within the image is defined as: \(p_{j}=\frac {n_{j}}{N},p_{j} > 0,{\sum \nolimits }_{j=0}^{N} p_{j}=1\) assume the pixels of the image are separated into two classes O and B by a gray level s. O is the pixels with levels { 0,1,…,s }, and the rest of the pixels belongs to B, where O and B are typically corresponding to the object class and the background one \(P_{O}=\frac {p_{1}}{W_{1}},\frac {p_{2}}{W_{2}},\ldots..\frac {p_{s}}{W_{s}}\) and \(P_{B}=\frac {p_{s+1}}{W_{s+1}},\frac {p_{s+2}}{W_{s+2}},.., \frac {p_{M-1}}{W_{M-1}}\) where \(W_{1}(s)={\sum \nolimits }_{i=0}^{s}p_{i} \) and W2(s)=1−W1(s) and s is the threshold value. According to the definition of QEM, the density operator of background pixels and the object region pixels can characterize as follows:

$$ \rho_{j}=|I_{j}(\theta)\rangle P_{j} \langle I_{j}(\theta)|, \,\,\text{where}\,\, j=O,B $$
(18)

And the quantum entropy measure (QEM) of background pixels and the object region pixels are

$$ S(\rho)=S(\rho_{O})+S(\rho_{B}) $$
(19)

The QEM S(ρ) is parametrically dependent on the threshold value t for the object and background. When S(ρ) is maximized, the luminance level t is considered as the optimum threshold value. In this work, we have proposed a new criterion for QEM as the following:

$$\begin{array}{*{20}l} S(\rho)&=S(\rho_{O})+S(\rho_{B})+ (1-q)^{\alpha} \text{max} [0,S(\rho_{O})S(\rho_{B})], q \in ]0,1 [ \end{array} $$
(20)
$$\begin{array}{*{20}l} S(\text{opt})&=\text{argmax}[S(\rho)] \end{array} $$
(21)

and the maximum value of S(ρ) is the image thresholding.

3 Materials and methods

In the following, the algorithm as well as the data set used for segmentation are described.

3.1 Image segmentation algorithm base on modified quantum entropy

In this section, we define the proposed algorithm as flowing:

3.2 Description of MIVIA HEp2 image data set

We have utilized MIVIA HEp2 image data set consists of 28 images, where the images have a resolution of 1388 × 1038 pixels, a color depth of 24 bits and are stored in stored as bitmap images. The images were obtained by means of a fluorescence microscope (40-fold amplification) coupled with a 50W mercury vapor lamp and with a digital camera. The camera contains a CCD with a squared pixel of equal side to 6.45 μm. The six type of HEp-2 (centromere, nucleolar, homogeneous, fine speckled, coarse speckled, and cytoplasmic) presented and tested [45].

3.3 Performance measures

After reading and reviewing some references related to segmentation evaluation criteria. We can divide it into three groups as following: (1) Subjective methods (observation methods). It depends on personal vision. (2) Supervised methods (statistical standards) need a gold standard image (personal expert) to compare with the segmentation result. This group overcomes the limitations of the observation methods, So it has been used in many papers. The examples of this group are dice similarity coefficient (DSC), Jaccard similarity (JS), specificity (SP), sensitivity (SE), F1-measure, and segmentation accuracy (SA), and they are the most commonly used ones. (3) Unsupervised methods based on the measure of the similarity between the segmented image and original image, for example the peak signal-to-noise ratio (PSNR). In this paper, we have adopted all three types to assess the proposed method as the following—observation method, segmentation accuracy (SA), Jaccard similarity(JS), F1-measure, Matthews correlation coefficient (MCC), and the peak signal-to-noise ratio (PSNR) [46].

$$\begin{array}{*{20}l} \mathrm{Accuracy (SA)} &= \frac{TP+TN}{FN+FP+TP+TN} \end{array} $$
(22)
$$\begin{array}{*{20}l} \text{Dice}\;\text{similarity}\;\text{coefficient}\;\mathrm{(DSC/F1)} &= \frac{2*TP}{2*TP+FP+FN} \end{array} $$
(23)

it is the measure of degree for overlapping between two images, if DSc=1 perfect match, DSC=0 no match.

$$ \text{Jaccard} \mathrm{(JS)} = \frac{\text{Dice}}{2-\text{Dice}} $$
(24)

it is used to compare similarity and diversity of image, given by the intersection to the union, JS generally comes between 0 and 1, so, a higher JS is for better segmentation.

$$\begin{array}{*{20}l} \text{Precision} &= \frac{TP}{TP+FP} \end{array} $$
(25)
$$\begin{array}{*{20}l} \mathrm{Sensitivity-Recall-True} \ \text{positive}\, \text{rate}\,\mathrm{(TPR)} &= \frac{TP}{TP+FN} \end{array} $$
(26)

where, for a given class A (foreground or background),

True positive (TP) : pixels correctly segmented as A.

False positive (FP): pixels falsely segmented as A.

True negative (TN) : pixels correctly detected as not A.

False Negative (FN) : pixel classified incorrectly as not A.

Finally, the peak signal-to-noise ratio (PSNR): [11, 20].

$$ \text{PSNR}=20\log\frac{255}{\text{RMSE}} $$
(27)

where the RMSE is the root mean-squared error that is defined by: \( \text {RMSE}=\sqrt {\frac {{\sum \nolimits }_{i=1}^{M} {\sum \nolimits }_{j=1}^{N}|S\left (i,j\right)-IM\left (i,j\right)|^{2}}{MN}} \) where S and IM are the segmented and the input images, respectively. A higher PSNR value indicates a better threshold image quality. We chose F-measure over precision and recall since it is the harmonic mean of precision and recall (TPR/sensitivity). The JS is very similar to dice as they are positively correlated, where Jaccard = dice/2-dice. One disadvantage of the F-measure, a function of precision and recall, is that it is only interested in the positive class. All three measures (F-measure, recall and precision) use only 3 values (TP, FP, FN) without the 4th (TN).

$$ \text{MCC} =\frac{TP*TN-FP*FN}{\sqrt{(TP+FP)*(TP+FN)*(TN+FP)*(TN+FN)}} $$
(28)

The Matthews correlation coefficient treat the true class (expert image) and segmented image class as two binary variables and find their correlation coefficient. The higher the correlation between true and segmented image, the better the segmentation. MCC considers all four values TP, TN, FP, and FN of confusion matrix and is belonging to [ − 1, 1]. The closer the MCC value is to 1, the better is the classification of both classes (object and background).

4 Experimental results and discussion

In the following, the numerical examples as well as the figures are described.

4.1 Numerical examples

For all examples, each example have two figures. For the first figure, we used the following notation: (a) original image, (b) its gray level, (c) expert segmentation, and (d) image histogram, while for the second figure, (e) quantum entropy, (f) quantum entropy modified (proposed), (g) Otsu method, (l) hybrid method, (h) Kapur method, and (m) segmentation by experts, where the hybrid method threshold is the average between the quantum entropy modified threshold and the Otsu threshold. In the segmentation by expert image, we write the number of the image in the data set. The values of F1- measure of quantum entropy, quantum entropy modified (proposed),Otsu, Kapur, and hybrid methods, respectively, are written under the figures. In addition, the value of q in (20) is shown in each figure with the value of threshold T. All the images of data set are tested.

4.1.1 Example 1

(image no3): Figures 1 and 2. Histogram shape: Positive skew, QEM (proposed method) is better than QE, Kapur, and Otsu.

Fig. 1
figure 1

a Original image. b Its gray level. c Expert segmentation. d Image histogram

Fig. 2
figure 2

F-measure [0.0865 0.5371 0.4275 0.0160 0.7707] for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur, and hybrid of the proposed with Otsu methods, respectively

4.1.2 Example 2

(image no 4): Figures 3 and 4. Histogram shape: Bi modal, QEM (proposed method) is better than QE, Kapur, and Otsu.

Fig. 3
figure 3

a Original image. b Its gray level. c Expert segmentation. d Image histogram

Fig. 4
figure 4

F-measure = [0.0067 0.8039 0.5159 0.0695 0.8039] for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur, and hybrid of the proposed with the Otsu methods, respectively

4.1.3 Example 3

(image no 16): Figures 5 and 6. Histogram shape: Positive skew, QEM (proposed method) is better than QE, Kapur, and Otsu.

Fig. 5
figure 5

a Original image. b Its gray level. c Expert segmentation. d Image histogram

Fig. 6
figure 6

F-measure= [0.0635 0.4441 0.3109 0.0117 0.6981] for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur, and hybrid of the proposed with the Otsu methods, respectively

4.1.4 Example 4

(image no 19): Figures 7 and 8. Histogram shape: Bi modal, QEM (proposed method) is better than QE, Kapur, and Otsu, and it is very near to expert segmentation.

Fig. 7
figure 7

a Original image. b Its gray level. c Expert segmentation. d Image histogram

Fig. 8
figure 8

F-measure = [0.0287 0.7988 0.7178 0.01869 0.7988] for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur, and Hybrid of the proposed with the Otsu methods, respectively

4.1.5 Example 5

(image no 21): Figures 9 and 10 Histogram shape: Positive skew with double peaked, QEM (proposed method) is better than QE, Kapur, and Otsu.

Fig. 9
figure 9

a Original image. b Its gray level. c Expert segmentation. d Image histogram

Fig. 10
figure 10

F-measure= [0.0485 0.5941 0.3518 0.0194 0.8438] for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur, and hybrid of the proposed with Otsu methods respectively

Based on the subjective (observation), supervised and unsupervised evaluation methods. In all examples and figures we observed that (1) the proposed method quantum entropy modified (QEM) is best than QE and Kapur over all data set. In addition, it is best than Otsu over 40% of data set. (2) Our observation is that the Otsu method has a problem to find a good thresholding for the image which has positive skew histogram. On the contrary, the QEM finds the best thresholding for the same images. (3) The quantum entropy modified is better than Otsu, for certain class of images which has positive skew histogram. See Figs. 1, 2, 3, 4, 5, 6, 7, 8, 9, and 10.

4.2 Summarize table

In the following, one table summarize all measurement PNSR, accuracy, F-measure, Jaccard, and Mcc.

4.3 Summarize figures

In the following, four figures to summarize the average of accuracy, F-measure, Jaccard, MCC, and PNSR measures over all data set images, which are correspond to the quantum entropy, modified quantum entropy (proposed), Kapur Otsu, and hybrid methods (Figs. 11, 12, 13, 14, and 15)

Fig. 11
figure 11

This figure represents the average of accuracy for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur method, and the hybrid of the proposed and Otsu, respectively

Fig. 12
figure 12

This figure represents the average of the F-measure for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur method, and the hybrid of the proposed and Otsu, respectively

Fig. 13
figure 13

This fig represents the average of the Jaccard quantum entropy, modified quantum entropy(proposed), Otsu, Kapur method, and the hybrid of the proposed and Otsu, respectively

Fig. 14
figure 14

This figure represents the average of the Matthews correlation coefficient (MCC) for quantum entropy, modified quantum entropy (proposed), Otsu, Kapur method, and the hybrid of the proposed and Otsu, respectively

Fig. 15
figure 15

This figure represents only the average of decimal part of the PSNR for quantum entropy, modified quantum entropy(proposed), Otsu, Kapur method, and the hybrid of the proposed and Otsu, respectively

4.3.1 Accuracy

The following Fig. 11, represent the accuracy average of all images in the data set with all methods.

4.3.2 F1-measure

The following Fig. 12, represent F1-measure of all images in the data set with all methods.

4.3.3 Jaccard

The following Fig. 13, represent Jaccard measure of all images in the data set with all methods.

4.3.4 MCC

The following Fig. 14, represent average of the Matthews correlation coefficient (MCC) of all images in the data set with all methods.

4.3.5 PNSR

The following Fig. 15, represent PNSR measure of all images in the data set with all methods.

The experiments and Figs. 11, 12, 13, 14, and 15 of the average of accuracy, F1, Jaccard, MCC, and PNSR show that the QEM method is better than quantum entropy, and Kapur methods. See Table 1; it is very comparable to the Otsu method.

Table 1 average of PSNR, accuracy, F-measure, Jaccard and MCC for quantum entropy, quantum modified entropy(proposed), Otsu, Kapur method, and the hybrid methods respectively

5 Conclusion

We developed an efficient methodology for HEp2 cell segmentation from IIf images based on maximum of new criterion quantum entropy modified and an adaptable representation of the quantum image (FRQI). The method was tested on all the images of the MIVIA HEp 2 image data set. The results showed that the proposed method is most accurate of quantum entropy and Kapur methods in all examples. The proposed method overcomes the limitations of Otsu method Concerning the images which has positive skew histogram. The QEM finds the best thresholding than Otsu for the images which has positive skew histogram. Also, the experimental results show that the proposed methodology entropy outperforms the other strategies and gives superior segmentation output.The study can be improved by a new function with good parameters. This study can be utilized in creating a computer-aided decision (CAD) framework for the diagnosis of immune system diseases

Availability of data and materials

Availability of data and materials MIVIA HEp-2 image data set. Version: 1.0 For more information and for obtaining the User License Agreement (EULA). Please refer to the data set web page: https://mivia.unisa.it/datasets/biomedical-image-datasets/hep2-image-dataset/ [45].

Declarations

Abbreviations

CTD:

Connective tissue diseases

ANA:

Antinuclear antibody

IIf:

Indirect immune fluorescence

HEp2:

Typically human alveolar epithelial cells type2

FRQI:

Flexible representation of the quantum image

MIVIA HEp 2:

Data set images

PSNR:

Peak signal-to-noise ratio

SA:

Segmentation accuracy

DS:

Dice similarity

Js:

Jaccard similarity

CAD:

Computer-aided decision

QEM:

Quantum entropy measures

QE:

Quantum entropy

MCC:

Matthews correlation coefficient

References

  1. R. Hiemann, N. Hilger, U. Sack, M. Weigert, Objective quality evaluation of fluorescence images to optimize automatic image acquisition. Cytom. A: J. Int. Soc. Anal. Cytol.69(3), 182–184 (2006).

    Article  Google Scholar 

  2. S. Abdel-Khalek, G. Abdel-Azim, Z. Abo-Eleneen, A. -S. Obada, 37. New approach to image edge detection based on quantum entropy, (2016), pp. 141–154.

  3. A. D. Brink, 25. Thresholding of digital images using two-dimensional entropies, (1992), pp. 803–808.

  4. Y. Cai, X. Lu, N. Jiang, A survey on quantum image processing. Chin. J. Electron.27(4), 718–727 (2018).

    Article  Google Scholar 

  5. C. -C. Cheng, T. -Y. Hsieh, J. -S. Taur, Y. -F. Chen, 12. An automatic segmentation and classification framework for anti-nuclear antibody images, (2013), pp. 1–25.

  6. S. S. Chouhan, A. Kaul, U. P. Singh, 77. Soft computing approaches for image segmentation: a survey, (2018), pp. 28483–28537.

  7. C. Creemers, K. Guerti, S. Geerts, K. Van Cotthem, A. Ledda, V. Spruyt, in Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies. Hep-2 cell pattern segmentation for the support of autoimmune disease diagnosis, (2011), p. 28.

  8. C. -C. Cheng, T. -Y. Hsieh, J. -S. Taur, Y. -F. Chen, An automatic segmentation and classification framework for anti-nuclear antibody images. Biomed. Eng. Online. 12(1), 1–25 (2013).

    Article  Google Scholar 

  9. P. Perner, H. Perner, B. Müller, Mining knowledge for hep-2 cell image classification. Artif. Intell. Med.26(1-2), 161–173 (2002).

    Article  Google Scholar 

  10. U. Sack, S. Knoechner, H. Warschkau, U. Pigla, F. Emmrich, M. Kamprad, Computer-assisted classification of hep-2 immunofluorescence patterns in autoimmune diagnostics. Autoimmun. Rev.2(5), 298–304 (2003).

    Article  Google Scholar 

  11. M. Sezgin, B. Sankur, Survey over image thresholding techniques and quantitative performance evaluation. J. Electron. Imaging. 13(1), 146–166 (2004).

    Article  Google Scholar 

  12. K. Doi, Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput. Med. Imaging Graph.31(4-5), 198–211 (2007).

    Article  Google Scholar 

  13. A. Rigon, P. Soda, D. Zennaro, G. Iannello, A. Afeltra, Indirect immunofluorescence in autoimmune diseases: assessment of digital images for diagnostic purpose. Cytom. B: Clin. Cytom. J. Int. Soc. Anal. Cytol.72(6), 472–477 (2007).

    Article  Google Scholar 

  14. A. Melegari, C. Bonaguri, A. Russo, B. Luisita, T. Trenti, G. Lippi, A comparative study on the reliability of an automated system for the evaluation of cell-based indirect immunofluorescence. Autoimmun. Rev.11(10), 713–716 (2012).

    Article  Google Scholar 

  15. N. Wiebe, A. Kapoor, K. Svore, Quantum algorithms for nearest-neighbor methods for supervised and unsupervised learning. arXiv preprint arXiv:1401.2142 (2014).

  16. M. Guţă, W. Kotłowski, Quantum learning: asymptotically optimal classification of qubit states. New J. Phys.12(12), 123032 (2010).

    Article  MathSciNet  Google Scholar 

  17. C. A. Trugenberger, Probabilistic quantum memories. Phys. Rev. Lett.87(6), 067901 (2001).

    Article  Google Scholar 

  18. Y. C. Eldar, A. V. Oppenheim, Quantum signal processing. IEEE Signal Proc. Mag.19(6), 12–32 (2002).

    Article  Google Scholar 

  19. M. A. Nielson, I. Chuang, Quantum computation and quantum information (American Association of Physics Teachers, 2002).

  20. S. Du, G. Wu, L. Ma, Y. Ma, et al, Maximum quantum entropy based optimal threshold selecting criterion for thresholding image segmentation (Bethel, 2014).

  21. G. Abdel-Azim, A novel technique for detection of suspicious regions in digital mammogram based on maximum quantum entropy. J. Med. Imaging Health Inform.6(3), 627–633 (2016).

    Article  Google Scholar 

  22. I. Williams, N. Bowring, D. Svoboda, A performance evaluation of statistical tests for edge detection in textured images. Comp. Vision Image Underst.122:, 115–130 (2014).

    Article  Google Scholar 

  23. S. Lloyd, M. Mohseni, P. Rebentrost, Quantum algorithms for supervised and unsupervised machine learning. arXiv preprint arXiv:1307.0411 (2013).

  24. A. Melegari, C. Bonaguri, A. Russo, B. Luisita, T. Trenti, G. Lippi, 11. A comparative study on the reliability of an automated system for the evaluation of cell-based indirect immunofluorescence, (2012), pp. 713–716.

  25. A. B. Hamza, Nonextensive information-theoretic measure for image edge detection. J. Electron. Imaging. 15(1), 013011 (2006).

    Article  MathSciNet  Google Scholar 

  26. C. Yan, B. Gong, Y. Wei, Y. Gao, Deep multi-view enhancement hashing for image retrieval. IEEE Trans. Pattern Anal. Mach Intell. (2020). IEEE.

  27. R. J. Schalkoff, Digital Image Processing and Computer Vision, vol. 286 (Wiley, New York, 1989).

    Google Scholar 

  28. P. Q. Le, A. M. Iliyasu, F. Dong, K. Hirota, Efficient color transformations on quantum images. JACIII. 15(6), 698–706 (2011).

    Article  Google Scholar 

  29. S. Rödiger, P. Schierack, A. Böhm, J. Nitschke, I. Berger, U. Frömmel, C. Schmidt, M. Ruhland, I. Schimke, D. Roggenbuck, et al, in Molecular Diagnostics. A highly versatile microscope imaging technology platform for the multiplex real-time detection of biomolecules and autoimmune antibodies (Springer, 2012), pp. 35–74.

  30. C. Yan, B. Shao, H. Zhao, R. Ning, Y. Zhang, F. Xu, 3D room layout estimation from a single RGB image. IEEE Trans. Multimed.22(11), 3014–3024 (2020).

    Article  Google Scholar 

  31. H. Zhao, J. Shi, X. Qi, X. Wang, J. Jia, in Proceedings of the IEEE conference on computer vision and pattern recognition. Pyramid scene parsing network (Honolulu, 2017), pp. 2881–2890.

  32. H. Zhao, M. Lu, A. Yao, Y. Guo, Y. Chen, L. Zhang, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Physics inspired optimization on semantic transfer features: An alternative method for room layout estimation (Honolulu, 2017), pp. 10–18.

  33. J. Liu, K. Doi, A. Fenster, S. Chan, in MIPPR 2009: Medical Imaging, Parallel Processing of Images, and Optimization Techniques, 7497. Mippr 2009: Medical imaging, parallel processing of images, and optimization techniques (Honolulu, 2009).

  34. B. Sun, A. M. Iliyasu, F. Yan, F. Dong, K. Hirota, 17. An RGB multi-channel representation for images on quantum computers, (2013), pp. 404–417.

  35. S. Abdel-Khalek, G. Abdel-Azim, Z. Abo-Eleneen, A. -S. Obada, New approach to image edge detection based on quantum entropy. J. Russ. Laser Rese.37(2), 141–154 (2016).

    Article  Google Scholar 

  36. P. Q. Le, F. Dong, K. Hirota, A flexible representation of quantum images for polynomial preparation, image compression, and processing operations. Quantum Inf. Process. 10(1), 63–84 (2011).

    Article  MathSciNet  Google Scholar 

  37. F. Yan, A. M. Iliyasu, S. E. Venegas-Andraca, A survey of quantum image representations. Quantum Inf. Process. 15(1), 1–35 (2016).

    Article  MathSciNet  Google Scholar 

  38. B. Sun, A. M. Iliyasu, F. Yan, F. Dong, K. Hirota, An RGB multi-channel representation for images on quantum computers. J. Adv. Comput. Intell. Intell. Inform.17(3), 404–417 (2013).

    Article  Google Scholar 

  39. X. Wang, C. Yang, G. -S. Xie, Z. Liu, Image thresholding segmentation on quantum state space. Entropy. 20(10), 728 (2018).

    Article  Google Scholar 

  40. Y. Zhang, K. Lu, Y. Gao, M. Wang, Neqr: a novel enhanced quantum representation of digital images. Quantum Inf. Process. 12(8), 2833–2860 (2013).

    Article  MathSciNet  Google Scholar 

  41. Y. Cai, X. Lu, N. Jiang, A survey on quantum image processing. Chin. J. Electron.27(4), 718–727 (2018).

    Article  Google Scholar 

  42. P. Sahoo, C. Wilkins, J. Yeager, Threshold selection using renyi’s entropy. Pattern Recog.30(1), 71–84 (1997).

    Article  Google Scholar 

  43. A. D. Brink, Thresholding of digital images using two-dimensional entropies. Pattern Recog.25(8), 803–808 (1992).

    Article  Google Scholar 

  44. Z. Yongde, Principles of Quantum Information Physics [M] (Science Press, Beijing, 2005).

    Google Scholar 

  45. P. Foggia, G. Percannella, P. Soda, M. Vento, Benchmarking hep-2 cells classification methods. IEEE Trans. Med. Imaging. 32(10), 1878–1889 (2013).

    Article  Google Scholar 

  46. S. S. Chouhan, A. Kaul, U. P. Singh, Soft computing approaches for image segmentation: a survey. Multimed. Tools Appl.77(21), 28483–28537 (2018).

    Article  Google Scholar 

Download references

Acknowledgements

This project was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah, under grant No.(D-111-363-1440). The authors, therefore, gratefully acknowledge the DSR technical and financial support.

Funding

This project was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah, Saudi Arabia, under grant No.(D-111-363-1440).

Author information

Authors and Affiliations

Authors

Contributions

The two authors contributed equally to the presented research and writing of this paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Abu-Zinadah Hanaa.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hanaa, AZ., Gamil, A. Segmentation of epithelial human type 2 cell images for the indirect immune fluorescence based on modified quantum entropy. J Image Video Proc. 2021, 12 (2021). https://doi.org/10.1186/s13640-021-00554-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13640-021-00554-6

Keywords