- Open Access
The influence of photo elements on EEG signal recognition
© The Author(s). 2018
- Received: 11 August 2018
- Accepted: 23 October 2018
- Published: 4 December 2018
With the increasing demand for confidentiality of information, traditional identification tools are no longer sufficient. As a new biological signal, EEG signal has the advantage of being difficult to forge and easy to carry and has become a hot topic in the identification research. In the study of EEG signals, the EEG signals triggered by vision have the advantage of stable characteristics. Therefore, many researchers use the photos of the subjects themselves as stimuli to achieve identification research, but the EEG signals caused by vision are easily stimulated. Object interference, such as photo size, resolution, and color. The main purpose of this paper is to study the effect of these disturbances on the recognition effect. The results show that when the number of electrodes is increased to 9, the effect of increasing the electrode to improve the classification accuracy is not significant; the recognition effect of black-and-white photos is lower than that of color, the size of the picture is 800 × 600 or 1024 × 768. When the resolution is 72, the classification effect is the optimal.
- EEG signals
- Photo attributes
In order to protect their own property, people began to research on identity early on, from early passwords to later fingerprints, faces, genes, etc. With the development of technology, the tools used for identity recognition are also gradually developing. The existing identification can easily forget (passwords) and easily be forged (fingerprints, faces), and the cost is too expensive (genetic testing). In some special circumstances, such as for the higher confidentiality departments, the existing identification tools are not suitable, so they need to find new identification tools.
The development of biometric technology has provided a new way to provide a reliable identification tool. Any physiological or behavioral characteristic of a person can be used as a biometric for identification in principle as long as it satisfies the following conditions: (1) universality, everyone has; (2) uniqueness, each person is different; (3) stability, relatively stable over a period of time; and (4) collectability, which can be conveniently measured quantitatively. Of course, it is not always feasible to satisfy the above conditions. The actual system should also consider the following: (1) performance, i.e., accuracy, speed, robustness, and resources needed to meet the requirements; (2) acceptability, people: the degree of acceptance of such biometrics; and (3) deceptiveness, whether it is possible to deceive the system through subjective fraud. At present, more mature biometric technologies include fingerprints, irises, faces, hand shapes, voiceprints and signatures, but there are still some problems as follows: (1) there are always some people whose biometrics are not significant and are excluded, such as fingerprints. Unclear or injured may not pass the fingerprint test. It may be difficult for iris recognition when red eye, and the sound may change when there is a cold; (2) the safety factor is not high, for example, face recognition is powerless for twins and photo imitation; voiceprint and signature recognition is easy to be imitated; fingerprint and hand type identification are easy to be stolen; (3) it is difficult to perform living body detection, and the fingerprints, faces, and hands of dead or isolated bodies are still effective. Therefore, research on the theory and methods of new biometric technologies is a challenge for biometric research institutes.
EEG signal is the external manifestation of brain thinking activity. Since EEG signals have been recorded, people use a variety of methods to use EEG signals to reveal brain activity [1–5]. In these studies, EEG signals induced by image stimuli have been widely used in many studies due to stable features. For example, Mamoru N et al.  use visual stimuli to make objective evaluation of educational videos. Visual stimuli are induced by pictures displayed on the liquid crystal display in the shielded room. The results showed a negative correlation between the EEG signal and pupil size in the 9–11 Hz frequency band; Yan X D  et al. used image stimulation to study the “image advantage effect.” Through the discussion of the two types of self-demolition, the feature extraction of the image-stimulated EEG signals is used to improve the accuracy of the test case’s brain in test civil and criminal cases. Liu F J et al.  used picture-evoked EEG signals to study the different responses of teenagers and older adults to voice, pictures, and Chinese characters. The results showed that the ERP components of the elderly and young people are different.
As a tool for identification, EEG has the following characteristics: First, it is universal, and each living person has an EEG signal. Secondly, because each person’s brain characteristics, thinking mode, memory, etc. are different, there are differences between people. The characteristic EEG signal is unique. Thirdly, the EEG signal has stability. The EEG signal can be relatively stable for a certain period of time. Fourth, the EEG signal is easy to collect. Currently, there are commercial acquisition devices. After years of research and development, today’s EEG signal acquisition has been simplified from the original steps of grounding, setting reference, coating conductive paste, and mounting electrode caps, and simplifying it to only one earphone-like device. Corresponding EEG signal.
EEG signal is a spontaneous physiological signal. With the development of acquisition techniques, the memorylessness, difficulty of counterfeiting, and convenience of EEG signals have become new research directions for many identity researchers [9–12]. People’s sensitivity to their own photos is higher than that of other people’s photos, which can use this difference to induce stable EEG signals with their own characteristics to achieve identification.
Identity recognition using photo-induced EEG signals has achieved good results [13–15]. From the point of view of the experimental model, these results are based on a small part of the same photo recognition research. However, in the specific use process, whether the attributes such as the size, color, and resolution of the photograph will have influence on the final recognition effect, which is rarely studied. This paper uses photos as stimuli to induce subjects’ brain electrical signals. Wavelet decomposition is used as a feature extraction tool to extract the features of the subject’s EEG signals, and Fisher distance is used as a feature screening method for feature screening. SVM is used as a classification algorithm for identification. In the process of choosing photos, choose different size, color, and resolution photos to experiment. The results show that the attributes of photos have an impact on the accuracy of recognition. When the best size, color, and resolution are selected, the recognition rate can reach 97.8%, which is much higher than that of similar identity recognition research. In summary, the main contribution of this paper is that, by the influence of the size, resolution, and color of the subject’s photos on the classification and recognition results, the best photo attributes are finally obtained.
The purpose of the experiment in this paper is to investigate the effect of photos on identification results under different attributes. The photo attributes are set to size, resolution, and black-and-white color, and the size is set to 400px × 300px, 640px × 480px, 800px × 600px, 1024px × 768px, and 1280px × 960px, and the resolution is set to 50 dpi (pixels/inches), 72 dpi (pixels/inch), 100 dpi (pixels/inch), 200 dpi (pixels/inch), and 300 dpi (pixels/inch).
The 20 subjects in this study are from college students, including 10 males and 10 females (mean=20.45, variance=1.05). Before the experiment, the subjects knew the contents of the experiment. The subjects did not drink alcohol before the experiment, and they did not take any irritating drugs. Subjects were guaranteed adequate sleep (8 h or more) before the experiment. The experiments in this paper are all filed at the Research Office.
The design of EEG acquisition mode, in the analysis of EEG signals, generally consider the following three aspects: First, how to design the experimental process to “inducate” the subject to “transmit” a reasonable signal; Second, the setting of various parameters; Third, the number and position of the electrodes, the more electrodes, the more complex the algorithm, the effect may be better; the fewer the electrodes, the simpler the algorithm, the worse the effect may be.
This paper uses neruoscan’s 40-lead brain electrical signal acquisition device to collect brain electrical signals at a sampling frequency of 1000 Hz. The left mastoid is used as a reference electrode, and the 50-Hz notch is used. The data are stored for 8 min each time, including 100 trials and preparations before and after the experiment. Before the analysis, the experimental data was pre-processed with the offline processing software (scan 4.3), which is provided with the acquisition equipment, including the removal of the electro-oculogram (vertical electro-oculogram), filtering (1–100 Hz band-pass filtering), and photo display time (the first 20–80%) segmentation, the final segmentation results are stored in the form of a sample, each sample is cutoff for one sampling period (1 s), and each subject’s pretreated sample set behaves as 30 × 200 (electrode number of *samples).
As shown in Fig. 1(2), the electrodes are distributed on the international 10–20 standard, in which the markers in each electrode respectively represent the 10–20 standard nomenclature and the serial numbers used in this paper.
3.1 Wavelet entropy
The EEG signal is a weak electric signal, so the EEG signal characteristics are easily interfered by the outside world. In order to highlight the essential features of EEG signals, it is a common type to convert EEG signals from time domain signals to other domain signals; means, in which the frequency domain feature is a commonly used method, the wavelet transform can transform the time domain feature into the time-frequency domain and integrate the time and frequency features to achieve the filtering effect. Wavelet entropy better reflects the order of this time-frequency domain feature, so this paper chooses wavelet entropy as the feature transformation method.
Wavelet analysis is used to perform multi-scale decomposition of EEG signals. If the wavelet coefficient vector on scale i is denoted as Wi = (wi1, wi2, …, win), in which win refers to wavelet coefficient parameters, n is the decomposition length, so each scale has a coefficient vector corresponding to it. For EEG signals, the more similar coefficient vectors at different scales, the greater the entropy of the signal, the greater the complexity of the signal, the more similar each signal component, and the less obvious the signal characteristics.
In which, |ws| is the norm sequence.
According to the definition of wavelet energy, the closeness of each scale is measured by a norm sequence of wavelet coefficient vectors. Normalize the energy sequence E1, E2, …, Em. The signal structure and complexity are analyzed by the distribution of normalized energy sequences. The process is described as follows:
3.2 Fisher distance
This paper introduces the Fisher distance to calculate the feature distance between different subjects who see themselves and look at others. The Fisher distance calculation method is as follows:
In which, Fi,j refers to the Fisher distance matrix between subjects’ normal state and fatigue state EEG signals, and μ and σ are the mean value and variance.
3.3 SVM classifier
Supportive Vector Machine (SVM) is a supervised machine learning method that can learn the characteristics of different types of known samples and predict unknown samples. It is essentially a two-class algorithm. For an input sample of n-dimensional space, it finds an optimal categorical hyperplane so that the two types of samples can obtain the best classification effect under this hyperplane.
In order to ensure the robustness of the classification results, this paper adopts a 30-fold cross-validation method to test and divide all the samples into 30 equal samples. The 300 self photos and the 300 photos of others were equally divided into 10 parts. Each time, 8 of them were selected as learning sets and 2 were used as test sets. Randomly selected 10 times, the average result was finally calculated.
In which, γ is the width of the kernel function.
The penalty factor C and the kernel function σ in the classification calculation are determined using a grid search method.
For each subject, the sample of brain electrical signals collected from the photo collection of each attribute included 100 samples (positive samples) of self-photographs and 100 samples (negative samples) that were not self-photographs. A total of 20 subjects were added together to obtain 2000 samples of one’s own and 2000 samples of watching others, for a total of 26 groups. Using the above method for feature extraction, we can get the following results (the wavelet entropy used in this paper is based on the original value in addition to e5 after taking the absolute value).
4.1 Electrode selection
The smaller the number of electrodes, the smaller the amount of data involved in the algorithm operation and the smaller the time complexity of the algorithm. Can 30-lead EEG signals be identified using only a few electrodes? Because there is no hair in the forehead area, it is easy to collect and practice. Can we use the two leads of brain signals in the forehead area to achieve identification?
As can be seen from Fig. 2, with the increase in the number of electrodes, Fisher’s distance increasing trend gradually decreased, indicating that under different electrodes, subjects see themselves and see others’ different characteristics of the difference. Therefore, the contribution to the classification is also different. The classification accuracy can also be seen that when the number of electrodes increases from 8 to 9, the accuracy rate increases by 0.01, from 9 to 10 only increases by 0.0008, and then the accuracy increases as the number of electrodes increases. The rate has barely increased. Moreover, as the number of electrodes increases, there is also a phenomenon in which the accuracy rate is lowered (for example, 18). Therefore, it can be concluded that when the number of electrodes is selected at 9, the effect of 30 electrodes can be achieved.
If only the two electrodes in the forehead region are used, the classification accuracy is 81%, which is only 8% less than when selecting 9 electrodes. Therefore, for cases where the classification requirement speed is not strict, it is feasible to use the forehead EEG signal.
4.2 Influence of black and white photos
Contrast between the entropy of looking at yourself and looking at others
B- W (other)
For the above result, because the subject knew that it was an identity recognition experiment, his photos would appear during the experiment, so the expectation was not obvious. And because they are more familiar with their own photos is much higher than that of other photos, the volatility (the amount of information in the signal) that appears in the expression of entropy is not obvious. But when looking at other people’s photos, because of the background photos selected from the sample database, randomness may cause each photo to be different. The brain needs more information to process these photos that are not “familiar.” Therefore, the volatility of the signal (the amount of information contained in the signal) is large, causing the entropy value to be less than the average of the photos of others.
The black and white of photographs are more colorful than color photographs, and people have more attention to color photographs. Color photographs also highlight the subtle features of people. Therefore, the reaction of the human brain is also more intense, causing the entropy of the color photo to be larger than the entropy of black and white.
4.3 Classification accuracy
In order to highlight the characteristics of your own photos, the small size of the photos is suitable for 800 × 600 or 1024 × 768.
The resolution of 72 is more appropriate.
The main reason for the above results may be that with the popularity of smart phones, photos at this resolution and size are more popular. Especially in the case of various self-portraits and online self-photographs, such photographs are the most numerous, and therefore, the subject is affected and the subject is most familiar with such photographs.
Figure 5 shows the effect of resolution and size on entropy (where 1 is the effect of looking at your own photo. 2 is the effect on looking at other people’s photos, where the x-axis is the resolution (1, 2, 3, 4, and 5 corresponds to 50 dpi, 72 dpi, 100 dpi, 200 dpi, and 300 dpi), and y is the resolution entropy. The five bars at each resolution in the figure correspond to five different photo sizes of 400 px × 300 px, 640 px × 480 px, 800 px × 600 px, 1024 px × 768 px, 1280 px × 960 px), respectively.
Recognition rates with different resolutions and sizes
400 × 300
640 × 480
800 × 600
1024 × 768
1280 × 960
Comparison of existing representative identification results
The highest accuracy
Miyamoto C 
Spectral feature extraction
Hu J F 
Das K 
Visually evoked potential
Yeom S K 
Averaged event-related potential (ERP)
EEG signals as an identification and recognition tool have advantages over other biological information. Biometric systems based on EEG signals can achieve certain accuracy and speed. Collecting EEG signals will not cause any harm to the human body. It is easy to accept, and because the EEG signal is derived from the brain’s thinking activities, the way and the way of thinking between people are different. On the one hand, it is difficult to “decipher” the individual’s thinking. On the other hand, even if it is deciphered, it is difficult to forge the same. Using the EEG signal, it is impossible to “decipher” through subjective fraud, with the continuous enrichment of signal analysis tools and research results, to achieve “validation is not this person,” using the classification method to achieve, and through feature extraction and classification method design; basic can achieve verification purposes.
The use of EEG signals as an identification tool is an important branch of the current identity research. Because of the stability of the EEG signal characteristics induced by the vision, the picture is often used as a tool for inducing EEG signals. Among the visually evoked EEG signals, there are many research findings on the identification of EEG signals based on the differences in characteristics of EEG signals seen by the subjects themselves and their photos. However, this study does not have a good analysis of the effect of photo properties as a stimulus on the accuracy of classification. In this paper, the brain electrical signals of 20 subjects were used as a tool to analyze the influence of the size of the photo, black and white photos, and resolution attributes on the accuracy rate. The results show that the recognition rate results under different attributes are different.
The authors thank the editor and anonymous reviewers for their helpful comments and valuable suggestions.
Availability of data and materials
We can provide the data.
About the authors
Qingjun Wang received his M.S. degree from the Northeast University, in 2009. He is currently a graduate student studying for Ph.D. degree in the College of Automation Engineering, Nanjing University of Aeronautics and Astronautics. His research interests include Pattern Recognition, EEG Recognition, and Fatigue Detection.
Yibo Li was born in 1963 and a Professor of Shenyang Aerospace University. His main research interests include Artificial Intelligence, Pattern Recognition, and Artificial Intelligence.
Xueping Liu received his M.S. degree from the Shenyang Aerospace University, in 2010. He is currently a graduate student studying for Ph.D. degree in the College of Automation Engineering, Nanjing University of Aeronautics and Astronautics. He has published over 10 technical research papers. His research interests include machine learning, vision analysis, and pattern recognition.
QW did the experiment. XL and YL gave significant ideas in writing the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- W. Klimesch, P. Sauseng, S. Hanslmayr, EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res. Rev. 53(1), 63–88 (2007)View ArticleGoogle Scholar
- Y. Zhang, X. Ji, B. Liu, D. Huang, F. Xie, Y. Zhang, Combined feature extraction method for classification of EEG signals. Neural Comput. & Applic. 28(11), 3153–3161 (2017)View ArticleGoogle Scholar
- Y. Dai, X. Wang, P. Zhang, W. Zhang, J. Chen, Sparsity constrained differential evolution enabled feature-channel-sample hybrid selection for daily-life EEG emotion recognition. Multimedia Tools Appl. 77(17), 21967–21994 (2018)View ArticleGoogle Scholar
- A. Bhattacharyya, M. Sharma, R.B. Pachori, P. Sircar, U.R. Acharya, A novel approach for automated detection of focal EEG signals using empirical wavelet transform. Neural Comput. & Applic. 29(8), 47–57 (2018)View ArticleGoogle Scholar
- M. Yadava, P. Kumar, R. Saini, P.P. Roy, D. Prosad Dogra, Analysis of EEG signals and its application to neuromarketing. Multimedia Tools Appl. 76(18), 19087–19111 (2017)View ArticleGoogle Scholar
- N. Mamoru, S. Yasutaka, Pupil size and EEG affected by visual stimuli. Electron. Commun. Jpn. 77(2), 58–67 (2010)Google Scholar
- X.D. Yan, H.G. Liu, H. Qiao, Research of Chinese characters and picture as stimulus in the cognitive EEG lie detection. J. Shanxi Police Acad. 20(1), 75–78 (2012)Google Scholar
- F.J. Liu, X. Wu, M.X. Yu, ERPs of characters of Chinese words compared with tone and picture stimuli in adolescents and aged persons. Clin. EEG 29(3), 146 (1998)Google Scholar
- S. Marcel, J.D.R. Millan, Person authentication using brainwaves (EEG) and maximum a posteriori model adaptation. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 743–752 (2007)View ArticleGoogle Scholar
- C. He, X. Lv, Z.J. Wang, in IEEE international conference on acoustics, speech and signal processing. Hashing the mAR coefficients from EEG data for person authentication (IEEE Computer Society, Taipei, 2009), pp. 1445–1448Google Scholar
- S.H. Liew, Y.H. Choo, F.L. Yin, in International conference on fuzzy theory and ITS applications. Fuzzy-rough nearest neighbour classifier for person authentication using EEG signals (IEEE, Taipei, 2013), pp. 316–321Google Scholar
- T. Nakamura, V. Goverdovsky, D.P. Mandic, In-ear EEG biometrics for feasible and readily collectable real-world person authentication. IEEE Trans. Inf. Forensics Secur. (99), 1 (2017)Google Scholar
- S.K. Yeom, H.I. Suk, S.W. Lee, in Proceedings of the Korean information science society conference. EEG-based person authentication using face-specific self representation (Korean Institute of Information Scientists and Engineers, Seoul, 2011)Google Scholar
- Z. Mu, J. Hu, J. Min, et al., Comparison of different entropies as features for person authentication based on EEG signals. IET Biom. 6(6), 409–417 (2017)View ArticleGoogle Scholar
- Z. Mu, J. Hu, J. Min, EEG-based person authentication using a fuzzy entropy-related approach with two electrodes. Entropy 18(12), 432 (2016)View ArticleGoogle Scholar
- O. Nieves, V. Manian, in World Automation Congress. Automatic person authentication using fewer channel EEG motor imagery (IEEE, Guilin, 2016), pp. 1–6Google Scholar
- Hu J F. New biometric approach based on motor imagery EEG signals BioMedical Information Engineering, 2009. FBIE 2009. International Conference on Future. IEEE, Tianjin, 2010:94–97Google Scholar
- Das K, Zhang S, Giesbrecht B, et al. Using rapid visually evoked EEG activity for person identification International conference of the IEEE Engineering in Medicine & Biology Society. Conf Proc IEEE Eng Med Biol Soc, 2009:2490Google Scholar
- A. Ferreira, C. Almeida, P. Georgieva, et al., in International conference image analysis and recognition. Advances in EEG-Based Biometry (Springer, Berlin, Heidelberg, 2010), pp. 287–295View ArticleGoogle Scholar
- Paranjape R B, Mahovsky J, Benedicenti L, et al. The electroencephalogram as a biometric Electrical and computer engineering, 2001. Canadian Conference on. IEEE, Toronto, 2001:1363–1366 2Google Scholar
- C. Miyamoto, S. Baba, I. Nakanishi, in International symposium on intelligent signal processing and communications systems. Biometric person authentication using new spectral features of electroencephalogram (EEG) (IEEE, Shanghai, 2009), pp. 1–4Google Scholar