- Open Access
Research on English translation distortion detection based on image evolution
© The Author(s). 2019
- Received: 30 October 2018
- Accepted: 9 January 2019
- Published: 29 January 2019
At present, there are serious distortions in the translation of image English characters. In order to alleviate this problem, this study improves the traditional algorithm, uses the Canny edge detection method as the edge detection method through experimental comparison and analysis, and combines the image evolution to analyze the English character translation of multiple complex images. Simultaneously, in this study, the closed space is used to fill the small holes in the target area, and some intrinsic characteristics of the text area are used to form the heuristic knowledge to limit the connected area, and the English candidate area is constructed for the image recognition algorithm of the image. Then, this study uses the English candidate area as the recognition area for translation recognition. The research shows that the algorithm has certain practical effects and can provide a theoretical reference for subsequent related research.
- Image evolution
In people’s life, there is no information about characters at all times, and this information is generally divided into two types of information: print and handwriting. The characters of the printed body have a certain regularity, and each character has a certain template, so in the process of computer recognition, the character recognition rate is high. Because of the difference between people and people, handwritten characters do not have a unified template for each character, which causes the recognition rate of the computer to be low in the process of recognizing handwritten characters and the recognition speed is slow. For English fonts, there are only 26 English letters, some of which are similar, so it is easy to be confused during the recognition process. Especially in the machine identification, there are obvious automatic recognition errors. Based on this, it is necessary to improve the distortion of English translation .
Since the great breakthrough in character recognition by scientist Tausheck in 1929, character recognition has become a hot issue in pattern recognition after years of unremitting efforts. Since the 1950s, the study of optical characters has slowly begun to develop. In the early 1960s, there were several commonly used identification systems on the market, including optical character recognition programs developed by NCR, Farrington, and IBM. Although these developed systems are able to initially classify characters, these programs have many drawbacks in many functions . In order to solve these problems, after about 10 years of research, Parks et al. proposed to use the topology method to extract the character structure of the character first and then identify it . After several years of development, by 1980, Japan had achieved certain results in character recognition, and based on the research results, developed the first postal code sorter. In the early 1990s, Vapnik et al. proposed a support vector machine based on mathematical statistics. This proposal opened a new way for pattern recognition and made a great contribution to pattern recognition. In the following years, the neural network was also associated with image recognition, and good results were also achieved .
China’s research work on OCR technology started late. In the 1970s, Dai Wei, an academician of the Institute of Automation of the Chinese Academy of Sciences, led the handwritten character recognition. In 1974, the handwritten digit recognition system studied was applied to the automatic sorting of postal letters . In the late 1970s, the research on Chinese character recognition began. By 1986, the research on Chinese character recognition entered a substantive stage and achieved great results, and many research units have successively launched Chinese OCR products. The National “863 Program” has given great support to the research of OCR technology and promoted the achievement of OCR’s major achievements . At present, online handwritten Chinese character recognition technology is quite mature, and a number of representative products have appeared on the market. At the same time, offline print identification also has mature products, and the recognition rate can basically meet the practical requirements . In addition, the research on offline handwritten Chinese character recognition has made great progress, and the small character set word recognition technology is relatively more mature. For example, the financial Chinese character recognition system developed by Beijing Post and Telecommunications Research Institute in 1998 obtained a 99.7% recognition accuracy rate in the National 863 tests. At the same time, Chinese character recognition methods for large character sets, such as cosine shaping transformation methods, have also achieved high precision . The theory and technology of word recognition are generated by strong social demand and continue to develop. However, it can be said that no recognizer has achieved perfect recognition. In the past few decades, researchers have proposed a number of identification methods. Letter recognition belongs to the category of pattern recognition, which is a specific problem of pattern recognition, and letter recognition has special requirements different from other pattern recognition. In addition to requiring high recognition accuracy and reliable work, letter recognition requires high recognition efficiency and fast recognition speed, which requires accurate mathematical modeling .
With the continuous advancement of technology, several new recognition technologies will be rapidly developed in the foreseeable future, and the optical character recognition system will be continuously improved [10, 11]. (1) Recognition method based on fuzzy technology—because the characters themselves, especially the handwritten characters, vary greatly in the font type, which leads to great uncertainty in the text recognition, the concept of fuzzy mathematics is naturally cited in the field of pattern recognition. In 1976, Rosenfeld et al. proposed a scene identification relaxation algorithm. In 1977, Jain et al. used the fuzzy set theory to analyze complex images, realized the detection of moving targets, and began the application of fuzzy mathematics in image recognition . (2) Post-processing techniques combined with semantic understanding—in contrast to the pre-recognition pre-processing, this technique can post-process the results of the recognition and improve the correct rate of recognition. In the process of analyzing human beings in recognizing words, words are generally understood in conjunction with context. Therefore, when the computer recognizes the text, the recognition result can be corrected by combining the context information of the single word on the basis of identifying the word, and the word or even the sentence is used as the result of the recognition. According to the statistical information of the language and text, it is possible to determine the candidate character set that may follow a certain text, thereby narrowing the search scope and simplifying the calculation. The problem of this technology combined with context information identification mainly focuses on how to efficiently organize candidate character subsets and realize the rapid positioning of candidate characters . (3) Comprehensive integration of multiple strategies—in the field of OCR, although new algorithm ideas continue to emerge, the use of only one identification method in an efficient OCR system cannot meet the requirements of reality . The ability to identify a single strategy is limited, so multiple strategies are used to achieve complementary advantages, and the use of character information in multiple angles is the direction of OCR development. The integration strategies often used in this direction are a variety of integrated methods such as voting, probabilistic, Dempster-Sharer, and behavioral knowledge space. Taking the voting method as an example, as the name suggests, each identification strategy has a ballot. For each strategy with the same character, each of its own results produces a vote. After all the strategies are voted, the most recognized result is the final recognition result. Obviously, human resources are needed in this integrated approach. On the one hand, the completion of various algorithms requires human resources. On the other hand, if the parallelism between the various algorithms is not good, the total execution time will be multiplied .
From the above analysis, we can see that there are some problems in the process of image translation in English; especially in the actual translation process, there will be distortion. For these distortion problems, improved identification methods are needed to reduce the distortion rate. Based on this, this study combines image recognition technology to improve the traditional algorithm and strive to improve the image translation effect.
2.1 Image edge detection
Edge detection is the basis of all algorithms that segment images based on edges. The edge of the image is the boundary between different regions and regions in the image, and it is also the part where the local features of the image change significantly. It is represented by a discontinuous pattern of local characteristics of the target, such as sudden changes in luminance values, sudden changes in color, and mutations in texture features. There are two characteristics at the edge of the image: direction and amplitude characteristics. In general, along the edge, the gray level of the pixel changes relatively gently, while the gray level changes perpendicular to the edge. The edge is the most dramatic change in the gray value on the image, which is reflected in the mathematical expression, the place where the function gradient is relatively large. Therefore, the idea of edge detection is mainly focused on the study of better derivative operators. The method of edge detection mainly focuses on calculating the first derivative or the second derivative of the gray value of the image; the edge point of the image corresponds to the peak point of the first-order differential image and corresponds to the zero-crossing point on the second-order differential image. The general image edge detection method has three steps: image filtering—filters are used to improve the performance of noise-related edge detectors; image enhancement—this step is usually done by calculating the magnitude of the gradient; and image detection—this step is mainly to determine which points are edge points. The simplest edge detection judgment is based on the gradient magnitude. Gradient-based image edge detection operators have two main categories: the edge detection operator of the first-order derivation and the edge detection operator of the second-order derivation.
What is given after the edge detection is the binary edge image es. Binarization of edge images is an important issue. If the threshold is too large, some text edges may be missed, and if the threshold is too small, more non-text edges may be treated as text edges, causing more false detections. In order to achieve good results in binarization, the edge image is first morphologically filled, the holes are removed to remove noise, and then adaptive threshold segmentation is performed to obtain a binary image. Mathematical morphology is an operation based on mathematical sets. Its basic principle is to use structural elements with certain characteristics to measure and extract similar shapes in images, so as to achieve the purpose of image analysis and recognition. Morphological operations on the image simplify the data of the image and eliminate irrelevant structures while maintaining the basic shape characteristics of the image. In the usual image processing, there are four basic morphological operators: corrosion, expansion, open operation, and closed operation.
The main function of the corrosion operation is to mark the interior of the image where the defined structural elements can be filled. Corrosion operations can remove targets smaller than structural elements (such as burrs, small bulges), so that different sizes of objects can be removed from the original image by selecting structural elements of different sizes. At the same time, corrosion can also eliminate object boundary points. If there is a small connection between the two targets, then if the structural elements are chosen to be large enough, the two targets can be separated by a corrosion operation.
2.2 Image text extraction technology
The 0-pixel set or the 1-pixel set that communicates with each other in a binary image is referred to as a connected component. There may be multiple connected components in one image after segmentation, and each connected component corresponds to a target image region, and the process of assigning corresponding labels to each target image region is called a mark. Common connectivity area marking algorithms mainly have four connections and eight connections. The eight-connected region means that from each pixel in the region, it can reach any pixel in the region through eight directions under the premise of not getting out of the region, namely, eight directions of up, down, left, right, upper left, upper right, lower left, and lower right. However, the four connected areas are only connected in the four directions of up, down, left, and right. In this paper, the candidate text area is marked by the eight-neighbor labeling algorithm. The background is marked as 0, the first connected area is marked as 1, and the second connected area is marked as 2, and so on. After marking, the attribute characteristics of each connected domain can be calculated, such as perimeter and area.
It can be seen in Fig. 3 that after the threshold segmentation, the features are more prominent, and the target recognition is more convenient. At the same time, with some methods based on global threshold or optimal threshold segmentation, this adaptive threshold segmentation is not sensitive to the effects of illumination conditions and reflections. After the threshold segmentation forms the binarized image e, the connected regions formed by the self-color pixel points in the image are re-marked to obtain a candidate text region.
Due to the complexity and variety of color images, some noise points or noise curves are inevitably present in the candidate text regions. Therefore, it is necessary to form some heuristic knowledge in combination with some inherent characteristics of the text area to limit the connected area. If it does not satisfy the following conditions, the connected area is regarded as noise and is eliminated.
As shown in Fig. 5, Fig. 5(a) is an original video image, and the background of the image is relatively complicated and belongs to the background of the building, so the text segmentation is very difficult. Figure 5(b) shows the result of text recognition segmentation by the genetic neural network, and Fig. 5c shows the character recognition result of the algorithm of the present study.
As shown in Fig. 6, Fig. 6a is an original video image, and the background of the image is relatively complicated, which is a technical parameter image of a vortex mixer, so that text segmentation is very difficult. Figure 6b shows the result of text recognition segmentation by the genetic neural network, and Fig. 6c shows the character recognition result of the algorithm of the present study.
Comparison of English image translation performance between the algorithm of this paper and the genetic neural network algorithm
Genetic neural network algorithm
Algorithm of this study
Recognition speed (s)
Image sharpness (%)
Image de-noise rate (%)
Image distortion rate (%)
At present, the translation software is for displaying text. If the text appears in the image, this translation software cannot do anything about it. Although some visual-based semi-automatic or automated translation systems have emerged, most are based on server and client architectures. These systems require users to upload images and perform text detection on the server side to extract translations, so translation results cannot be provided in real time. At the same time, the translation results are simply superimposed on the screen and do not achieve good visual effects. Based on this, this study proposes an image English translation algorithm based on image evolution, which can detect English in a variety of images.
Through the experimental analysis, the performance of the algorithm is analyzed. Simultaneously, the comparison of image recognition results and performance parameters can be used to draw corresponding conclusions. As can be seen in Fig. 4, the genetic neural network basically detects the text with clear outline and less interference in the figure and is selected as a single English area by the construction of the English area. However, for those words whose glyphs are not clear enough or are relatively small in size, the method has not been successfully detected. At the same time, not only the text portion of the image is recognized, but also other image portions are also emitted, so it has a certain influence on the English recognition. In the face of a complex background, large illumination impact or serious graphic deformation, the detection method proposed in this paper cannot accurately detect the text area and eliminate the influence of other factors in the background. Therefore, the proposed algorithm has a better translation and recognition effect on English text in a fuzzy environment.
Figure 5 shows the text recognition in a complex background. Through comparative analysis, it can be seen that the neural network algorithm accurately detects the English located above and constructs it into a single complete Chinese character. However, because the angle of the text in the picture is tilted and the background contains a lot of horizontal and vertical building disturbances, the Chinese characters and the background of the building also are detected, and they are combined with the noise data to form a larger non-English area. The text located below the image is disturbed by the entrance of the building, and its font is not clear in the figure, and its background is also a strip-shaped building. Therefore, when the stroke area is screened, it is filtered out as a large area together with the background. In the actual identification of the research algorithm of this paper, in addition to the effective elimination of the building part, the Chinese text part can also be eliminated. At the same time, the algorithm only retains the English part, and the English text part is clearly expressed, and the recognition effect is good.
Figure 6 shows the mixed image recognition in Chinese and English. The image background is complex and is a technical parameter image of a vortex mixer. Therefore, the text segmentation is very difficult. Through research, it is found that the genetic neural network algorithm recognizes both Chinese and English from the image in image segmentation, thus causing Chinese and English to be mixed in the recognition result. However, the algorithm of this study can identify all the English parts of the image, and the Chinese part is filtered out along with the background.
From the performance experiment results, the accuracy of the method for detecting and identifying English in natural scenes is 99.3%, which is less than 100%. Therefore, further research and improvement are needed. From the current status quo, compared with the current advanced genetic neural network algorithm recognition results, the algorithm leads the genetic neural network algorithm in recognition speed, accuracy, image sharpness, image de-drying rate, and image distortion rate. First of all, in the recognition speed, the algorithm is far ahead of the genetic neural network algorithm, and secondly, it is close to 100% accuracy, which can be initially applied to practice. In addition, the algorithm can ensure the image distortion rate is low after recognition, ensure the image has certain clarity, and effectively eliminate the noise in image recognition. Therefore, it is a good image recognition algorithm for images.
Aiming at a variety of complex images under the condition of image evolution, this study combines image recognition technology to improve the traditional algorithm and strive to improve the translation of image English. After comparing the edge detection algorithm, it is found that the edge extraction ability of the Canny operator is the most satisfactory, and it is better adapted to the change of detection information, which ensures the continuity and closure of the edge. At the same time, in order to achieve good results in binarization, the edge image is first morphologically filled, the holes are removed to remove noise, and adaptive threshold segmentation is performed to obtain a binary image. By using the closing operation, small holes in the target area can be filled, and narrow gaps are connected to form elongated bends. At the same time, after the image is marginalized, there is a gap between the characters obtained, so the filling is used to fill the gaps by the idea of mathematical morphology. Due to the complexity and variety of color images, some noise points or noise curves are inevitably present in the candidate text regions. Therefore, this study combines some inherent characteristics of text regions to form heuristic knowledge to limit connected regions. If it does not satisfy the following conditions, the connected area is regarded as noise and is eliminated. In addition, this paper draws on the traditional image recognition detection ideas and makes appropriate changes to use English detection. Through the recognition algorithm for image English proposed in this paper, the English candidate region is constructed, and then the English candidate region is used as the recognition region for translation recognition. From the performance experiment results, the performance of the proposed algorithm is good and meets the research expectations.
The author thanks the editor and anonymous reviewers for their helpful comments and valuable suggestions.
Availability of data and materials
Please contact author for data requests.
The author read and approved the final manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- S. Sudeng, N. Wattanapongsakorn, A preference-based multiobjective evolutionary algorithm for finding knee solutions. Appl. Mech. Materi. 781, 559–563 (2015).View ArticleGoogle Scholar
- Q. Husain, S.K. Patel, R.S. Soni, et al., Celebrating the golden anniversary of anterior skull base surgery: reflections on the past 50 years and its historical evolution. Laryngoscope 123(1), 64–72 (2013).View ArticleGoogle Scholar
- L.J. Zhang, D.D. Liu, W.B. Zhang, et al., A new diffusivity database for multi-component Al alloys: focusing on ternary systems and its effect on microstructure evolution during solidification. Mater. Sci. Forum 794-796, 611–616 (2014).View ArticleGoogle Scholar
- M. Polat, S.N. Takeshima, K. Hosomichi, et al., A new genotype of bovine leukemia virus in South America identified by NGS-based whole genome sequencing and molecular evolutionary genetic analysis. Retrovirology 13(1), 4 (2016).View ArticleGoogle Scholar
- P. Margaria, M. Ciuffo, C. Rosa, et al., Evidence of a tomato spotted wilt virus resistance-breaking strain originated through natural reassortment between two evolutionary-distinct isolates. Virus Res. 196, 157–161 (2015).View ArticleGoogle Scholar
- X.Q. Zhang, Q. Xing, R.B. Li, et al., Deformation investigation on iPP/SiO 2, composites: influence of stretching temperature and particle size on morphology evolution and crystalline structure of thin films. Chin. J. Polym. Sci. 31(2), 275–284 (2013).View ArticleGoogle Scholar
- M.R. Ciancio, E.C. Vieytes, A.A. Carlini, When xenarthrans had enamel: insights on the evolution of their hypsodonty and paleontological support for independent evolution in armadillos. Naturwissenschaften 101(9), 715–725 (2014).View ArticleGoogle Scholar
- J.C. Matsubu, E.T. Lin, K.L. Gunther, et al., Critical role of interfacial effects on the reactivity of semiconductor-cocatalyst junctions for photocatalytic oxygen evolution from water[J]. Catalysis Sci. Technol. 6(18) 6836-6844 (2016).Google Scholar
- B. Shi, J. Mosler, On the macroscopic description of yield surface evolution by means of distortional hardening models: application to magnesium. Int. J. Plast. 44(9), 1–22 (2013).View ArticleGoogle Scholar
- S. Hirai, S. Yagi, A. Seno, et al., Enhancement of the oxygen evolution reaction in Mn3+-based electrocatalysts: correlation between Jahn–Teller distortion and catalytic activity. RSC Adv. 6(3), 2019–2023 (2016).View ArticleGoogle Scholar
- A.K. Bhandari, A novel beta differential evolution algorithm-based fast multilevel thresholding for color image segmentation[J]. Neural Comput. & Applic., 1–31 (2018).Google Scholar
- Y. Liu, X. Hua, C. Xiao, et al., Heterogeneous spin states in ultrathin nanosheet inducing subtle lattice distortion for efficiently triggering hydrogen evolution. J. Am. Chem. Soc. 138(15), 5087 (2016).View ArticleGoogle Scholar
- A.A. El-Fergany, A.Y. Abdelaziz, Capacitor allocations in radial distribution networks using cuckoo search algorithm. Iet Generation Transm. Distrib. 8(2), 223–232 (2014).View ArticleGoogle Scholar
- S. Sultana, P.K. Roy, Multi-objective quasi-oppositional teaching learning based optimization for optimal location of distributed generator in radial distribution systems. Int. J. Electr. Power Energy Syst. 63(12), 534–545 (2014).View ArticleGoogle Scholar
- D. Wang, Z. Wang, C. Wang, et al., Distorted MoS2 nanostructures: an efficient catalyst for the electrochemical hydrogen evolution reaction. Electrochem. Commun. 34(5), 219–222 (2013).View ArticleGoogle Scholar
- S.H. Thomas, S. Liu, Analysis of low transformation temperature welding (LTTW) consumables: distortion control and evolution of stresses. Sci. Technol. Welding Join. 19(5), 392–401 (2014).View ArticleGoogle Scholar
- C. Andújar, V. Soria-Carrasco, J. Serrano, et al., Congruence test of molecular clock calibration hypotheses based on Bayes factor comparisons. Methods Ecol. Evol. 5(3), 226–242 (2014).View ArticleGoogle Scholar