- Research Article
Perceptual Image Representation
EURASIP Journal on Image and Video Processingvolume 2007, Article number: 098181 (2007)
This paper describes a rarity-based visual attention model working on both still images and video sequences. Applications of this kind of models are numerous and we focus on a perceptual image representation which enhances the perceptually important areas and uses lower resolution for perceptually less important regions. Our aim is to provide an approximation of human perception by visualizing its gradual discovery of the visual environment. Comparisons with classical methods for visual attention show that the proposed algorithm is well adapted to anisotropic filtering purposes. Moreover, it has a high ability to preserve perceptually important areas as defects or abnormalities from an important loss of information. High accuracy on low-contrast defects and scalable real-time video compression may be some practical applications of the proposed image representation.
Hubel DH: Eye, Brain, and Vision, Scientific American Library, no. 22. W. H. Freeman, New York, NY, USA; 1989.
Treisman AM, Gelade G: A feature-integration theory of attention. Cognitive Psychology 1980,12(1):97-136. 10.1016/0010-0285(80)90005-5
Crabtree JW, Spear PD, McCall MA, Jones KR, Kornguth SE: Contributions of Y- and W-cell pathways to response properties of cat superior colliculus neurons: comparison of antibody- and deprivation-induced alterations. Journal of Neurophysiology 1986,56(4):1157-1173.
Itti L, Koch C: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 2000,40(10–12):1489-1506.
Le Meur O, Le Callet P, Barba D, Thoreau D: A coherent computational approach to model bottom-up visual attention. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006,28(5):802-817.
Walker KN, Cootes TF, Taylor CJ: Locating salient object features. Proceedings of the 9th British Machine Vision Conference (BMVC '98), September 1998, Southampton, UK 2: 557-566.
Mudge TN, Turney JL, Volz RA: Automatic generation of salient features for the recognition of partially occluded parts. Robotica 1987,5(2):117-127. 10.1017/S0263574700015083
Stentiford FWM: An estimator for visual attention through competitive novelty with application to image compression. Proceedings of the 22nd Picture Coding Symposium (PCS '01), April 2001, Seoul, Korea 101-104.
Boiman O, Irani M: Detecting irregularities in images and in video. Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), October 2005, Beijing, China 1: 462-469.
Itti L, Baldi P: A principled approach to detecting surprising events in video. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), June 2005, San Diego, Calif, USA 1: 631-637.
Näätänen R, Gaillard AWK, Mäntysalo S: Early selective-attention effect on evoked potential reinterpreted. Acta Psychologica 1978,42(4):313-329. 10.1016/0001-6918(78)90006-9
Tales A, Newton P, Troscianko T, Butler S: Mismatch negativity in the visual modality. NeuroReport 1999,10(16):3363-3367. 10.1097/00001756-199911080-00020
Crottaz-Herbette S: Attention spatiale auditive et visuelle chez des patients héminégligents et des sujets normaux: étude clinique, comportementale et électrophysiologique, M.S. thesis. University of Geneva, Geneva, Switzerland; 2001.
Tribus M: Thermodynamics and Thermostatics: An Introduction to Energy, Information and States of Matter, with Engineering Applications. D. Van Nostrand, New York, NY, USA; 1961.
Stanford LR: W-cells in the cat retina: correlated morphological and physiological evidence for two distinct classes. Journal of Neurophysiology 1987,57(1):218-244.
Mancas M, Mancas-Thillou C, Gosselin B, Macq B: A rarity-based visual attention map: application to texture description. Proceedings of IEEE International Conference on Image (ICIP '06), September 2006, San Antonio, Tex, USA 445-448.
Mancas M, Unay B, Gosselin B, Macq D: Computational attention for defect localisation. Proceedings of ICVS Workshop on Computational Attention & Applications (WCAA '07), March 2007, Bielefeld, Germany
Wren CR, Azarbayejani A, Darrell T, Pentland AP: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997,19(7):780-785. 10.1109/34.598236
Bradley AP, Stentiford FWM: JPEG 2000 and region of interest coding. Digital Image Computing: Techniques and Applications (DICTA '02), January 2002, Melbourne, Australia 303-308.
Perona P, Malik J: Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990,12(7):629-639. 10.1109/34.56205
Barash D, Comaniciu D: A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. Image and Vision Computing 2004,22(1):73-81. 10.1016/j.imavis.2003.08.005