RAPID — a model of fast eye pupil registration and tracking by a modified metaheuristic differential evolution method based on the Verhulst-Pearl equation

Y. V. Grushko

Vestnik KRAUNC. Fiziko-matematičeskie nauki, Tome 38 (2022) no. 1, pp. 84-105

Résumé

This paper proposes a model of fast registration and pupil tracking — «RAPID», for devices with limited computing resource (weak personal computers, smartphones, embedded systems based on ARM architecture) in order to reduce the cost of technology for individual use by people with disabilities and medical institutions. The model is based on the idea of representing the process of video oculography as a multidimensional global optimization problem and its solution by the metaheuristic method of differential evolution. The optimization problem (objective function) is formalized as a search for the region that approximates the pupil in the three-dimensional parameter space most completely — the position and approximate size of the pupil. For the considered optimization problem we propose a modification of differential evolution method based on the process of formation of genetic isolations of population of solutions in the neighborhood of all local and global extremums of the target function followed by growth of the most adapted isolation (near the global extremum) and degeneration of others according to the differential Verhulst-Pearl equation. This behavior makes the search algorithm less «greedy» and makes it possible to correctly extract the pupil from the full frame. The developed tracking model can be used in the development of software packages in the task of augmentative communication for patients with lateral amyotrophic sclerosis or diplegia syndromes, on non-specialized devices, as well as in ophthalmological complexes and infrared-pupillometers.

Détail

Keywords: videooculography, differential evolution, multivariate global optimization, region of interest, Hough transform, Verhulst-Pearl model.

Bibliographie

[1] Oshorov A. V., Aleksandrova E. V., Muradyan K. R., Sosnovskaya O. Y., Sokolova E. Y., Savin I. A., “Pupillometry as a method of monitoring photoreactivity in neuroresuscitation”, Voprosy nejrohirurgii imeni N.N. Burdenko, 85:3 (2021), 117–123 (In Russian) | DOI

[2] Kucalo A. L., Cimbal M. V., Homich D. S., Varenikov M. G., SHtejnberg N. V., “Dynamic Pupillometry as a Screening Diagnostic Method for Industrial Toxicant Poisoning”, Medicina ekstremal'nyh situacij, 20 (2018), 487–493, (In Russian)

[3] Logroscino G., et al, “Global, regional, and national burden of motor neuron diseases 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016”, The Lancet Neurology, 17 (2018), 1083–1097 | DOI

[4] Tkachenko Ekaterina Sergeevna, Goleva Ol'ga Petrovna, SHCHerbakov Denis Viktorovich, Halikova Adel' Ravil'evna., “Cerebral Palsy: State of the Study of the Problem (Review)”, Mat' i ditya v Kuzbasse, 2 (2019), 4–9 (In Russian)

[5] Durna Y., Ari F., “Design of a Binocular Pupil and Gaze Point Detection System Utilizing High Definition Images”, Applied Sciences, 7 (2017), 498 | DOI

[6] Grushko Y. V., “Hardware-software complex of augmentative communication system based on eyetracking technology”, Vestnik KRAUNC. Fiz.-Mat. Nauki, 27:2 (2019), 55–73 (In Russian) | Zbl

[7] Bonteanu P., Cracan A., Bonteanu G., Bozomitu R. A., “Robust Pupil Detection Algorithm Based on a New Adaptive Thresholding Procedure”, IEEE International Conference on e-Health and Bioengineering EHB (2019)., 2019, 276

[8] Matveev I. A., Methods and algorithms for automatic processing of images of the iris of the eye, Dissertation for the degree of Doctor of Technical Sciences, 2014 (In Russian)

[9] Alkuzaay M., Alshemmary E., “Towards Accurate Pupil Detection Based on Morphology and Hough Transform”, Baghdad Science Journal, 17:2 (2020), 583–590 | DOI

[10] Dongheng L., Winfield D., Parkhurst D. J., “A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches”, Paper Presented at the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, v. 3, 2005, 79

[11] Fuhl W., Santini T., Kubler T., Kasneci E., “ElSe: ellipse selection for robust pupil detection in real-world environments”, The Ninth Biennial ACM Symposium, 2016, 123–130 | DOI

[12] Swirski. L. Bulling. A. Dodgson. N., “Robust real-time pupil tracking in highly off-axis images”, Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA), 2012, 173–176 | DOI

[13] Topal Cihan, CAKIR Halil, Akinlar Cuneyt, An Adaptive Algorithm for Precise Pupil Boundary Detection using Entropy of Contour Gradients, 2017

[14] Yang Z., “Intelligent Evaluation of Strabismus in Videos Based on an Automated Cover Test”, Applied Sciences, 2019, 59

[15] Fuhl Wolfgang, Geisler David, Rosenstiel Wolfgang, Kasneci Enkelejda., “The Applicability of Cycle GANs for Pupil and Eyelid Segmentation”, Data Generation and Image Refinement, 2019, 4406–4415

[16] Grushko Y. V., Parovik R. I., “Fast Pupil Tracking based on the Study of a Boundary-stepped Image Model and Multidimensional Optimization Hook-Jives Method”, Informatika i avtomatizacija – Informatics and automation, 2 (2021), 435–462 (In Russian) | DOI

[17] Chinese Academy of Sciences Institute of Automation., Iris image database, version 4 , 2021 http://www.cbsr.ia.ac.cn/china/Iris20Databases20CH.asp | Zbl

[18] Kovalevich, A. A., Jakimov A. I., Albkeirat D. M., “Study of stochastic optimization algorithms for use in simulation of systems”, Informacionnye tehnologii – Information technologies, 8 (2011), 55–60 (In Russian)

[19] Pupkov K. A., Feoktistov V. A., “Algorithm «Differential evolution» for the problem of technical design”, Informacionnye tehnologii – Information technologies, 8 (2004), 25–31 (In Russian)

[20] R. Storn, K. Price., “Differential evolution – a simple and efficient heuristic for global optimization over continuous spaces”, Journal of Global Optimization, 11:4 (1997), 341–359 | DOI | Zbl

[21] Tsoularis A. N., Wallace James., “Analysis of Logistic Growth Models”, Mathematical biosciences, 179 (2002), 21–55 | DOI | Zbl

[22] Jeyakumar Gurusamy, C. Shanmugavelayutham., “Convergence Analysis of Differential Evolution Variants on Unconstrained Global Optimization Functions”, International Journal of Artificial Intelligence and Applications, 2011

[23] Meera Ramadas, Ajith Abraham, Sushil Kumar., “FSDE-Forced Strategy Differential Evolution used for data clustering”, Journal of King Saud University - Computer and Information Sciences, 31:1 (2019), 52–61