Geodesic
Deep learning of adaptive control systems based on a logical-probabilistic approach
The Bulletin of Irkutsk State University. Series Mathematics, Tome 38 (2021), pp. 65-83 Cet article a éte moissonné depuis la source Math-Net.Ru

Voir la notice de l'article

The problem of automatic selection of subgoals is currently one of the most relevant in adaptive control problems, in particular, in Reinforcement Learning. This paper proposes a logical-probabilistic approach to the construction of adaptive learning control systems capable of detecting deep implicit subgoals. The approach uses the ideas of the neurophysiological Theory of functional systems to organize the control scheme, and logical-probabilistic methods of machine learning to train the rules of the system and identify subgoals. The efficiency of the proposed approach is demonstrated by an example of solving a three-stage foraging problem containing two nested implicit subgoals.
Keywords: control system, machine learning, knowledge discovery, reinforcement learning. 
@article{IIGUM_2021_38_a4,
     author = {A. V. Demin},
     title = {Deep learning of adaptive control systems based on a logical-probabilistic approach},
     journal = {The Bulletin of Irkutsk State University. Series Mathematics},
     pages = {65--83},
     year = {2021},
     volume = {38},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/IIGUM_2021_38_a4/}
}
TY  - JOUR
AU  - A. V. Demin
TI  - Deep learning of adaptive control systems based on a logical-probabilistic approach
JO  - The Bulletin of Irkutsk State University. Series Mathematics
PY  - 2021
SP  - 65
EP  - 83
VL  - 38
UR  - http://geodesic.mathdoc.fr/item/IIGUM_2021_38_a4/
LA  - ru
ID  - IIGUM_2021_38_a4
ER  - 
%0 Journal Article
%A A. V. Demin
%T Deep learning of adaptive control systems based on a logical-probabilistic approach
%J The Bulletin of Irkutsk State University. Series Mathematics
%D 2021
%P 65-83
%V 38
%U http://geodesic.mathdoc.fr/item/IIGUM_2021_38_a4/
%G ru
%F IIGUM_2021_38_a4
A. V. Demin. Deep learning of adaptive control systems based on a logical-probabilistic approach. The Bulletin of Irkutsk State University. Series Mathematics, Tome 38 (2021), pp. 65-83. http://geodesic.mathdoc.fr/item/IIGUM_2021_38_a4/

[1] Anohin P. K., “Fundamental questions of the general theory of functional systems”, The principles of the systemic organization of functions, Science Publ, M., 1973, 5–61 (in Russian)

[2] Vityaev E. E., Extracting Knowledge from Data. Computer Cognition. Models of Cognitive Processes, Novosibirsk State University Publ, Novosibirsk, 2006, 293 pp. (in Russian)

[3] Demin A. V., Vityaev E. E., “A Logical Model of an Adaptive Control System”, Neiroinformatika, 3:1 (2008), 79–107 (in Russian)

[4] Demin A. V., Vityaev E. E., “Relational approach to knowledge discovery and its application”, Materials of the All-Russian conference with international participation “Knowledge–Ontology–Theories”, KONT-2013 (Novosibirsk, 2013), v. 1, 122–130 (in Russian)

[5] Al-Emran Mostafa, “Hierarchical Reinforcement Learning: A Survey”, IJCDS Journal, 4:2 (2015), 137–142 | DOI

[6] Dietterich T. G., “Hierarchical reinforcement learning with the MAXQ value function decomposition”, Journal of Artificial Intelligence Research, 3 (2000), 227–303 | DOI

[7] Goodfellow Ian, Bengio Yoshua, Courville Aaron, Deep learning, The MIT Press, 2016, 800 pp.

[8] V. Mnih et al., “Human-level control through deep reinforcement learning”, Nature, 518 (2015), 529–533 | DOI

[9] D. Silver et al., “Mastering the game of Go with deep neural networks and tree search”, Nature, 529 (2016), 484–489 | DOI

[10] Sutton R. S., Barto A. G., Reinforcement Learning, MIT Press, London, 2012, 320 pp.

[11] Vityaev E. E., Demin A. V., Kolonin Y. A., “Logical probabilistic biologically inspired cognitive architecture”, Artificial General Intelligence – 13th International Conference, AGI 2020, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12177, Springer Gabler, 2020, 337–346 | DOI

[12] Vityaev E. E., Demin A. V., “Cognitive architecture based on the functional systems theory”, Procedia Computer Science, 145 (2018), 623–628 | DOI

[13] Vityaev E. E., Demin A. V., “Recursive subgoals discovery based on the Functional Systems Theory”, Biologically Inspired Cognitive Architectures, IOS Press, 2011, 425–430

[14] Zhou Zhi-Hua, Feng Ji, “Deep Forest: Towards An Alternative to Deep Neural Networks”, Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, 2017, 3553–3559 | DOI

[15] Zhou Zhi-Hua, Feng Ji, “Deep Forest”, National Science Review, 6:1 (2019), 74–86 | DOI