Before We Can Find a Model, We Must Forget about Perfection
Serdica Journal of Computing, Tome 15 (2022) no. 2, pp. 85-128.

Voir la notice de l'article provenant de la source Bulgarian Digital Mathematics Library

With Reinforcement Learning we assume that a model of the world does exist. We assume furthermore that the model in question is perfect (i.e. it describes the world completely and unambiguously). This article will demonstrate that it does not make sense to search for the perfect model because this model is too complicated and practically impossible to find. We will show that we should abandon the pursuit of perfection and pursue Event-Driven (ED) models instead. These models are generalization of Markov Decision Process (MDP) models. This generalization is essential because nothing can be found without it. Rather than a single MDP, we will aim to find a raft of neat simple ED models each one describing a simple dependency or property. In other words, we will replace the search for a singular and complex perfect model with a search for a large number of simple models.
Keywords: Artificial Intelligence, Reinforcement Learning, Partial Observability, Event-Driven Model, Definition of Object
@article{SJC_2022_15_2_a0,
     author = {Dobrev, Dimiter},
     title = {Before {We} {Can} {Find} a {Model,} {We} {Must} {Forget} about {Perfection}},
     journal = {Serdica Journal of Computing},
     pages = {85--128},
     publisher = {mathdoc},
     volume = {15},
     number = {2},
     year = {2022},
     language = {en},
     url = {http://geodesic.mathdoc.fr/item/SJC_2022_15_2_a0/}
}
TY  - JOUR
AU  - Dobrev, Dimiter
TI  - Before We Can Find a Model, We Must Forget about Perfection
JO  - Serdica Journal of Computing
PY  - 2022
SP  - 85
EP  - 128
VL  - 15
IS  - 2
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/SJC_2022_15_2_a0/
LA  - en
ID  - SJC_2022_15_2_a0
ER  - 
%0 Journal Article
%A Dobrev, Dimiter
%T Before We Can Find a Model, We Must Forget about Perfection
%J Serdica Journal of Computing
%D 2022
%P 85-128
%V 15
%N 2
%I mathdoc
%U http://geodesic.mathdoc.fr/item/SJC_2022_15_2_a0/
%G en
%F SJC_2022_15_2_a0
Dobrev, Dimiter. Before We Can Find a Model, We Must Forget about Perfection. Serdica Journal of Computing, Tome 15 (2022) no. 2, pp. 85-128. http://geodesic.mathdoc.fr/item/SJC_2022_15_2_a0/