<abstract xmlns="http://www.w3.org/1999/xhtml"><p> Machine learning is an appealing and useful approach to creating vehicle control algorithms, both for simulated and real vehicles. One common learning scenario that is often possible to apply is learning by imitation, in which the behavior of an exemplary driver provides training instances for a supervised learning algorithm. This article follows this approach in the domain of simulated car racing, using the TORCS simulator. In contrast to most prior work on imitation learning, a symbolic decision tree knowledge representation is adopted, which combines potentially high accuracy with human readability, an advantage that can be important in many applications. Decision trees are demonstrated to be capable of representing high quality control models, reaching the performance level of sophisticated pre-designed algorithms. This is achieved by enhancing the basic imitation learning scenario to include active retraining, automatically triggered on control failures. It is also demonstrated how better stability and generalization can be achieved by sacrificing human-readability and using decision tree model ensembles. The methodology for learning control models contributed by this article can be hopefully applied to solve real-world control tasks, as well as to develop video game bots</p></abstract>

Machine learning is an appealing and useful approach to creating vehicle control algorithms, both for simulated and real vehicles. One common learning scenario that is often possible to apply is learning by imitation, in which the behavior of an exemplary driver provides training instances for a supervised learning algorithm. This article follows this approach in the domain of simulated car racing, using the TORCS simulator. In contrast to most prior work on imitation learning, a symbolic decision tree knowledge representation is adopted, which combines potentially high accuracy with human readability, an advantage that can be important in many applications. Decision trees are demonstrated to be capable of representing high quality control models, reaching the performance level of sophisticated pre-designed algorithms. This is achieved by enhancing the basic imitation learning scenario to include active retraining, automatically triggered on control failures. It is also demonstrated how better stability and generalization can be achieved by sacrificing human-readability and using decision tree model ensembles. The methodology for learning control models contributed by this article can be hopefully applied to solve real-world control tasks, as well as to develop video game bots

Imitation learning of car driving skills with decision trees and random forests

Department of Electronics and Information Technology Warsaw University of Technology, Nowowiejska 15/19, 00-665 Warsaw, Poland

International Journal of Applied Mathematics and Computer Science

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

{"article-title":"Imitation learning of car driving skills with decision trees and random forests"}

Machine learning is an appealing and useful approach to creating vehicle control algorithms, both for simulated and real vehicles. One common learning scenario...

Imitation learning of car driving skills with decision trees and random forests

Published Online: Sep 25, 2014

Page range: 579 - 597

Received: Jan 31, 2013

DOI: https://doi.org/10.2478/amcs-2014-0042

Keywords
imitation learning, behavioral cloning, decision trees, model ensembles, random forest, control, autonomous driving, car racing

© by Paweł Cichosz

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Imitation learning of car driving skills with decision trees and random forests

Published Online: Sep 25, 2014

Page range: 579 - 597

Received: Jan 31, 2013

DOI: https://doi.org/10.2478/amcs-2014-0042

Keywordsimitation learning, behavioral cloning, decision trees, model ensembles, random forest, control, autonomous driving, car racing

© by Paweł Cichosz

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
imitation learning, behavioral cloning, decision trees, model ensembles, random forest, control, autonomous driving, car racing