Konstantia, Xenou and Chalkiadakis, Georgios and Afantenos, Stergos
Deep Reinforcement Learning in Strategic Board Game Environments.
(2019)
In: 16th European Conference on Multi-Agent Systems (EUMAS 2018), 6 December 2018 - 7 December 2018 (Bergen, Norway).
|
(Document in English)
PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader 540kB |
Official URL: https://doi.org/10.1007/978-3-030-14174-5_16
Abstract
In this paper we propose a novel Deep Reinforcement Learning (DRL) algorithm that uses the concept of “action-dependent state features”, and exploits it to approximate the Q-values locally, employing a deep neural network with parallel Long Short Term Memory (LSTM) components, each one responsible for computing an action-related Q-value. As such, all computations occur simultaneously, and there is no need to employ “target” networks and experience replay, which are techniques regularly used in the DRL literature. Moreover, our algorithm does not require previous training experiences, but trains itself online during game play. We tested our approach in the Settlers Of Catan multi-player strategic board game. Our results confirm the effectiveness of our approach, since it outperforms several competitors, including the state-of-the-art jSettler heuristic algorithm devised for this particular domain.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | Thanks to Springer editor. This papers appears in Volume 11450 of Lecture Notes in Computer Science ISSN : 0302-9743 ISBN: 978-3-030-14173-8 The original PDF is available at: https://link.springer.com/chapter/10.1007%2F978-3-030-14174-5_16 |
HAL Id: | hal-02124411 |
Audience (conference): | International conference proceedings |
Uncontrolled Keywords: | |
Institution: | French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE) Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE) Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE) Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE) Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE) Other partners > Technical University of Crete (GREECE) |
Laboratory name: | |
Statistics: | download |
Deposited On: | 05 Apr 2019 09:50 |
Repository Staff Only: item control page