OATAO - Open Archive Toulouse Archive Ouverte Open Access Week

Deep Reinforcement Learning in Strategic Board Game Environments

Konstantia, Xenou and Chalkiadakis, Georgios and Afantenos, Stergos Deep Reinforcement Learning in Strategic Board Game Environments. (2019) In: 16th European Conference on Multi-Agent Systems (EUMAS 2018), 6 December 2018 - 7 December 2018 (Bergen, Norway).

(Document in English)

PDF (Author's version) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: https://doi.org/10.1007/978-3-030-14174-5_16


In this paper we propose a novel Deep Reinforcement Learning (DRL) algorithm that uses the concept of “action-dependent state features”, and exploits it to approximate the Q-values locally, employing a deep neural network with parallel Long Short Term Memory (LSTM) components, each one responsible for computing an action-related Q-value. As such, all computations occur simultaneously, and there is no need to employ “target” networks and experience replay, which are techniques regularly used in the DRL literature. Moreover, our algorithm does not require previous training experiences, but trains itself online during game play. We tested our approach in the Settlers Of Catan multi-player strategic board game. Our results confirm the effectiveness of our approach, since it outperforms several competitors, including the state-of-the-art jSettler heuristic algorithm devised for this particular domain.

Item Type:Conference or Workshop Item (Paper)
Additional Information:Thanks to Springer editor. This papers appears in Volume 11450 of Lecture Notes in Computer Science ISSN : 0302-9743 ISBN: 978-3-030-14173-8 The original PDF is available at: https://link.springer.com/chapter/10.1007%2F978-3-030-14174-5_16
HAL Id:hal-02124411
Audience (conference):International conference proceedings
Uncontrolled Keywords:
Institution:French research institutions > Centre National de la Recherche Scientifique - CNRS (FRANCE)
Université de Toulouse > Institut National Polytechnique de Toulouse - Toulouse INP (FRANCE)
Université de Toulouse > Université Toulouse III - Paul Sabatier - UT3 (FRANCE)
Université de Toulouse > Université Toulouse - Jean Jaurès - UT2J (FRANCE)
Université de Toulouse > Université Toulouse 1 Capitole - UT1 (FRANCE)
Other partners > Technical University of Crete (GREECE)
Laboratory name:
Deposited On:05 Apr 2019 09:50

Repository Staff Only: item control page