Playing Connect6 With Threat Space Search And Temporal Difference Learning

Abstract

In this paper we combine threat space search (TSS) and temporal difference (TD) learning to create three bots for the board game Connect6. By using TD learning to train a novel evaluation function based on a neural network, our best bot, Bryony, performs better than 89% of all Connect6 players on the board game website Little Golem (littlegolem.net).