Learning Behaviour by Observation for Real-Time Strategy Games

ResearchSpace/Manakin Repository

Show simple item record

dc.contributor.advisor Watson, I en
dc.contributor.author Robertson, Glen en
dc.date.accessioned 2016-07-12T21:29:02Z en
dc.date.issued 2015 en
dc.identifier.citation 2015 en
dc.identifier.uri http://hdl.handle.net/2292/29398 en
dc.description.abstract This thesis details an exploratory investigation into the use of Learning By Observation (LBO) methods for the complex domain of real-time strategy games. The domain presents a number of interesting challenges for Artificial Intelligence (AI) research, many of which are analogous to real-world challenges in robotics. The aim of this research was to reduce the human effort required to develop new AI systems for such complex domains by using LBO methods to enable an agent to learn from human examples. Case-based reasoning was applied to the problem, creating a case base associating observed game states with the actions that humans took in those situations. Even with a very simple metric for deciding which states were similar, this method was able to select appropriate enough actions to emulate a human in the very early stages of the game. However, it suffered from issues in selecting the correct order of actions, and required a relatively large amount of time to make decisions. Additionally, the existing dataset used to form the case base presented a very simplified view of the game state, with many attributes not recorded or infrequently sampled. To address the limitation in data, an improved dataset was created using the same original human match records as the dataset from prior work, but extracting much more precise and complete information. This information was also stored more efficiently so that it could be quickly and easily searched or updated. In the process of extracting and checking this information, previously undetected errors with certain records were discovered and the records removed, making the dataset more accurate than any prior work. Data mining algorithms were applied to the new dataset in order to extract association rules and frequent patterns that could be useful for online decisionmaking. Most of the tested algorithms were unsuitable to handle the large scale and complexity of the data without extensive human preprocessing, making them unsuitable for LBO. A new method was devised to find simple highconfidence rules and patterns. It was able to discover some game rules and common action sequences. An alternative approach was then taken with the dataset: player actions were used to build a behaviour tree characterising typical player actions in a match. This was achieved using a novel application of a motif-finding algorithm from computational biology to align subsections of observed action sequences. This method was able to create a tree structure that generalised a large amount of action information, making it viable as a first step in building a more compact and generalised representation of observed behaviour. en
dc.publisher ResearchSpace@Auckland en
dc.relation.ispartof PhD Thesis - University of Auckland en
dc.relation.isreferencedby UoA99264851407902091 en
dc.rights Items in ResearchSpace are protected by copyright, with all rights reserved, unless otherwise indicated. Previously published items are made available in accordance with the copyright policy of the publisher. en
dc.rights.uri https://researchspace.auckland.ac.nz/docs/uoa-docs/rights.htm en
dc.rights.uri http://creativecommons.org/licenses/by-nc-sa/3.0/nz/ en
dc.title Learning Behaviour by Observation for Real-Time Strategy Games en
dc.type Thesis en
thesis.degree.discipline Computer Science en
thesis.degree.grantor The University of Auckland en
thesis.degree.level Doctoral en
thesis.degree.name PhD en
dc.rights.holder Copyright: The Author en
dc.rights.accessrights http://purl.org/eprint/accessRights/OpenAccess en
pubs.elements-id 535457 en
pubs.record-created-at-source-date 2016-07-13 en

Full text options

This item appears in the following Collection(s)

Show simple item record

http://creativecommons.org/licenses/by-nc-sa/3.0/nz/ Except where otherwise noted, this item's license is described as http://creativecommons.org/licenses/by-nc-sa/3.0/nz/


Search ResearchSpace

Advanced Search