Training an Agent for FPS Doom Game using Visual Reinforcement Learning and VizDoom

Abstract

Because of the recent success and advancements in deep mind technologies, it is now used to train agents using deep learning for first-person shooter games that are often outperforming human players by means of only screen raw pixels to create their decisions. A visual Doom AI Competition is organized each year on two different tracks: limited death-match on a known map and a full death-match on an unknown map for evaluating AI agents, because computer games are the best test-beds for testing and evaluating different AI techniques and approaches. The competition is ranked based on the number of frags each agent achieves. In this paper, training a competitive agent for playing Doom’s (FPS Game) basic scenario(s) in a semi-realistic 3D world ‘VizDoom’ using the combination of convolutional Deep learning and Q-learning by considering only the screen raw pixels in order to exhibit agent’s usefulness in Doom is proposed. Experimental results show that the trained agent outperforms average human player and inbuilt game agents in basic scenario(s) where only move left, right and shoot actions are allowed.

Authors and Affiliations

Khan Adil, Feng Jiang, Shaohui Liu, Aleksei Grigorev, B. B. Gupta, Seungmin Rho

Keywords

Related Articles

Synergies of Advanced Technologies and Role of VANET in Logistics and Transportation

In Intelligent Transport Systems (ITS), Vehicular Ad-hoc Network (VANET) is one of key wireless technologies, which helps in managing road safety, traffic efficiency, fleet, logistics and transportation. The objective of...

An Enhanced Approach for Detection and Classification of Computed Tomography Lung Cancer

The paper presents approaches for nodule detection and extraction in axial lung computed tomography. The goal is to detect correctly pulmonary nodule to recognize and screen lung cancer patients. The pulmonary nodule det...

Enhancing the Secured Software Framework using Vulnerability Patterns and Flow Diagrams

This article describes the process of simplifying the software security classification. The inputs of this process include a reference model from previous researcher and existing Common Vulnerabilities and Exposure (CVE)...

An Amplitude Modulation of Cerebral Rhythms based Method in a Motor Task BCI Paradigm

Quantitative evaluation based on amplitude modulation analysis of electroencephalographic signals is proposed for a brain computer interface paradigm. The method allows characterization of the interaction effects of diff...

Mining Trending Hash Tags for Arabic Sentiment Analysis

People text millions of posts everyday on microblogging social networking especially Twitter which make microblogs a rich source for public opinions, customer’s comments and reviews. Companies and public sectors are look...

Download PDF file
  • EP ID EP251587
  • DOI 10.14569/IJACSA.2017.081205
  • Views 102
  • Downloads 0

How To Cite

Khan Adil, Feng Jiang, Shaohui Liu, Aleksei Grigorev, B. B. Gupta, Seungmin Rho (2017). Training an Agent for FPS Doom Game using Visual Reinforcement Learning and VizDoom. International Journal of Advanced Computer Science & Applications, 8(12), 32-41. https://europub.co.uk./articles/-A-251587