Transfer Learning Method Using Ontology for Heterogeneous Multi-agent Reinforcement Learning

Abstract

This paper presents a framework, called the knowledge co-creation framework (KCF), for heterogeneous multiagent robot systems that use a transfer learning method. A multiagent robot system (MARS) that utilizes reinforcement learning and a transfer learning method has recently been studied in realworld situations. In MARS, autonomous agents obtain behavior autonomously through multi-agent reinforcement learning and the transfer learning method enables the reuse of the knowledge of other robots’ behavior, such as for cooperative behavior. Those methods, however, have not been fully and systematically discussed. To address this, KCF leverages the transfer learning method and cloud-computing resources. In prior research, we developed ontology-based inter-task mapping as a core technology for hierarchical transfer learning (HTL) method and investigated its effectiveness in a dynamic multi-agent environment. The HTL method hierarchically abstracts obtained knowledge by ontological methods. Here, we evaluate the effectiveness of HTL with a basic experimental setup that considers two types of ontology: action and state.

Authors and Affiliations

Hitoshi Kono, Akiya Kamimura, Kohji Tomita, Yuta Murata, Tsuyoshi Suzuki

Keywords

Related Articles

Detection and Classification of Mu Rhythm using Phase Synchronization for a Brain Computer Interface

Phase synchronization in a brain computer interface based on Mu rhythm is evaluated by means of phase lag index and weighted phase lag index. In order to detect and classify the important features reflected in brain sign...

Using the Sub-Game Perfect Nash Equilibrium to Deduce the Effect of Government Subsidy on Consumption Rates and Prices

Governments are interested in inducing positive habits and behaviors in its citizens and discouraging ones that are harmful to the individual or to the society. Taxation and legislation are usually used to discourage neg...

Multicast Routing with Load Balancing in Multi-Channel Multi-Radio Wireless Mesh Networks

By an increasing expansion of multimedia services and group communication applications, the need for multicast routing to respond to multicast requests in wireless mesh networks is felt more than before. One of the main...

Digital Technology Disorder: Justification and a Proposed Model of Treatment

Due to advances in technology being made at an exponential rate, organisations are attempting to compete with one another by utilising state-of-the-art technology to provide innovative products and services that encourag...

Analyzing the Changes in Online Community based on Topic Model and Self-Organizing Map

In this paper, we propose a new model for two purposes: (1) discovering communities of users on social networks via topics with the temporal factor and (2) analyzing the changes in interested topics and users in communit...

Download PDF file
  • EP ID EP100049
  • DOI 10.14569/IJACSA.2014.051022#sthash.yjFX63PH.dpuf
  • Views 101
  • Downloads 0

How To Cite

Hitoshi Kono, Akiya Kamimura, Kohji Tomita, Yuta Murata, Tsuyoshi Suzuki (2014). Transfer Learning Method Using Ontology for Heterogeneous Multi-agent Reinforcement Learning. International Journal of Advanced Computer Science & Applications, 5(10), 156-164. https://europub.co.uk./articles/-A-100049