XCS with an internal action table for non-Markov environments
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2014, Vol 5, Issue 6
Abstract
To cope with sequential decision problems in non- Markov environments, learning classifier systems using the internal register have been proposed. Since, by utilizing the action part of classifiers, these systems control the internal register in the same way as choosing actions to the environment, they do not always work well. In this paper, we develop an effective learning classifier system with two different rule sets for internal and external actions. The first one is used for determining internal actions, that is, rules for controlling the internal register. It provides stable performance by separating control of the internal register from the action part of classifiers, and it is represented by “If [external state] & [internal state] then [internal action],” and we call a set of the first rules the internal action table. The second one is for selecting external actions as in the classical classifier system, but its structure is slightly different with the classical one; it is represented by “If [external state] & [internal state] & [internal action] then [external action].” In the proposed system, aliased states in the environment are identified by observing payoffs of a classifier and referring to the internal action table. To demonstrate the efficiency and effectiveness of the proposed system, we apply it to woods environments which are used in the related works, and compare the performance of it to those of the existing classifier systems.
Authors and Affiliations
Tomohiro Hayashida, Ichiro Nishizaki, Keita Moriwake
Keywords
Related Articles
- EP ID EP126663
- DOI 10.14569/IJACSA.2014.050626
- Views 88
- Downloads 0
Towards Implementing Framework to Generate Myopathic Signals
In this paper, we describe a simulation system of myopathicsurface electromyography (sEMG) signals. The architecture of the proposed system consists of two cascading modules. SEMG signals of three pathological skeletal m...
Empirical Analyis of Public ICT Development Project Objectives in Hungary
E-government development in most European countries was ensured from Structural Funds in the period of 2007-2014. In our paper we show how Hungary has used these funds in order to achieve efficiency and effectiveness in...
Cross-Organizational Information Systems: A Case for Educational Data Mining
Establishing a new organization is becoming more difficult day by day due to the extremely competitive business environment. A new organization may not have enough experience to survive in the competitive market; which i...
A Multimedia System for Breath Regulation and Relaxation
In the hectic life today, detrimental stress has caused numerous illness. To adjust mental states, breath regulation plays a core role in multiple relaxation techniques. In this paper, we introduce a multimedia system su...
Improving Classification Accuracy of Heart Sound Signals Using Hierarchical MLP Network
Classification of heart sound signals to normal or their classes of disease are very important in screening and diagnosis system since various applications and devices that fulfilling this purpose are rapidly design and...