A Non-Deterministic Strategy for Searching Optimal Number of Trees Hyperparameter in Random Forest
Journal Title: Annals of Computer Science and Information Systems - Year 2018, Vol 15, Issue
Abstract
In this paper, we present a non-deterministic strategy for searching for optimal number of trees hyperparameter in Random Forest (RF). Hyperparameter tuning in Machine Learning (ML) algorithms is essential. It optimizes predictability of an ML algorithm and/or improves computer resources utilization. However, hyperparameter tuning is a complex optimization task and time wasting. We set up experiments with the goal of maximizing predictability, minimizing number of trees and minimizing time of execution. Compared to the deterministic algorithm, this research's non-deterministic algorithm recorded an average percentage accuracy of approximately 98\\%, number of trees percentage average improvement of 44.64\\%, average time of execution mean improvement ratio of 212.79 and an average improvement of 93\\% iterations. Moreover, evaluations using Jackkife Estimation show stable and reliable results from several experiment runs of the non-deterministic strategy. The non-deterministic approach in selecting hyperparameter shows a significant accuracy and better computer resources (i.e cpu and memory time) utilization. This approach can be adopted widely in hyperparameter tuning, and in conserving utilization of computer resources i.e green computing.
Authors and Affiliations
Kennedy Senagi, Nicolas Jouandeau
Keywords
Related Articles
- EP ID EP569796
- DOI 10.15439/2018F202
- Views 24
- Downloads 0
Soccer object motion recognition based on 3D convolutional neural networks
Due to the development of video understanding and big data analysis research field using deep learning technique, intelligent machines have replaced the tasks that people performed in the past in various fields such as t...
Ranking Rough Sets in Pawlak Approximation Spaces
By the cardinality of finite sets, interval numbers can be assigned to rough sets which are represented by nested sets. Borrowing two different comparison methods from Multiple Attribute Decision Making analysis, rough s...
Development of a mathematical model for electrode systems in rheoophthalmography
The problem of estimating the electrical impedance characteristics was solved using the system of impedance diagnostics of blood circulation with the help of mathematical modeling. In this work, the geometry for mathemat...
Testing the Algorithm of Area Optimization by Binary Classification with Use of Three State 2D Cellular Automata in Layers
The paper is dedicated to a new algorithm of optimization in the sense of the area. Proposed method joins a few issues. First one is utilizing data from the set of sensors monitoring the area put into optimization. The s...
Application of ASIP in Embedded Design with Optimized Clock Management
As the demand for high performance computing increases, new approaches have to be found to automate the design of embedded processors. Simultaneously, new tools have to be developed to short the execution time consumptio...