Reinforcement Learning for Predictive Analytics in Smart Cities
Journal Title: Informatics - Year 2017, Vol 4, Issue 3
Abstract
The digitization of our lives cause a shift in the data production as well as in the required data management. Numerous nodes are capable of producing huge volumes of data in our everyday activities. Sensors, personal smart devices as well as the Internet of Things (IoT) paradigm lead to a vast infrastructure that covers all the aspects of activities in modern societies. In the most of the cases, the critical issue for public authorities (usually, local, like municipalities) is the efficient management of data towards the support of novel services. The reason is that analytics provided on top of the collected data could help in the delivery of new applications that will facilitate citizens’ lives. However, the provision of analytics demands intelligent techniques for the underlying data management. The most known technique is the separation of huge volumes of data into a number of parts and their parallel management to limit the required time for the delivery of analytics. Afterwards, analytics requests in the form of queries could be realized and derive the necessary knowledge for supporting intelligent applications. In this paper, we define the concept of a Query Controller (QC) that receives queries for analytics and assigns each of them to a processor placed in front of each data partition. We discuss an intelligent process for query assignments that adopts Machine Learning (ML). We adopt two learning schemes, i.e., Reinforcement Learning (RL) and clustering. We report on the comparison of the two schemes and elaborate on their combination. Our aim is to provide an efficient framework to support the decision making of the QC that should swiftly select the appropriate processor for each query. We provide mathematical formulations for the discussed problem and present simulation results. Through a comprehensive experimental evaluation, we reveal the advantages of the proposed models and describe the outcomes results while comparing them with a deterministic framework.
Authors and Affiliations
Kostas Kolomvatsos and Christos Anagnostopoulos
Keywords
Related Articles
- EP ID EP44101
- DOI https://doi.org/10.3390/informatics4030016
- Views 276
- Downloads 0
Social Media Providing an International Virtual Elective Experience for Student Nurses
The advances in social media offer many opportunities for developing understanding of different countries and cultures without any implications of travel. Nursing has a global presence and yet it appears as though stud...
Big Data in the Era of Health Information Exchanges: Challenges and Opportunities for Public Health
Public health surveillance of communicable diseases depends on timely, complete, accurate, and useful data that are collected across a number of healthcare and public health systems. Health Information Exchanges (HIEs)...
Evaluating Awareness and Perception of Botnet Activity within Consumer Internet-of-Things (IoT) Networks
The growth of the Internet of Things (IoT), and demand for low-cost, easy-to-deploy devices, has led to the production of swathes of insecure Internet-connected devices. Many can be exploited and leveraged to perform l...
Self-Adaptive Multi-Sensor Activity Recognition Systems Based on Gaussian Mixture Models
Personal wearables such as smartphones or smartwatches are increasingly utilized in everyday life. Frequently, activity recognition is performed on these devices to estimate the current user status and trigger automate...
What Is This Sensor and Does This App Need Access to It?
Mobile sensors have already proven to be helpful in different aspects of people’s everyday lives such as fitness, gaming, navigation, etc. However, illegitimate access to these sensors results in a malicious program ru...