Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 146
- Downloads 0
Modeling and Simulation of Lac Operon Regulation of E. coli bacterium Using Intelligent Fuzzy System
Abstract: Current methodologies in displaying dynamic organic frameworks regularly need fathomability, particularly for users without scientific foundation. In this paper propose another way to deal with defeat such conf...
Characterization of the Crystalline Structure of Wheat Bran Burned by Nd: YAG Laser
Abstract:This paper reports obtaining of useful and highly value materials from wheat bran. For this purpose, wheat bran sample was burned for 30 s using Nd: YAG laser with output power 60 W. The product of synthesis pro...
Energy Conservation and Management for Houses and Building in Oman-Case study
Abstract: The interest in energy conservation and management comes from the increased demand on energy in the present day. This issue has become necessary to achieve sustainable development of the society. Energy conserv...
Zootechnical Parameters and Zoo-Genetic Management of Goat Breeds Encountered in Benin: A Review
Abstract: In rural areas, goats contribute to the reduction of malnutrition through their production of milk and meat. A review of the zootechnical and reproductive performance of goat breeds in Benin was made from ninet...
A Smart Traffic Management System for Congestion Control and Warnings Using Internet of Things (IoT)
Abstract: Over the years, there has been a sudden increase in the number of vehicles on road. Traffic congestion, is a growing problem everyone faces in their daily life. Manual control of traffic by policeman has not pr...