A Contemplating approach for Hive and Map reduce for efficient Big Data Implementation
Journal Title: Annals of Computer Science and Information Systems - Year 2018, Vol 14, Issue
Abstract
In the reference current scenario, data is incremented exponentially and speed of data accruing at the rate of petabytes. Big data defines the available amount of data over the different media or wide communication media internet. Big Data term refers to the explosion in the quantity (and quality) of available and potentially relevant data. On the basis of quantity amount of data are very huge and this quantity has been handled by conventional database systems and data warehouses because the amount of data increases similarly complexity with it also increases. Multiple areas are involved in the production, generation, and implementation of Big Data such as news media, social networking sites, business applications, industrial community, and much more. Some parameters concern with the handling of Big Data like Efficient management, proper storage, availability, scalability, and processing. Thus to handle this big data, new techniques, tools, and architecture are required. In the present paper, we have discussed different technology available in the implementation and management of Big Data. This paper contemplates an approach formal tools and techniques used to solve the major difficulties with Big Data, This evaluate different industries data stock exchange to covariance factor and it tells the significance of data through covariance positive result using hive approach and also how much hive approach is efficient for that in the term of HDFS and hive query. and also evaluates the covariance factors after applying hive and map reduce approaches with stock exchange dataset of around 3500.After process data with the hive approach we have conclude that hive approach is better than map reduce and big table in terms of storage and processing of Big Data.
Authors and Affiliations
Gopinadh Sasubilli, Uday Shankar Sekhar, Ms. Surbhi Sharma, Ms. Swati Sharma
Keywords
Related Articles
- EP ID EP569750
- DOI 10.15439/2017KM20
- Views 23
- Downloads 0
Optimizing Maintenance in Project Management by Considering HSE and Resilience Engineering
One of the most important objectives of project management is to complete the project within the specified completion date of the project. Another important objective of project is to terminate the project by minimum rat...
An Approach towards economical hierarchic Search over Encrypted Cloud
In display, Cloud registering is the prevailing area in data innovation. With expanded value of information outsourcing of cloud information protection of delicate information turns into a major issue. For the security r...
A Perspective Approach (OABC) Algorithm using Square Odd Routing for minimized Energy Consumption
ABC set of principles has been already proposed furthermore with some drove guidelines, yet the length of the work parameter has been spinning round detecting the hubs in static or dynamic way with no accentuation at the...
Analysis of inter-channel dependencies in audio lossless block coding
In this paper the basics of data predictive modeling (using the method of minimization mean square error) for lossless audio compression are presented. The described research focuses on inter-channel analysis and setting...
Automated generator for complex and realistic test data—a case study
Some type of tests, especially stress tests and functional tests, require a large amount of realistic test data. In this paper, we propose a tool JOP (Java Object Populator) that uses a pseudorandom number generator in o...