Highly Available Hadoop Name Node Architecture-Using Replicas of Name Node with Time Synchronization among Replicas
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2014, Vol 16, Issue 3
Abstract
Abstract : Hadoop is a Java software framework that supports data - intensive distributed applications and is developed under open source license. It enables applications to work with thousands of nodes and petabytes of data. The two major pieces of Hadoop are HDFS and MapReduce. HDFS works with two types of hardware machines, the DataNode (Slave machine) which is the machine on which application’s data is stored and the NameNode (Master machine) which store the metadata of file system. Where NameNode is the only single machine for storing metadata of file system and is the Single Point of Failure (SPOF) for the HDFS. SPOF of NameNode machine affects the overall availability of Hadoop. When NameNode goes down the entire system become offine and cannot do any operation until NameNode gets restart. If the NameNode machine fails, the system needs to be re-started manually, making the system less available. This paper proposes a highly available architecture and its working principle for the HDFS NameNode against its SPOF utilizing well-known 2-Phase Commit (2PC) Protocol and election by bully with Time synchronization mechanism.
Authors and Affiliations
Soubhagya V N , Nikhila T Bhuvan
Keywords
Related Articles
- EP ID EP99757
- DOI 10.9790/0661-16325862
- Views 120
- Downloads 0
Scalable and Cost Effective Solution to Minimum Cost Forwarding in WSN
Abstract: This paper introduces an improved routing protocol for wireless sensor networks (WSN), built on the basis of fundamental concepts in source based minimum cost forwarding protocol. Neither routing tables nor net...
Artificially Intelligent Investment Risk Calculation system based on Distributed Data Mining
Abstract:- In the present days of e-commerce and social engineering the use of artificial intelligent system and data mining is one of the most relevant issue. Several investment sector giants use highly developed data m...
Towards Automated Generation of ER-Diagram using a Web Based Approach
Abstract : Diagrams plays an important role in the software development process. Drawing the diagrams manually is the time consuming task, so there are many tools to draw and modify the diagram. From all the diagrams ER...
Improving operational efficiencies using Big Data for Financial Services
Abstract: Financial services organizations around the world are experiencing drastic change. Financial services firms are turning to big data technologies and Hadoop to reduce risk, analyze fraud patterns. Ability of Big...
Face Recognition using Feed Forward Neural Network
Abstract: In this paper, we propose four techniques for extraction of facial features namely 2DPCA, LDA, KPCA and KFA. The purpose of face feature extraction is to capture certain discriminative features that are unique...