DATA PROCESSING AND ANALYSIS USING APACHE SPARK

Abstract

Analysis and research of the solution of the problem of distributed data processing with the help of Apache Spark. This article presents an investigation of modern data processing methods and identifies their advantages and disadvantages in the context of requirements for a distributed system. Apache Spark's approach to solving distributed data processing problems is shown. It is demonstrated on test cases using Apache Spark.

Authors and Affiliations

Sergei Lovchinsky

Keywords

Related Articles

PIPELINE SYSTEM AS THE GEO-ECONOMIC FACTOR IN

The article highlights the importance of pipeline transport in oil and gas supplies to consumers, its impact on the expansion of relationships between the countries-producers and countries-consumers of energy resources;...

TO THE PROBLEM OF PROFESSIONAL MOBILITY OF THE TEACHER COLLEGE

The article presents the conditions of development of readiness of College teacher to professional mobility. Reviewed scientific approaches regarding the interpretation of the concept of «mobility», «professional mobilit...

HOME EXPERIMENTAL WORK OF STUDENTS OF HUMANITARIAN SPECIALTIES OF THE COLLEGE

The study of the natural sciences is intended to familiarize oneself with the foundations of sciences, to reveal the possibilities and prospects for the development of modern science and technology. An important componen...

UNFAIR COMPETITION AS A TYPE OF ECONOMIC OFFENCE

In the article the author analyzes and generalizes the existing theoretical approaches to unfair competition as a type of economic offense. The types and forms of unfair competition are analyzed. The article defines resp...

PHOTOSENSITIVE HETEROSTRUCTURE OF GaTe — THIN NANOSTRUCTURED DIELECTRIC — InSe

Heterostructure p-GaTe — n-InSe was prepared by the method of mechanical contact of GaTe oxidized plate with van der Waals surface of InSe. Topology of surfaces of GaTe and InSe layered crystals were studied by using AFM...

Download PDF file
  • EP ID EP302734
  • DOI -
  • Views 94
  • Downloads 0

How To Cite

Sergei Lovchinsky (2017). DATA PROCESSING AND ANALYSIS USING APACHE SPARK. Международный научный журнал "Интернаука", 1(9), 40-44. https://europub.co.uk./articles/-A-302734