ETL TECHNOLOGY AS AN APPROACH TO DATA INTEGRATION
Journal Title: Международный научный журнал "Интернаука" - Year 2018, Vol 2, Issue 19
Abstract
This article is devoted to the study of the corporate data integration problem. The aim of the work is the analysis of the existing ways of big data integration and implementation of a software system that allows the implementation of the full cycle of data extraction, transformation, and load (ETL). Most of the information required for analytical applications stored in the corporate management systems, databases and individual user files. Data integration tools provide the necessary infrastructure for converting disparate data sources into a single resource. When the company starts an integrated enterprise data warehouse (EDW) development, the number of data streams increases many times. For efficient use of EDW, it requires data on all aspects of the enterprise operations and the transfer of large volumes of detailed data from each source system to the warehouse. The main problem of data integration is the use of a large number of tools and technologies for solving integration problems in organizations. However, the effectiveness of such solutions drops with an increase in data streams quantity. In order to ensure effective integration, tools that can provide a general overview and management of all data flows are needed. Tools for integration should work equally effective with all DBMS used by the organization, data sources, messaging systems, etc. The integration method developed and presented in the article is designed for small enterprises that work with large data volumes that require low cost, easy to deploy and scale solutions. The features of work with data for small enterprises were investigated. Based on them, the requirements for the input data, as well as methods of their filtration and cleaning are formulated. The result of the work is a developed algorithm and data loading procedure into a prepared data warehouse.
Authors and Affiliations
Andriy Zhmurkevych, Iryna Rozhok
Keywords
Related Articles
- EP ID EP611749
- DOI -
- Views 67
- Downloads 0
MORPHOLOGICAL AND PHYSIOLOGICAL FEATURES OF KARAKUL SHEEP, AND CHEMICAL AND BOTANICAL COMPOSITION OF PASTURE GRASS
Article presents the results of long-term observations for the study of the productivity of natural pastures located in areas of mountainous and foothill areas of the Republic of Uzbekistan. Also presented and interprete...
MEANING OF MARKETING AUDIT IN BUSINESS OF MODERN COMPANY
Govern of marketing joint after characteristic: organization of govern of marketing and processing of organization structure; optimization of management decision; marketing audit; estimation of marketing job effect. In m...
ЦЕЛИ И ОСОБЕННОСТИ РОССИЙСКОЙ ВНЕШНЕЙ ПОЛИТИКИ
В данной статье обсуждались цели и особенности внешней политики Российской Федерации. Также уделялось особое внимание внешней политики России на Ближнем Востоке. Рассматривалась стратегия Владимира Путина по возвращению...
CHINA STRATEGY IN CENTRAL ASIA IN THE BELT AND ROAD INITIATIVE CONTEXT
Evolution of the Beijing strategy in Central Asia promulgated by the changes in the Western policies towards China and formation of the Eurasian economic union. The Beijing belt and road initiative as a broader context f...
IMPROVEMENT OF SURFACE MECHANICAL CHARACTERISTICS OF ROLLING INSTRUMENTS BY IONIC IMPLANTATION
In the work the pig-iron rolls surface was modified by Mo, Cr, N ions by ionic implantation. It is established that superficial coatings CrN and MoN which in 2,5 times accordingly raise superficial hardness prolong servi...