Web Crawler: Essential Component of Search Engine
Journal Title: International Journal of Science and Research (IJSR) - Year 2015, Vol 4, Issue 4
Abstract
With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously; users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.
Authors and Affiliations
Keywords
Related Articles
- EP ID EP366220
- DOI -
- Views 97
- Downloads 0
Modeling, Simulation and Control of Flow Tank System
Process control refers the methods that are used to control and manipulating of processes variable in manufacturing a product. It has many importances in industrial processes. In this paper, a brief introduction about se...
Cloud Computing: Technical Challenges and CloudSim Functionalities
The rapid development in internet era is continuous; big organizations and individuals are finding the means that can reduce their cost of communication, storage and computing. One of these, Cloud computing is an emergin...
Vein of Galen Malformation- A Unique Congenital Malformation
Vein of Galen malformation (VGM) is a congenital arterio-venous fistula in the brain associated with cardiovascular and neurological complications leading to high morbidity and mortality. It may...
R-Restricted Steiner Problem is NP-Complete
This work aims to arrive a Steiner minimum tree with -terminals. Every full component of a Steiner tree contains almost 4 terminals. In this work, we propose to flash R-restricted Steiner problem which is NP-complete.
The Antagonism of Enterococcus Fecalis Isolated from Kefir with Salmonella Typhimurium Caused Poultry Diarrhea in Vitro
"This study was conducted to investigate the role of Enterococcus Fecalis which isolated from kefir in treatment of diarrhea chicken caused by Salmonella Typhimurium .Enterococcus Fecalis isolated from kefir on azide blo...