Web Scraper Revealing Trends of Target Products and New Insights in Online Shopping Websites
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2018, Vol 9, Issue 6
Abstract
Trillions of posts from Facebook, tweets in Twitter, photos on Instagram and e-mails on exchange servers are overwhelming the Internet with big data. This necessitates the development of such tools that can detect the frequent updates and select the required information instantly. This research work aims to implement scraper software that is capable of collecting the updated information from the target products hosted in fabulous online e-commerce websites. The software is implemented using Scrapy and Django frameworks. The software is configured and evaluated across different e-commerce websites. Individual website generates a greater amount of data about the products that need to be scraped. The proposed software provides the ability to search a target product in a single consolidated place instead of searching across various websites, such as amazon.com, alibaba.com and daraz.pk. Furthermore, the scheduling mechanism enables the scraper to execute at a required frequency within a specified time frame.
Authors and Affiliations
Habib Ullah, Zahid Ullah, Shahid Maqsood, Abdul Hafeez
Keywords
Related Articles
- EP ID EP324798
- DOI 10.14569/IJACSA.2018.090658
- Views 62
- Downloads 0
Comparatative Analysis of Energy Detection Spectrum Sensing of Cognitive Radio Under Wireless Environment Using SEAMCAT
In the recent years, the Cognitive Radio technology imposed itself as a good solution to enhance the utilization of unused spectrum and globalized the radio environment for different band users that utilize or require di...
OntoVerbal: a Generic Tool and Practical Application to SNOMED CT
Ontology development is a non-trivial task requiring expertise in the chosen ontological language. We propose a method for making the content of ontologies more transparent by presenting, through the use of natural langu...
OSPF vs EIGRP: A Comparative Analysis of CPU Utilization using OPNET
Routing is difficult in enterprise networks because a packet might have to traverse many intermediary nodes to reach the final destination. The selection of an appropriate routing protocol for a large network is difficul...
Image Segmentation Via Color Clustering
This paper develops a computationally efficient process for segmentation of color images. The input image is partitioned into a set of output images in accordance to color characteristics of various image regions. The al...
Analysis and Selection of Features for Gesture Recognition Based on a Micro Wearable Device
More and More researchers concerned about designing a health supporting system for elders that is light weight, no disturbing to user, and low computing complexity. In the paper, we introduced a micro wearable dev...