Design Issues in Web Crawlers and Review of Parallel Crawlers
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 127 | Views: 350

Review Papers | Computer Science & Engineering | India | Volume 5 Issue 6, June 2016 | Popularity: 6.1 / 10


     

Design Issues in Web Crawlers and Review of Parallel Crawlers

Komal, Dr. Ashutosh Dixit


Abstract: With the increase in size of web, search engine depends upon the Web Crawler to download and build index of million/billion of pages for efficient information retrieval when user interact through search interface. This paper will include the definition of Web Crawler, criteria on the basis of which various types of crawler are defined [4] and some common issues with the design of crawler, parallel crawler, its issues and comparison of solutions provided by researchers.


Keywords: WWW, URL, Mobile Crawler, Web Crawler, Mobile Agents, Parallel Crawler


Edition: Volume 5 Issue 6, June 2016


Pages: 61 - 64


DOI: https://www.doi.org/10.21275/NOV163887



Make Sure to Disable the Pop-Up Blocker of Web Browser




Text copied to Clipboard!
Komal, Dr. Ashutosh Dixit, "Design Issues in Web Crawlers and Review of Parallel Crawlers", International Journal of Science and Research (IJSR), Volume 5 Issue 6, June 2016, pp. 61-64, https://www.ijsr.net/getabstract.php?paperid=NOV163887, DOI: https://www.doi.org/10.21275/NOV163887

Similar Articles

Downloads: 105

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1617 - 1619

A Review of Domain Clustering Using Adaptive Preprocessing

Poonam Nagale, Alka Vishwa

Share this Article

Downloads: 107 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 1578 - 1583

Learning to Cluster Feedback Session for Identification of User Search Objective

Manjiri M. Kokate, Poonam D. Lambhate

Share this Article

Downloads: 107

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1434 - 1436

Method for Repossession of Content Based Video using Speech and Text Information

Manasi A. Kabade, U.A. Jogalekar

Share this Article

Downloads: 108

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1152 - 1154

A Survey on Content based Video Retrieval Using Speech and Text information

Laxmikant S. Kate, M. M. Waghmare

Share this Article

Downloads: 108

Review Papers, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016

Pages: 1600 - 1606

A Review of Web of Things and Request Dependency Graph Analysis and Mining

Preeti Gungrao Patil, Mansi Bhonsle

Share this Article



Top