International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 127 | Views: 220

Review Papers | Computer Science & Engineering | India | Volume 5 Issue 6, June 2016


Design Issues in Web Crawlers and Review of Parallel Crawlers

Komal [68] | Dr. Ashutosh Dixit


Abstract: With the increase in size of web, search engine depends upon the Web Crawler to download and build index of million/billion of pages for efficient information retrieval when user interact through search interface. This paper will include the definition of Web Crawler, criteria on the basis of which various types of crawler are defined [4] and some common issues with the design of crawler, parallel crawler, its issues and comparison of solutions provided by researchers.


Keywords: WWW, URL, Mobile Crawler, Web Crawler, Mobile Agents, Parallel Crawler


Edition: Volume 5 Issue 6, June 2016,


Pages: 61 - 64


How to Download this Article?

Type Your Valid Email Address below to Receive the Article PDF Link


Verification Code will appear in 2 Seconds ... Wait

Top