Web Crawler: Essential Component of Search Engine
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064



Downloads: 111

Research Paper | Computer Science & Engineering | India | Volume 4 Issue 4, April 2015

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously, users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.

Keywords: Search Engine, Web Crawler, Crawler Policies, Techniques

Edition: Volume 4 Issue 4, April 2015

Pages: 1471 - 1474

Share this Article

How to Cite this Article?

Akshada K. Dhakade, Deepak C. Dhanwani, "Web Crawler: Essential Component of Search Engine", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SUB153343, Volume 4 Issue 4, April 2015, 1471 - 1474

Enter Your Email Address and Click Download Button





Similar Articles with Keyword 'Search Engine'

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 716 - 720

A Comprehensive Study of Elasticsearch

Nikita Kathare, O. Vinati Reddy, Dr. Vishalakshi Prabhu

Share this Article

Downloads: 47

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 10, October 2016

Pages: 1554 - 1557

Paid and Non-Paid Marketing Strategies for Search Engine Optimization

Elton D'souza; Gursheen Grewal; Divya Unnikrishnan; Neelam Phadnis

Share this Article

Downloads: 98 | Weekly Hits: ⮙5

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1578 - 1582

A Survey Paper on To Retrieve the Relevant Images according to Re-Ranking of Images with Click based Similarity and Typicality

Deepak B. Waghchaure, K. N. Shedge

Share this Article

Downloads: 102 | Weekly Hits: ⮙3 | Monthly Hits: ⮙12

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2578 - 2580

Developing an Effective System for Keyword Based Query Processing

Ashwini P. Kshirsagar, G.M.Bhandari

Share this Article

Downloads: 102 | Monthly Hits: ⮙8

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2623 - 2626

A Novel Image Searching/Retrieving Approach using Sample Image and Text

Apurva S. Gomashe, R. R. Keole

Share this Article

Similar Articles with Keyword 'Web Crawler'

Downloads: 68 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020

Pages: 890 - 894

A Survey on Types of Crawlers and Web Searching Algorithms

T. Yogameera, Dr. D. Shanthi

Share this Article

Downloads: 96 | Weekly Hits: ⮙2 | Monthly Hits: ⮙9

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1191 - 1194

Web Data Extraction by Using Trinity

Sayali Khodade, Nilav Mukharjee

Share this Article

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 107

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1580 - 1582

Personalized Web Search using Ontology and Page Ranking

A. N. R. Latha Kumari

Share this Article

Downloads: 110

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 681 - 686

An Evolving Approach on Efficient Web Crawler using Fuzzy Genetic Algorithm

P. Jaganathan, T. Karthikeyan

Share this Article

Similar Articles with Keyword 'Techniques'

Downloads: 108 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 1375 - 1390

A Survey of Thinning Techniques on Two Dimensional Binary Images

Moumita Sarkar, Santanu Chatterjee

Share this Article

Downloads: 153

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 8, August 2017

Pages: 868 - 874

Study of Power Management in Adhoc Networks

Anandhi Giri, S. K. Srivatsa

Share this Article

Downloads: 1

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2205 - 2207

A Survey of Generating Multi-Document Summarizations

Patil Ajita S., P. M. Mane

Share this Article

Downloads: 1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 4, April 2021

Pages: 1213 - 1218

Sentiment Analysis of Twitter Data to Analyze the Acceptance of Aadhaar

Aarushi Thakral, Vasantha W. B.

Share this Article

Downloads: 1 | Monthly Hits: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021

Pages: 948 - 951

Survey on Various Image Segmentation Techniques

Babita Chauhan

Share this Article



Top