International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Most Trusted Research Journal Since Year 2012

ISSN: 2319-7064



Research Paper | Computer Science & Engineering | India | Volume 4 Issue 4, April 2015

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously, users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.

Keywords: Search Engine, Web Crawler, Crawler Policies, Techniques

Edition: Volume 4 Issue 4, April 2015

Pages: 1471 - 1474


How to Cite this Article?

Akshada K. Dhakade, Deepak C. Dhanwani, "Web Crawler: Essential Component of Search Engine", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SUB153343, Volume 4 Issue 4, April 2015, 1471 - 1474

22 PDF Views | 20 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Search Engine'

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 6, June 2020

Pages: 1151 - 1153

Search Engine Optimization (SEO) Techniques

Kanika Arora

Share this article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 3086 - 3089

Deriving Concept Based User Profiles for Search Engine Personalization

Supriya Vinod Koratkar, Sheetal A. Takale

Share this article

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1595 - 1596

User Privacy Protection in Personalised Web Search

Siva B, Merlin Shoerio

Share this article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1471 - 1474

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

Share this article

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1578 - 1582

A Survey Paper on To Retrieve the Relevant Images according to Re-Ranking of Images with Click based Similarity and Typicality

Deepak B. Waghchaure, K. N. Shedge

Share this article



Similar Articles with Keyword 'Web Crawler'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1471 - 1474

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

Share this article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2463 - 2465

Self-Adaptive Focused Crawler Using Ontology

Pallavi Wadibhasme, Nitin Shivale

Share this article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2108 - 2112

A Survey on User Search Goal Inferring and Re-Ranking System

Hemlata Gaikwad, P. B. Kumbharkar

Share this article

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1191 - 1194

Web Data Extraction by Using Trinity

Sayali Khodade, Nilav Mukharjee

Share this article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 857 - 859

Result Grabbing and its Analysis using Data Analytics

Puru Agrawal, Rajesh Deshmukh, Monika Gehi

Share this article



Similar Articles with Keyword 'Techniques'

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 482 - 484

Vehicle Registration using Computer Vision

Vishal Singh, Anuj Kumar Bharti

Share this article

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 496 - 497

Naive Buyers Theorem for Heart Disease Prediction System

Indu Kumari, Dinesh Kumar Bahgel

Share this article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2205 - 2207

A Survey of Generating Multi-Document Summarizations

Patil Ajita S., P. M. Mane

Share this article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1789 - 1791

The Survey Paper on Importance of Integration of Knowledge Management and Business Intelligence

Vina Lomte, Saloni Shah

Share this article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 735 - 737

Survey Paper on Alleviation of Cloud Internal Denial of Service Attacks

Nikhita Nerkar, Vina M Lomte

Share this article
Top