Web Crawler: Essential Component of Search Engine
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Most Trusted Research Journal Since Year 2012

ISSN: 2319-7064



Research Paper | Computer Science & Engineering | India | Volume 4 Issue 4, April 2015

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously, users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.

Keywords: Search Engine, Web Crawler, Crawler Policies, Techniques

Edition: Volume 4 Issue 4, April 2015

Pages: 1471 - 1474

Share this Article

How to Cite this Article?

Akshada K. Dhakade, Deepak C. Dhanwani, "Web Crawler: Essential Component of Search Engine", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SUB153343, Volume 4 Issue 4, April 2015, 1471 - 1474

45 PDF Views | 41 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Search Engine'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 3086 - 3089

Deriving Concept Based User Profiles for Search Engine Personalization

Supriya Vinod Koratkar, Sheetal A. Takale

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1862 - 1864

User Profile Based Client Side Instant Search Mechanism With Use of TLB Mechanism and Fuzzy Search

Rupali A. Ingale, J. L. Chaudhari

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 3068 - 3071

Hybrid Method for Online Web Image Ranking Using Query Specific Semantic Signatures

Shweta Damahe, Dr. Tanuja Dhope

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1578 - 1582

A Survey Paper on To Retrieve the Relevant Images according to Re-Ranking of Images with Click based Similarity and Typicality

Deepak B. Waghchaure, K. N. Shedge

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 5 Issue 4, April 2016

Pages: 1506 - 1508

Extract Entities with Iknoweb Framework

Utkarsha Daradmare, Bhushan Ugale

Share this Article

Similar Articles with Keyword 'Web Crawler'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2463 - 2465

Self-Adaptive Focused Crawler Using Ontology

Pallavi Wadibhasme, Nitin Shivale

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1191 - 1194

Web Data Extraction by Using Trinity

Sayali Khodade, Nilav Mukharjee

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 681 - 686

An Evolving Approach on Efficient Web Crawler using Fuzzy Genetic Algorithm

P. Jaganathan, T. Karthikeyan

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 857 - 859

Result Grabbing and its Analysis using Data Analytics

Puru Agrawal, Rajesh Deshmukh, Monika Gehi

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1471 - 1474

Web Crawler: Essential Component of Search Engine

Akshada K. Dhakade, Deepak C. Dhanwani

Share this Article

Similar Articles with Keyword 'Techniques'

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 1375 - 1390

A Survey of Thinning Techniques on Two Dimensional Binary Images

Moumita Sarkar, Santanu Chatterjee

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 8, August 2017

Pages: 868 - 874

Study of Power Management in Adhoc Networks

Anandhi Giri, S. K. Srivatsa

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1789 - 1791

The Survey Paper on Importance of Integration of Knowledge Management and Business Intelligence

Vina Lomte, Saloni Shah

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2205 - 2207

A Survey of Generating Multi-Document Summarizations

Patil Ajita S., P. M. Mane

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 408 - 410

Movie Recommendation System using Naive Bayes Algorithm with Collaborative Filtering

Anchal Dubey, Raju Ranjan

Share this Article
Top