Research Paper | Computer Science & Engineering | India | Volume 4 Issue 4, April 2015
Web Crawler: Essential Component of Search Engine
Akshada K. Dhakade, Deepak C. Dhanwani
With the vast growth of the Internet, many web pages are available online. Search engines use a component called as web crawlers for collecting these web pages from the web for storage and indexing. Many web pages are autonomous and are updated independent of the users. As the web pages are updated autonomously, users do not come to know of how often the sources change. Web crawler is the central part of the search engine which browses through the hyperlinks and stores the visited links for the future use. This paper represents concepts of web crawlers, its architecture and its various types.
Keywords: Search Engine, Web Crawler, Crawler Policies, Techniques
Edition: Volume 4 Issue 4, April 2015
Pages: 1471 - 1474
How to Cite this Article?
Akshada K. Dhakade, Deepak C. Dhanwani, "Web Crawler: Essential Component of Search Engine", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SUB153343, Volume 4 Issue 4, April 2015, 1471 - 1474
Enter Your Email Address and Click Download Button
Similar Articles with Keyword 'Search Engine'
A Comprehensive Study of Elasticsearch
Nikita Kathare, O. Vinati Reddy, Dr. Vishalakshi Prabhu
Paid and Non-Paid Marketing Strategies for Search Engine Optimization
Elton D'souza; Gursheen Grewal; Divya Unnikrishnan; Neelam Phadnis
A Survey Paper on To Retrieve the Relevant Images according to Re-Ranking of Images with Click based Similarity and Typicality
Deepak B. Waghchaure, K. N. Shedge
Developing an Effective System for Keyword Based Query Processing
Ashwini P. Kshirsagar, G.M.Bhandari
A Novel Image Searching/Retrieving Approach using Sample Image and Text
Apurva S. Gomashe, R. R. Keole
Similar Articles with Keyword 'Web Crawler'
A Survey on Types of Crawlers and Web Searching Algorithms
T. Yogameera, Dr. D. Shanthi
Web Data Extraction by Using Trinity
Sayali Khodade, Nilav Mukharjee
Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach
Personalized Web Search using Ontology and Page Ranking
A. N. R. Latha Kumari
An Evolving Approach on Efficient Web Crawler using Fuzzy Genetic Algorithm
P. Jaganathan, T. Karthikeyan
Similar Articles with Keyword 'Techniques'
A Survey of Thinning Techniques on Two Dimensional Binary Images
Moumita Sarkar, Santanu Chatterjee
Study of Power Management in Adhoc Networks
Anandhi Giri, S. K. Srivatsa
A Survey of Generating Multi-Document Summarizations
Patil Ajita S., P. M. Mane
Sentiment Analysis of Twitter Data to Analyze the Acceptance of Aadhaar
Aarushi Thakral, Vasantha W. B.
Survey on Various Image Segmentation Techniques