Downloads: 69 | Views: 164 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Survey Paper | Computer Science & Engineering | India | Volume 9 Issue 12, December 2020

A Survey on Types of Crawlers and Web Searching Algorithms

T. Yogameera | Dr. D. Shanthi

Abstract: Information Analysis and gathering is one of the trending constrain in web data processing all the year around with increase in internet data and its dimensionality. Various fields like biometric, business analytics, security application and medical science are in need of the processed web information. It involves highly complex crawling and data searching techniques. The time and space complexity acts as the metric measure to justify the algorithm chosen for crawling, processing the needed information and retrieving it within the users contour. Traditionally search begins only by analyzing the Entry URLs from query submitted. Hence glimpse of matched links returned in buffer stacks fill in short time but the most relevant websites with real demanded data finds back in view. Hence the end user pursuit with many unnecessary links and continues inquest without satisfaction. This leads to in-efficient knowledge engineering and web resource utilization. This journal presents a survey on different search algorithms and techniques; also it discusses the types of web crawlers implementing the above search.

Keywords: types of crawlers, searching algorithms used in crawlers

Edition: Volume 9 Issue 12, December 2020,

Pages: 890 - 894