International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Open Access | Fully Refereed | Peer Reviewed

ISSN: 2319-7064


Downloads: 113

Research Paper | Computer Science & Engineering | India | Volume 5 Issue 6, June 2016


SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble


Abstract: The number of web pages in Internet are changed day by day. Therefore relevant information searching is difficult task. Most of this data is hidden behind query forms which is interface to unexplored databases containing high quality structured data. Existing search engine has drawback that they cannot access and index this hidden data of the Web, in fact it is very hard to derive the unseen info. For this, we propose a framework, namely SmartCrawler, just to gather all the web interfaces in depth. Initially that is site locating, in this step, center pages are searched using search engines which is used to avoid visiting a large number of pages. For achieving precise results for a focused crawl, SmartCrawler gives ranks to websites to prioritize highly relevant ones for a given topic. The second step, adaptive link-ranking gives fast in-site searching by searching most relevant links. In third step, i. e. Web Navigation, Space complexity problem of other crawler are managed. The required relevant links are stored in database. Parsing of web pages is done in web navigation step. To reduce time in visiting some highly related links in unseen web directories, we have designed a link tree data


Keywords: Ranker, Form Classifier, Deep web, Crawler, Adaptive learning


Edition: Volume 5 Issue 6, June 2016,


Pages: 1931 - 1935


How to Cite this Article?

Sphurti S. Bhosale, Dr. S. B. Sonkamble, "SmartCrawler: For Site Locating and Balancing", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=NOV164167, Volume 5 Issue 6, June 2016, 1931 - 1935

How to Share this Article?

Enter Your Email Address


Similar Articles with Keyword 'Ranker'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 110

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1944 - 1948

Result Evaluation of Graph Based Multi Document Summarization

Vijay Sonawane, Rakesh Salam

Share this Article

Similar Articles with Keyword 'Form Classifier'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 122

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1331 - 1334

Survey on Crawler for Deep-Web Interfaces

Devendra Hapase, Prof. M. D. Ingle

Share this Article

Similar Articles with Keyword 'Deep web'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 109

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1598 - 1602

Search Result Optimization using Annotators

Vishal A. Kamble, Amit B. Chougule

Share this Article

Similar Articles with Keyword 'Crawler'

Downloads: 68

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020

Pages: 890 - 894

A Survey on Types of Crawlers and Web Searching Algorithms

T. Yogameera, Dr. D. Shanthi

Share this Article

Downloads: 97

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1191 - 1194

Web Data Extraction by Using Trinity

Sayali Khodade, Nilav Mukharjee

Share this Article

Similar Articles with Keyword 'Adaptive learning'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 107

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1124 - 1127

A Multiple QOS Constraints Based Trustworthy Resource Sharing In Cloud Computing Using Fuzzy Neural Network Harmony Platform

Gils P Jose, D Satish Kumar

Share this Article
Top