International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Since Year 2012 | Open Access | Double Blind Reviewed

ISSN: 2319-7064


Downloads: 113

Research Paper | Computer Science & Engineering | India | Volume 5 Issue 6, June 2016


SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale | Dr. S. B. Sonkamble [2]


Abstract: The number of web pages in Internet are changed day by day. Therefore relevant information searching is difficult task. Most of this data is hidden behind query forms which is interface to unexplored databases containing high quality structured data. Existing search engine has drawback that they cannot access and index this hidden data of the Web, in fact it is very hard to derive the unseen info. For this, we propose a framework, namely SmartCrawler, just to gather all the web interfaces in depth. Initially that is site locating, in this step, center pages are searched using search engines which is used to avoid visiting a large number of pages. For achieving precise results for a focused crawl, SmartCrawler gives ranks to websites to prioritize highly relevant ones for a given topic. The second step, adaptive link-ranking gives fast in-site searching by searching most relevant links. In third step, i. e. Web Navigation, Space complexity problem of other crawler are managed. The required relevant links are stored in database. Parsing of web pages is done in web navigation step. To reduce time in visiting some highly related links in unseen web directories, we have designed a link tree data


Keywords: Ranker, Form Classifier, Deep web, Crawler, Adaptive learning


Edition: Volume 5 Issue 6, June 2016,


Pages: 1931 - 1935


How to Download this Article?

You Need to Register Your Email Address Before You Can Download the Article PDF


How to Cite this Article?

Sphurti S. Bhosale, Dr. S. B. Sonkamble, "SmartCrawler: For Site Locating and Balancing", International Journal of Science and Research (IJSR), Volume 5 Issue 6, June 2016, pp. 1931-1935, https://www.ijsr.net/get_abstract.php?paper_id=NOV164167

Similar Articles with Keyword 'Ranker'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage [2]

Share this Article

Downloads: 110

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1944 - 1948

Result Evaluation of Graph Based Multi Document Summarization

Vijay Sonawane [6] | Rakesh Salam

Share this Article
Top