SmartCrawler: For Site Locating and Balancing
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064



Downloads: 113 | Weekly Hits: ⮙2

Research Paper | Computer Science & Engineering | India | Volume 5 Issue 6, June 2016

SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble

The number of web pages in Internet are changed day by day. Therefore relevant information searching is difficult task. Most of this data is hidden behind query forms which is interface to unexplored databases containing high quality structured data. Existing search engine has drawback that they cannot access and index this hidden data of the Web, in fact it is very hard to derive the unseen info. For this, we propose a framework, namely SmartCrawler, just to gather all the web interfaces in depth. Initially that is site locating, in this step, center pages are searched using search engines which is used to avoid visiting a large number of pages. For achieving precise results for a focused crawl, SmartCrawler gives ranks to websites to prioritize highly relevant ones for a given topic. The second step, adaptive link-ranking gives fast in-site searching by searching most relevant links. In third step, i.e. Web Navigation, Space complexity problem of other crawler are managed. The required relevant links are stored in database. Parsing of web pages is done in web navigation step. To reduce time in visiting some highly related links in unseen web directories, we have designed a link tree data

Keywords: Ranker, Form Classifier, Deep web, Crawler, Adaptive learning

Edition: Volume 5 Issue 6, June 2016

Pages: 1931 - 1935

Share this Article

How to Cite this Article?

Sphurti S. Bhosale, Dr. S. B. Sonkamble, "SmartCrawler: For Site Locating and Balancing", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=NOV164167, Volume 5 Issue 6, June 2016, 1931 - 1935

Enter Your Email Address and Click Download Button





Similar Articles with Keyword 'Ranker'

Downloads: 103 | Monthly Hits: ⮙11

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 109 | Weekly Hits: ⮙4 | Monthly Hits: ⮙11

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1944 - 1948

Result Evaluation of Graph Based Multi Document Summarization

Vijay Sonawane, Rakesh Salam

Share this Article

Downloads: 113 | Weekly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1931 - 1935

SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble

Share this Article

Downloads: 132 | Weekly Hits: ⮙1 | Monthly Hits: ⮙13

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 466 - 469

Smart Crawler: Crawler for Efficiently Harvesting Deep-Web Interfaces

Kalyani Thodage, B. B. Gite

Share this Article

Downloads: 162 | Weekly Hits: ⮙4

Research Paper, Computer Science & Engineering, Egypt, Volume 6 Issue 10, October 2017

Pages: 126 - 131

Early Prediction of Student Success Using a Data Mining Classification Technique

Mohamed Hegazy Mohamed, Hoda Mohamed Waguih

Share this Article

Similar Articles with Keyword 'Form Classifier'

Downloads: 103 | Monthly Hits: ⮙11

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 113 | Weekly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1931 - 1935

SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble

Share this Article

Downloads: 121 | Weekly Hits: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1331 - 1334

Survey on Crawler for Deep-Web Interfaces

Devendra Hapase, Prof. M. D. Ingle

Share this Article

Downloads: 129 | Weekly Hits: ⮙4 | Monthly Hits: ⮙15

Dissertation Chapters, Computer Science & Engineering, India, Volume 6 Issue 6, June 2017

Pages: 1939 - 1944

Bug Triage Using Data Reduction with Priority and Security

Vijay N. Kukre, Shyam Gupta

Share this Article

Similar Articles with Keyword 'Deep web'

Downloads: 103 | Monthly Hits: ⮙11

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 108 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1598 - 1602

Search Result Optimization using Annotators

Vishal A. Kamble, Amit B. Chougule

Share this Article

Downloads: 113 | Weekly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1931 - 1935

SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble

Share this Article

Downloads: 115 | Weekly Hits: ⮙4

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1962 - 1963

Automatic Retrieval System for Domain Specific Hidden Web Database

Megha Saini, Dr. Mukesh Rawat

Share this Article

Downloads: 121 | Weekly Hits: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1331 - 1334

Survey on Crawler for Deep-Web Interfaces

Devendra Hapase, Prof. M. D. Ingle

Share this Article

Similar Articles with Keyword 'Crawler'

Downloads: 67 | Weekly Hits: ⮙3 | Monthly Hits: ⮙16

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020

Pages: 890 - 894

A Survey on Types of Crawlers and Web Searching Algorithms

T. Yogameera, Dr. D. Shanthi

Share this Article

Downloads: 96 | Weekly Hits: ⮙2 | Monthly Hits: ⮙9

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1191 - 1194

Web Data Extraction by Using Trinity

Sayali Khodade, Nilav Mukharjee

Share this Article

Downloads: 102 | Weekly Hits: ⮙1 | Monthly Hits: ⮙11

Review Papers, Computer Science & Engineering, India, Volume 5 Issue 4, April 2016

Pages: 1506 - 1508

Extract Entities with Iknoweb Framework

Utkarsha Daradmare, Bhushan Ugale

Share this Article

Downloads: 103 | Monthly Hits: ⮙11

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙11

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 2212 - 2215

Focused and Adaptive Crawling for Topic Specific and Hidden Web Entries

Vrutuja Pande, Pratap Singh

Share this Article

Similar Articles with Keyword 'Adaptive learning'

Downloads: 103 | Monthly Hits: ⮙11

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2250 - 2253

Survey on Fast and Intelligent Deep Web Crawler Using Machine Learning Approach

Kalyani Thodage

Share this Article

Downloads: 107 | Monthly Hits: ⮙9

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1124 - 1127

A Multiple QOS Constraints Based Trustworthy Resource Sharing In Cloud Computing Using Fuzzy Neural Network Harmony Platform

Gils P Jose, D Satish Kumar

Share this Article

Downloads: 113 | Weekly Hits: ⮙2

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1931 - 1935

SmartCrawler: For Site Locating and Balancing

Sphurti S. Bhosale, Dr. S. B. Sonkamble

Share this Article

Downloads: 121 | Weekly Hits: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1331 - 1334

Survey on Crawler for Deep-Web Interfaces

Devendra Hapase, Prof. M. D. Ingle

Share this Article

Downloads: 132 | Weekly Hits: ⮙1 | Monthly Hits: ⮙13

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 466 - 469

Smart Crawler: Crawler for Efficiently Harvesting Deep-Web Interfaces

Kalyani Thodage, B. B. Gite

Share this Article



Top