Faster and Resourceful Multi-core Web Crawling
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064



Downloads: 135 | Monthly Hits: ⮙8

Research Paper | Computer Science & Engineering | India | Volume 1 Issue 2, November 2012

Faster and Resourceful Multi-core Web Crawling

Arun Kumar Dewangan, Asha Ambhaikar

Due to massive growth of World Wide Web, search engines have become crucial tools for navigation of web pages. In order to provide fast and powerful search facility, search engine maintains indexes for documents and its contents on the web by downloading web pages for processing in iterative manner. Web indexes are created and managed by web crawlers which work as a module of search engines and traverse the web in systematic manner for indexing its contents. A web crawling is a process which fetches data from various servers. It is a time taking process as it gathers data from various servers. Hence, to speed up the searching process in search engines the crawling should be fast enough. The aim of the proposed system is to enhance the speed of crawling process and CPU usage by use of multi-core concept.

Keywords: Web crawling, multi core, indexing, parallel crawler, CPU, URL

Edition: Volume 1 Issue 2, November 2012

Pages: 12 - 15

Share this Article

How to Cite this Article?

Arun Kumar Dewangan, Asha Ambhaikar, "Faster and Resourceful Multi-core Web Crawling", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=IJSR11120205, Volume 1 Issue 2, November 2012, 12 - 15

Enter Your Email Address and Click Download Button





Similar Articles with Keyword 'Web crawling'

Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙11

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 2212 - 2215

Focused and Adaptive Crawling for Topic Specific and Hidden Web Entries

Vrutuja Pande, Pratap Singh

Share this Article

Downloads: 116 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 610 - 612

Reducing Duplicate Content Using XXHASH Algorithm

Rahul Mahajan, Dr. S. K. Gupta, Rajeev Bedi

Share this Article

Downloads: 116 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1810 - 1813

Intelligent Semantic Web Image Search Engine

Soorya P. S., Soya Chandra C.S.

Share this Article

Downloads: 129 | Weekly Hits: ⮙5

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 859863 -

Comparative Analysis of Web PageRank Algorithm using DFS and BFS Crawling

Poonam Kumari, Gaurav Kakhani

Share this Article

Downloads: 135 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 1 Issue 2, November 2012

Pages: 12 - 15

Faster and Resourceful Multi-core Web Crawling

Arun Kumar Dewangan, Asha Ambhaikar

Share this Article

Similar Articles with Keyword 'multi core'

Downloads: 114 | Weekly Hits: ⮙2 | Monthly Hits: ⮙12

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 5, May 2014

Pages: 1166 - 1171

Literature Survey on a New Advanced Refactoring Based Approach for Parallelism Using Heterogeneous Parallel Architectures

Shanthi Makka, Bharat Bushan Sagar

Share this Article

Downloads: 118 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 8, August 2016

Pages: 1873 - 1875

Image Processing Application Using Parallel Computing

Vengayil Nayana Murali, Rahul C

Share this Article

Downloads: 134 | Weekly Hits: ⮙2 | Monthly Hits: ⮙12

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 10, October 2016

Pages: 684 - 686

A Survey on Dynamic Scheduling Method for Heterogeneous, Multi-Core Processors

Dr. S. Sai Satyanarayana Reddy, Debashree Rupalin, K. Sravanthi

Share this Article

Downloads: 135 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 1 Issue 2, November 2012

Pages: 12 - 15

Faster and Resourceful Multi-core Web Crawling

Arun Kumar Dewangan, Asha Ambhaikar

Share this Article

Similar Articles with Keyword 'indexing'

Downloads: 97 | Weekly Hits: ⮙3 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1910 - 1915

An Efficient Hash Count Indexing and Searching Scheme for Audio Fingerprinting

Simarjeet Singh Bhatia, Rupali Bhartiya

Share this Article

Downloads: 102 | Weekly Hits: ⮙1 | Monthly Hits: ⮙10

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 3, March 2016

Pages: 1687 - 1690

An Algorithm of Word Indexing Model for Document Summarization based on Perspective of Document

Meha Shah, Chetna Chand

Share this Article

Downloads: 103 | Weekly Hits: ⮙2 | Monthly Hits: ⮙10

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2523 - 2525

Study of Semantic Retrieval by Data Similarity of Trademarks

Deepak Mali, P. D. Lambate

Share this Article

Downloads: 105 | Weekly Hits: ⮙3

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2120 - 2123

Erection Trusted and Effective Request Services in the Cloud with RASP Data Perturbation

Rashmi Kadu, J. L. Chaudhari

Share this Article

Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙11

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 2212 - 2215

Focused and Adaptive Crawling for Topic Specific and Hidden Web Entries

Vrutuja Pande, Pratap Singh

Share this Article

Similar Articles with Keyword 'parallel crawler'

Downloads: 125 | Weekly Hits: ⮙2 | Monthly Hits: ⮙10

Review Papers, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 61 - 64

Design Issues in Web Crawlers and Review of Parallel Crawlers

Komal, Dr. Ashutosh Dixit

Share this Article

Downloads: 135 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 1 Issue 2, November 2012

Pages: 12 - 15

Faster and Resourceful Multi-core Web Crawling

Arun Kumar Dewangan, Asha Ambhaikar

Share this Article

Similar Articles with Keyword 'CPU'

Downloads: 179 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

Survey Paper, Computer Science & Engineering, India, Volume 7 Issue 1, January 2018

Pages: 81 - 84

Novel Approach to Virtual Machine Migration In Cloud Computing Environment - A Survey

Priyanka H, Dr. Mary Cherian

Share this Article

Downloads: 101 | Monthly Hits: ⮙11

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1525 - 1529

Blowfish Algorithm by Modify Randomness for S-Boxes using Fuzzy Value and Apply Encryption or Decryption on Image

Maulik P. Chaudhari, Neha Parmar

Share this Article

Downloads: 102 | Monthly Hits: ⮙9

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1987 - 1990

A Study on Setting Processor or CPU Affinity in Multi-Core Architecture for Parallel Computing

Saroj A. Shambharkar

Share this Article

Downloads: 110 | Weekly Hits: ⮙2 | Monthly Hits: ⮙10

Survey Paper, Computer Science & Engineering, India, Volume 6 Issue 2, February 2017

Pages: 1328 - 1334

Survey on Soft Computing Approaches for Human Activity Recognition

Manisha V. Kharat, K. H. Walse, Dr. R. V. Dharaskar

Share this Article

Downloads: 111 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 997 - 999

Round Robin CPU Scheduling Using Dynamic Time Quantum with Multiple Queue

Sonagara Payal T.

Share this Article

Similar Articles with Keyword 'URL'

Downloads: 67 | Weekly Hits: ⮙3 | Monthly Hits: ⮙16

Survey Paper, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020

Pages: 890 - 894

A Survey on Types of Crawlers and Web Searching Algorithms

T. Yogameera, Dr. D. Shanthi

Share this Article

Downloads: 102 | Weekly Hits: ⮙3 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 6, June 2016

Pages: 1895 - 1898

Implementation of Intellectual Browser for User Search Goal Discovery and Reordering System

Hemlata Gaikwad, Manisha Darak

Share this Article

Downloads: 106 | Weekly Hits: ⮙2 | Monthly Hits: ⮙12

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2083 - 2089

An Enhanced Web Mining Technique for Image Search using Weighted PageRank based on Visit of Links and Fuzzy K-Means Algorithm

Rashmi Sharma, Kamaljit Kaur

Share this Article

Downloads: 107 | Weekly Hits: ⮙3

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2880 - 2884

Inferring User Search Goals Using Feedback Session

Harshada P. Bhambure, Mandar Mokashi

Share this Article

Downloads: 107 | Weekly Hits: ⮙5

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 9 Issue 7, July 2020

Pages: 1888 - 1890

Spammer Detection and Identification on Social Network Using Machine Learning

Dr. Shameem Akhter, Noorain Saba

Share this Article



Top