Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064



Downloads: 105 | Weekly Hits: ⮙3 | Monthly Hits: ⮙10

Survey Paper | Computer Science & Engineering | India | Volume 4 Issue 11, November 2015

Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop

Suryakant S. Bhalke

MapReduce is programming tool for Hadoop cluster. While allocating resources, MapReduce has two levels Task-level and Phase-level. These levels should be used to check performance of each job. In existing system, the scheduling is focus on task level which tasks can have highly varying resource requirements during their lifetime and also its difficult to effectively utilize available resources to reduce job execution time. To address this limitation, this project proposes a PRISM (Phase and Resource Information -aware Scheduler MapReduce) which allocates a fine-grained resource at the phase-level to perform job scheduling. The job scheduling of prism is performed by the master node, which maintains a list of jobs in the system. Each node manager (slave node) periodically sends a heartbeat message to the scheduler. Upon receiving the status message from a node manager running on machine, the scheduler computes the utilization for set of candidate phases for the tasks using the jobs phase-level resource requirement. Then it select the phase with the highest utility for scheduling and update the resource utilization of the machine. This process is continued for until scheduled the phases of map and Reduce task is completed.

Keywords: MapReduce, Hadoop, Scheduling, Resource Allocation

Edition: Volume 4 Issue 11, November 2015

Pages: 1249 - 1251

Share this Article

How to Cite this Article?

Suryakant S. Bhalke, "Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=NOV151460, Volume 4 Issue 11, November 2015, 1249 - 1251

Enter Your Registered Email Address





Similar Articles with Keyword 'MapReduce'

Downloads: 101 | Weekly Hits: ⮙1

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Downloads: 104 | Weekly Hits: ⮙2 | Monthly Hits: ⮙10

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 2133 - 2136

One Class Clustering Tree for Implementing Many to Many Data Linkage

Ravi R, Michael G

Share this Article

Downloads: 104 | Weekly Hits: ⮙2

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1164 - 1169

A Survey on Scalable Big Data Analytics Platform

Ravindra Phule, Madhav Ingle

Share this Article

Downloads: 105 | Weekly Hits: ⮙3 | Monthly Hits: ⮙10

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1249 - 1251

Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop

Suryakant S. Bhalke

Share this Article

Downloads: 106 | Weekly Hits: ⮙2 | Monthly Hits: ⮙15

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1103 - 1108

Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System

Y. Steeven, C. Prakasha Rao

Share this Article

Similar Articles with Keyword 'Hadoop'

Downloads: 101 | Weekly Hits: ⮙1

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Downloads: 104 | Weekly Hits: ⮙2 | Monthly Hits: ⮙10

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 2133 - 2136

One Class Clustering Tree for Implementing Many to Many Data Linkage

Ravi R, Michael G

Share this Article

Downloads: 104 | Weekly Hits: ⮙2 | Monthly Hits: ⮙11

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 2241 - 2244

Backup Anomaly Identification with R and Hadoop

Ravindra Phule, Madhav Ingle

Share this Article

Downloads: 104 | Weekly Hits: ⮙2

Informative Article, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1482 - 1485

Overview of Big Data

Nivedita Manohar

Share this Article

Downloads: 105 | Weekly Hits: ⮙3 | Monthly Hits: ⮙10

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1249 - 1251

Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop

Suryakant S. Bhalke

Share this Article

Similar Articles with Keyword 'Scheduling'

Downloads: 91 | Weekly Hits: ⮙2 | Monthly Hits: ⮙12

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013

Pages: 474 - 478

Wireless Energy Meter and Billing via SMS

P.V. Santhoshi Roja, B. Kiran Babu, V. Samson Deva Kumar

Share this Article

Downloads: 99 | Weekly Hits: ⮙1 | Monthly Hits: ⮙8

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2045 - 2047

A Comparative Parameters Analysis of Different Round Robin Scheduling Algorithm using Dynamic Time Quantum

Payal T. Sonagara, Viral D. Sanghvi

Share this Article

Downloads: 101 | Weekly Hits: ⮙5

Survey Paper, Computer Science & Engineering, Nigeria, Volume 3 Issue 10, October 2014

Pages: 1774 - 1778

An Analytical Survey of Real Time System Scheduling Techniques

Ayeni, J. A., Odion A. E., Ogbormor-Odikayor I.F

Share this Article

Downloads: 102 | Monthly Hits: ⮙9

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1987 - 1990

A Study on Setting Processor or CPU Affinity in Multi-Core Architecture for Parallel Computing

Saroj A. Shambharkar

Share this Article

Downloads: 103 | Weekly Hits: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1355 - 1359

A Survey on Resource Scheduling and Allocation Policy in a Cloud Environment

V. Manimaran, S. Prabhu

Share this Article

Similar Articles with Keyword 'Resource Allocation'

Downloads: 103 | Weekly Hits: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1355 - 1359

A Survey on Resource Scheduling and Allocation Policy in a Cloud Environment

V. Manimaran, S. Prabhu

Share this Article

Downloads: 103 | Monthly Hits: ⮙9

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1959 - 1962

A Survey on Performance and Energy Management in Cloud Computing

Pratima D. Nerkar, Suresh B. Rathod

Share this Article

Downloads: 104 | Weekly Hits: ⮙1 | Monthly Hits: ⮙9

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1747 - 1751

Identification and Avoidance of DDoS Attack for Secured Data Communicationin Cloud

Aaqib Iqbal Wani, Janaki Raman V., N. Priya

Share this Article

Downloads: 104 | Monthly Hits: ⮙15

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2616 - 2618

Dynamic Resource Allocation in Cloud Computing using Virtualization Technology

A. D. Gawali, S. K. Sonkar

Share this Article

Downloads: 105 | Weekly Hits: ⮙1 | Monthly Hits: ⮙11

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1292 - 1296

User Ranking Based Social Network Platform for Cloud Environment

Abhijeet Mishra, S.Niveditha, Debojyoti Sengupta, Rakesh Kumar

Share this Article



Top