Abstract: Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Open Access | Fully Refereed | Peer Reviewed

ISSN: 2319-7064

Downloads: 106

Survey Paper | Computer Science & Engineering | India | Volume 4 Issue 11, November 2015

Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop

Suryakant S. Bhalke

MapReduce is programming tool for Hadoop cluster. While allocating resources, MapReduce has two levels Task-level and Phase-level. These levels should be used to check performance of each job. In existing system, the scheduling is focus on task level which tasks can have highly varying resource requirements during their lifetime and also its difficult to effectively utilize available resources to reduce job execution time. To address this limitation, this project proposes a PRISM (Phase and Resource Information -aware Scheduler MapReduce) which allocates a fine-grained resource at the phase-level to perform job scheduling. The job scheduling of prism is performed by the master node, which maintains a list of jobs in the system. Each node manager (slave node) periodically sends a heartbeat message to the scheduler. Upon receiving the status message from a node manager running on machine, the scheduler computes the utilization for set of candidate phases for the tasks using the jobs phase-level resource requirement. Then it select the phase with the highest utility for scheduling and update the resource utilization of the machine. This process is continued for until scheduled the phases of map and Reduce task is completed.

Keywords: MapReduce, Hadoop, Scheduling, Resource Allocation

Edition: Volume 4 Issue 11, November 2015

Pages: 1249 - 1251

Share this Article

How to Cite this Article?

Suryakant S. Bhalke, "Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=NOV151460, Volume 4 Issue 11, November 2015, 1249 - 1251

Enter Your Email Address


Similar Articles with Keyword 'MapReduce'

Downloads: 102

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Downloads: 105

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 2133 - 2136

One Class Clustering Tree for Implementing Many to Many Data Linkage

Ravi R, Michael G

Share this Article

Similar Articles with Keyword 'Hadoop'

Downloads: 1

Research Paper, Computer Science & Engineering, India, Volume 10 Issue 6, June 2021

Pages: 1188 - 1193

Profit Contribution of Bank Customer from Different Business Liabilities

Vinod Desai, Shalini B Ullagaddi, Vittal A Odeyar

Share this Article

Downloads: 102

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Similar Articles with Keyword 'Scheduling'

Downloads: 91

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013

Pages: 474 - 478

Wireless Energy Meter and Billing via SMS

P.V. Santhoshi Roja, B. Kiran Babu, V. Samson Deva Kumar

Share this Article

Downloads: 99

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2045 - 2047

A Comparative Parameters Analysis of Different Round Robin Scheduling Algorithm using Dynamic Time Quantum

Payal T. Sonagara, Viral D. Sanghvi

Share this Article

Similar Articles with Keyword 'Resource Allocation'

Downloads: 103

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1959 - 1962

A Survey on Performance and Energy Management in Cloud Computing

Pratima D. Nerkar, Suresh B. Rathod

Share this Article

Downloads: 104

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1355 - 1359

A Survey on Resource Scheduling and Allocation Policy in a Cloud Environment

V. Manimaran, S. Prabhu

Share this Article
Top