Downloads: 106 | Views: 115
Survey Paper | Computer Science & Engineering | India | Volume 4 Issue 11, November 2015
Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop
Suryakant S. Bhalke
Abstract: MapReduce is programming tool for Hadoop cluster. While allocating resources, MapReduce has two levels Task-level and Phase-level. These levels should be used to check performance of each job. In existing system, the scheduling is focus on task level which tasks can have highly varying resource requirements during their lifetime and also its difficult to effectively utilize available resources to reduce job execution time. To address this limitation, this project proposes a PRISM (Phase and Resource Information -aware Scheduler MapReduce) which allocates a fine-grained resource at the phase-level to perform job scheduling. The job scheduling of prism is performed by the master node, which maintains a list of jobs in the system. Each node manager (slave node) periodically sends a heartbeat message to the scheduler. Upon receiving the status message from a node manager running on machine, the scheduler computes the utilization for set of candidate phases for the tasks using the jobs phase-level resource requirement. Then it select the phase with the highest utility for scheduling and update the resource utilization of the machine. This process is continued for until scheduled the phases of map and Reduce task is completed.
Keywords: MapReduce, Hadoop, Scheduling, Resource Allocation
Edition: Volume 4 Issue 11, November 2015,
Pages: 1249 - 1251
Similar Articles with Keyword 'MapReduce'
Downloads: 103 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015Pages: 1721 - 1725
Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble | Y. B. Gurav 
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015Pages: 2133 - 2136
One Class Clustering Tree for Implementing Many to Many Data Linkage