M.Tech / M.E / PhD Thesis | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014
Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
Distributed file systems are key building blocks for cloud computing applications based on the Map Reduce programming paradigm. In such file systems, nodes simultaneously serve computing and storage functions; a file is partitioned into a number of chunks allocated in distinct nodes so that MapReduce tasks can be performed in parallel over the nodes. However, in a cloud computing environment, failure is the norm, and nodes may be upgraded, replaced, and added in the system. Files can also be dynamically created, deleted, and appended. This results in load imbalance in a distributed file system; that is, the file chunks are not distributed as uniformly as possible among the nodes. Emerging distributed file systems in production systems strongly depend on a central node for chunk reallocation. This dependence is clearly inadequate in a large-scale, failure-prone environment because the central load balancer is put under considerable workload that is linearly scaled with the system size, and may thus become the performance bottleneck and the single point of failure. In this paper, a fully distributed load rebalancing algorithm is presented to cope with the load imbalance problem. Our algorithm is compared against a centralized approach in a production system and a competing distributed solution presented in the literature. The simulation results indicate that our proposal is comparable with the existing centralized approach and considerably outperforms the prior distributed algorithm in terms of load imbalance factor, movement cost, and algorithmic overhead. The performance of our proposal implemented in the Hadoop distributed file system is further investigated in a cluster environment.
Keywords: Cloud Computing, Load Rebalancing, Distributed File System, Movement Cost, Network Traffic
Edition: Volume 3 Issue 12, December 2014
Pages: 1103 - 1108
How to Cite this Article?
Y. Steeven, C. Prakasha Rao, "Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SUB14546, Volume 3 Issue 12, December 2014, 1103 - 1108
100 PDF Views | 82 PDF Downloads
Similar Articles with Keyword 'Cloud Computing'
Survey Paper, Computer Science & Engineering, India, Volume 7 Issue 1, January 2018
Pages: 81 - 84Novel Approach to Virtual Machine Migration In Cloud Computing Environment - A Survey
Priyanka H, Dr. Mary Cherian
Review Papers, Computer Science & Engineering, India, Volume 10 Issue 1, January 2021
Pages: 594 - 596A Review of Replication Strategies to Increase Data Availability for Data Intensive Applications in Cloud
K. Sreelatha
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 8, August 2013
Pages: 71 - 73Cloud Computing and Its Types in Mobile Network
Palak Jain
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013
Pages: 315 - 318Cloud Computing - A Birds Eye View
S.Kalaiselvi, S.V.Revathi
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 9 Issue 9, September 2020
Pages: 1028 - 1031Secure and Efficient Item Information Retrieval in Cloud Computing
Dr. Shameem Akther, Tahseen Begum
Similar Articles with Keyword 'Load Rebalancing'
Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015
Pages: 1721 - 1725Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble, Y. B. Gurav
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 2993 - 2996Survey Paper on Load Rebalancing for Distributed File Systems in Clouds
Juhi Shah, D. N. Rewadkar
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1103 - 1108Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013
Pages: 83 - 86Cluster Based Load Rebalancing in Clouds
S. Aravind Kumar, R. Mangalagowri
Similar Articles with Keyword 'Distributed File System'
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016
Pages: 2314 - 2318Cloud And Parallel Network File System Using Authenticated Key Exchange Protocols
Anupama T, Refeeda K
Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015
Pages: 1721 - 1725Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble, Y. B. Gurav
Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016
Pages: 1967 - 1970Survey on Recommender System using Distributed Framework
Sonali B. Ghodake, R. S. Paswan
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 2993 - 2996Survey Paper on Load Rebalancing for Distributed File Systems in Clouds
Juhi Shah, D. N. Rewadkar
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1103 - 1108Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
Similar Articles with Keyword 'Movement Cost'
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 2993 - 2996Survey Paper on Load Rebalancing for Distributed File Systems in Clouds
Juhi Shah, D. N. Rewadkar
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1103 - 1108Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
Similar Articles with Keyword 'Network Traffic'
Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016
Pages: 1057 - 1058Survey on Novel Hybrid Techniques in EAACK for Prevention of Attacks in MANETS
Pranita Prakash Kulkarni
Informative Article, Computer Science & Engineering, India, Volume 5 Issue 4, April 2016
Pages: 2169 - 2172Spotting and Segregation of Sinkhole Node in MANET
Jeeja Borkar, Vaishali Malekar
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015
Pages: 1612 - 1616Survey Paper on Mitigation Mechanisms for Distributed Denial of Service Attacks
Vishal Mahale, Deepali Gothawal
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014
Pages: 1944 - 1947Design and Implementation of Tarf for WSNs
Kavita, Amareshwari Patil
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 1701 - 1708An Autonomic Approach for Replication of Scalable Internet Service Deployment
Raji Rajasekharan