Research Paper | Computer Science & Engineering | India | Volume 2 Issue 4, April 2013
Cluster Based Load Rebalancing in Clouds
S. Aravind Kumar, R. Mangalagowri
Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands on new strategies for processing and analysing the information. The project explores the use of Hadoop MapReduce framework to execute scientific workflows in the cloud. Cloud computing provides massive clusters for efficient large computation and data analysis. In such file systems, a file is partitioned into a number of file chunks allocated in distinct nodes so that MapReduce tasks can performed in parallel over the nodes to make resource utilization effective and to improve the response time of the job. In large failure prone cloud environments files and nodes are dynamically created, replaced and added in the system due to which some of the nodes are over loaded while some others are under loaded. It leads to load imbalance in distributed file system. To overcome this load imbalance problem, a fully distributed Load rebalancing algorithm has been implemented, which is dynamic in nature does not consider the previous state or behaviour of the system (global knowledge) and it only depends on the present behaviour of the system and estimation of load, comparison of load, stability of different system, performance of system, interaction n between the nodes, nature of load to be transferred, selection of nodes and network traffic. The current Hadoop implementation assumes that computing nodes in a cluster are homogeneous in nature. The performance of Hadoop in heterogeneous clusters where the nodes have different computing capacity is also tested.
Keywords: Hadoop, Map Reduce, cloud computing, clusters
Edition: Volume 2 Issue 4, April 2013
Pages: 83 - 86
How to Cite this Article?
S. Aravind Kumar, R. Mangalagowri, "Cluster Based Load Rebalancing in Clouds", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=IJSRON2013672, Volume 2 Issue 4, April 2013, 83 - 86
123 PDF Views | 106 PDF Downloads
Similar Articles with Keyword 'Hadoop'
Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015
Pages: 1721 - 1725Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble, Y. B. Gurav
Informative Article, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016
Pages: 1482 - 1485Overview of Big Data
Nivedita Manohar
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015
Pages: 2241 - 2244Backup Anomaly Identification with R and Hadoop
Ravindra Phule, Madhav Ingle
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2133 - 2136One Class Clustering Tree for Implementing Many to Many Data Linkage
Ravi R, Michael G
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015
Pages: 1646 - 1650Performance Analysis of Multi-Node Hadoop Clusters using Amazon EC2 Instances
Ruchi Mittal, Ruhi Bagga
Similar Articles with Keyword 'Map Reduce'
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015
Pages: 1666 - 1668Survey Paper on Cube Computation Techniques
Amar Sawant, Madhav Ingle
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 2762 - 2766Large Scale Data Shared by Peer to Peer Based System in Shared Network
Bhavsar Harshada V., Dr. S. V. Gumaste, Prof. Deokate Gajanan S.
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 2041 - 2044Optimization Technique for Efficient Dynamic Query Forms with NoSQL
Kavita Ozarkar, Rakesh Rajani
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1103 - 1108Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016
Pages: 1240 - 1244Implementing K-Means Clustering Algorithm Using MapReduce Paradigm
Botcha Chandrasekhara Rao, Medara Rambabu
Similar Articles with Keyword 'cloud computing'
Survey Paper, Computer Science & Engineering, India, Volume 7 Issue 1, January 2018
Pages: 81 - 84Novel Approach to Virtual Machine Migration In Cloud Computing Environment - A Survey
Priyanka H, Dr. Mary Cherian
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 8, August 2013
Pages: 71 - 73Cloud Computing and Its Types in Mobile Network
Palak Jain
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 2394 - 2397Multilayered Security Approach for Cloud Data Centers using Hash Functions
Jashanpreet Pal Kaur, Rajbhupinder Kaur
Research Paper, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016
Pages: 2242 - 2246Efficient and Secure Auditing of Cloud Data with Key -Updating
Niranjana S, Manjusha M S
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013
Pages: 315 - 318Cloud Computing - A Birds Eye View
S.Kalaiselvi, S.V.Revathi
Similar Articles with Keyword 'clusters'
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 1884 - 1886Performance Analysis of Clustal W Algorithm on Linux Cluster
Swati Jasrotia, Salam Din
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 1882 - 1888Grid Based Straight-Line Layout Algorithm for Clustered Biological Networks
Noopur Landge, Manikrao Dhore, Pushkar Jogalekar, Vrushali Inamdar
Research Paper, Computer Science & Engineering, Egypt, Volume 3 Issue 11, November 2014
Pages: 1128 - 1132Keyword Extraction using Clustering and Semantic Analysis
Dr. Mohamed H. Haggag, Dr.Amal Abutabl, Ahmed Basil
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 2790 - 2794Risk Distribution and Validation of Data in Passport Data Analysis Using Cluster Analysis
Sucheta Gulia, Dr. Rajan Vohra
Review Papers, Computer Science & Engineering, India, Volume 5 Issue 4, April 2016
Pages: 1936 - 1939Ensuring Efficient Data Transmission in Wireless Sensor Networks in Secure Way
D. Hemalatha, R. Arunudaya