Research Paper | Computer Science & Engineering | India | Volume 2 Issue 4, April 2013
Cluster Based Load Rebalancing in Clouds
S. Aravind Kumar, R. Mangalagowri
Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands on new strategies for processing and analysing the information. The project explores the use of Hadoop MapReduce framework to execute scientific workflows in the cloud. Cloud computing provides massive clusters for efficient large computation and data analysis. In such file systems, a file is partitioned into a number of file chunks allocated in distinct nodes so that MapReduce tasks can performed in parallel over the nodes to make resource utilization effective and to improve the response time of the job. In large failure prone cloud environments files and nodes are dynamically created, replaced and added in the system due to which some of the nodes are over loaded while some others are under loaded. It leads to load imbalance in distributed file system. To overcome this load imbalance problem, a fully distributed Load rebalancing algorithm has been implemented, which is dynamic in nature does not consider the previous state or behaviour of the system (global knowledge) and it only depends on the present behaviour of the system and estimation of load, comparison of load, stability of different system, performance of system, interaction n between the nodes, nature of load to be transferred, selection of nodes and network traffic. The current Hadoop implementation assumes that computing nodes in a cluster are homogeneous in nature. The performance of Hadoop in heterogeneous clusters where the nodes have different computing capacity is also tested.
Keywords: Hadoop, Map Reduce, cloud computing, clusters
Edition: Volume 2 Issue 4, April 2013
Pages: 83 - 86
How to Cite this Article?
S. Aravind Kumar, R. Mangalagowri, "Cluster Based Load Rebalancing in Clouds", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=IJSRON2013672, Volume 2 Issue 4, April 2013, 83 - 86
123 PDF Views | 106 PDF Downloads
Similar Articles with Keyword 'Hadoop'
Secured Load Rebalancing for Distributed Files System in Cloud
Jayesh D. Kamble, Y. B. Gurav
Overview of Big Data
Backup Anomaly Identification with R and Hadoop
Ravindra Phule, Madhav Ingle
One Class Clustering Tree for Implementing Many to Many Data Linkage
Ravi R, Michael G
Performance Analysis of Multi-Node Hadoop Clusters using Amazon EC2 Instances
Ruchi Mittal, Ruhi Bagga
Similar Articles with Keyword 'Map Reduce'
Survey Paper on Cube Computation Techniques
Amar Sawant, Madhav Ingle
Large Scale Data Shared by Peer to Peer Based System in Shared Network
Bhavsar Harshada V., Dr. S. V. Gumaste, Prof. Deokate Gajanan S.
Optimization Technique for Efficient Dynamic Query Forms with NoSQL
Kavita Ozarkar, Rakesh Rajani
Design of a High Performing Cloud Using Load Rebalancing Technique in Distributed File System
Y. Steeven, C. Prakasha Rao
Implementing K-Means Clustering Algorithm Using MapReduce Paradigm
Botcha Chandrasekhara Rao, Medara Rambabu
Similar Articles with Keyword 'cloud computing'
Novel Approach to Virtual Machine Migration In Cloud Computing Environment - A Survey
Priyanka H, Dr. Mary Cherian
Cloud Computing and Its Types in Mobile Network
Multilayered Security Approach for Cloud Data Centers using Hash Functions
Jashanpreet Pal Kaur, Rajbhupinder Kaur
Efficient and Secure Auditing of Cloud Data with Key -Updating
Niranjana S, Manjusha M S
Cloud Computing - A Birds Eye View
Similar Articles with Keyword 'clusters'
Performance Analysis of Clustal W Algorithm on Linux Cluster
Swati Jasrotia, Salam Din
Grid Based Straight-Line Layout Algorithm for Clustered Biological Networks
Noopur Landge, Manikrao Dhore, Pushkar Jogalekar, Vrushali Inamdar
Keyword Extraction using Clustering and Semantic Analysis
Dr. Mohamed H. Haggag, Dr.Amal Abutabl, Ahmed Basil
Risk Distribution and Validation of Data in Passport Data Analysis Using Cluster Analysis
Sucheta Gulia, Dr. Rajan Vohra
Ensuring Efficient Data Transmission in Wireless Sensor Networks in Secure Way
D. Hemalatha, R. Arunudaya