Downloads: 119 | Views: 325
Research Paper | Information Technology | India | Volume 4 Issue 4, April 2015 | Popularity: 7.1 / 10
A Novel Network-Levitated Merge Algorithm for Hadoop Acceleration
Rina Sao, Naveen K.
Abstract: Large companies like Facebook, Google, and Microsoft as well as a number of small and medium enterprises daily process massive amounts of data in batch jobs and in real time applications. This generates high network traffic, which is hard to support using traditional, oversubscribed, network infrastructures. To address this issue, several novel network topologies have been proposed, aiming at increasing the bandwidth available in enterprise clusters. Hadoop faces a number of issues to achieve the best performance from the underlying systems. These include a serialization barrier that delays the reduce phase, and the lack of portability to different interconnects. To keep up with the increasing volume of data sets, Hadoop also requires efficient I/O capability from the underlying computer systems to process and analyze data. We describe Hadoop-A, an acceleration framework that optimizes Hadoop with plug-in components for fast data movement. A novel network-levitated merge algorithm is introduced to merge data without repetition and disk access Our experimental results show that Hadoop-A significantly speeds up data movement in MapReduce and doubles the throughput of Hadoop.
Keywords: Hadoop, MapReduce, Network-levitated merge, Hadoop acceleration, Cloud Computing
Edition: Volume 4 Issue 4, April 2015
Pages: 2471 - 2474
Make Sure to Disable the Pop-Up Blocker of Web Browser
Similar Articles
Downloads: 0
Research Paper, Information Technology, India, Volume 9 Issue 6, June 2020
Pages: 1964 - 1973From FinTech to Healthcare: A DevOps Journey Across Industries
Vishnu Vardhan Reddy Boda
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Information Technology, United States of America, Volume 13 Issue 4, April 2024
Pages: 1487 - 1496The Transformative Effects of Digitalization on I. T Organization and Leadership
Rakesh Singh
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Information Technology, India, Volume 10 Issue 8, August 2021
Pages: 1296 - 1304Hybrid Cloud: Combining the Best of Both Worlds: Increased Adoption of Hybrid Cloud Solutions
Sandeep Chinamanagonda
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Information Technology, India, Volume 11 Issue 3, March 2022
Pages: 1642 - 1649Data Integration Strategies in Hybrid Cloud Environments
Sai Kumar Reddy Thumburu
Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Case Studies, Information Technology, United States of America, Volume 13 Issue 11, November 2024
Pages: 1291 - 1295The Transformative Impact of Cloud Computing and Big Data Analytics on Healthcare
Bhaskara Rao Arepalli