A Novel Network-Levitated Merge Algorithm for Hadoop Acceleration
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 119 | Views: 325

Research Paper | Information Technology | India | Volume 4 Issue 4, April 2015 | Popularity: 7.1 / 10


     

A Novel Network-Levitated Merge Algorithm for Hadoop Acceleration

Rina Sao, Naveen K.


Abstract: Large companies like Facebook, Google, and Microsoft as well as a number of small and medium enterprises daily process massive amounts of data in batch jobs and in real time applications. This generates high network traffic, which is hard to support using traditional, oversubscribed, network infrastructures. To address this issue, several novel network topologies have been proposed, aiming at increasing the bandwidth available in enterprise clusters. Hadoop faces a number of issues to achieve the best performance from the underlying systems. These include a serialization barrier that delays the reduce phase, and the lack of portability to different interconnects. To keep up with the increasing volume of data sets, Hadoop also requires efficient I/O capability from the underlying computer systems to process and analyze data. We describe Hadoop-A, an acceleration framework that optimizes Hadoop with plug-in components for fast data movement. A novel network-levitated merge algorithm is introduced to merge data without repetition and disk access Our experimental results show that Hadoop-A significantly speeds up data movement in MapReduce and doubles the throughput of Hadoop.


Keywords: Hadoop, MapReduce, Network-levitated merge, Hadoop acceleration, Cloud Computing


Edition: Volume 4 Issue 4, April 2015


Pages: 2471 - 2474



Make Sure to Disable the Pop-Up Blocker of Web Browser


Text copied to Clipboard!
Rina Sao, Naveen K., "A Novel Network-Levitated Merge Algorithm for Hadoop Acceleration", International Journal of Science and Research (IJSR), Volume 4 Issue 4, April 2015, pp. 2471-2474, https://www.ijsr.net/getabstract.php?paperid=SUB153627, DOI: https://www.doi.org/10.21275/SUB153627

Similar Articles

Downloads: 0

Research Paper, Information Technology, India, Volume 9 Issue 6, June 2020

Pages: 1964 - 1973

From FinTech to Healthcare: A DevOps Journey Across Industries

Vishnu Vardhan Reddy Boda

Share this Article

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Information Technology, United States of America, Volume 13 Issue 4, April 2024

Pages: 1487 - 1496

The Transformative Effects of Digitalization on I. T Organization and Leadership

Rakesh Singh

Share this Article

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Information Technology, India, Volume 10 Issue 8, August 2021

Pages: 1296 - 1304

Hybrid Cloud: Combining the Best of Both Worlds: Increased Adoption of Hybrid Cloud Solutions

Sandeep Chinamanagonda

Share this Article

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Research Paper, Information Technology, India, Volume 11 Issue 3, March 2022

Pages: 1642 - 1649

Data Integration Strategies in Hybrid Cloud Environments

Sai Kumar Reddy Thumburu

Share this Article

Downloads: 1 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Case Studies, Information Technology, United States of America, Volume 13 Issue 11, November 2024

Pages: 1291 - 1295

The Transformative Impact of Cloud Computing and Big Data Analytics on Healthcare

Bhaskara Rao Arepalli

Share this Article
Top