Performance Evaluation of Hadoop Distributed File System and Local File System
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064

Research Paper | Computer Science & Engineering | India | Volume 3 Issue 9, September 2014

Performance Evaluation of Hadoop Distributed File System and Local File System

Linthala Srinithya, Dr. G. Venkata Rami Reddy

Hadoop is a framework which enables applications to work and petabytes of data on large clusters with thousand of nodes built of commodity hardware. It provides a Hadoop Distributed File System (HDFS) that stores data on the computed nodes, providing very high aggregate bandwidth across the cluster. In addition, Hadoop implements a parallel computational paradigm named map-reduce which divides the application into many small segments of work, each of which may be executed or re executed on any node in the cluster. In this project I would like to analyze performance of HDFS and LFS with respective read and write. To measure the performance I will set up a hadoop cluster and design an interface which gives us the size of the file, time taken for upload or download from Local File System (LFS) and Hadoop Distributed File System (HDFS). By literature survey the expected HDFS writing performance scales will on both small and big data set were it is however lower than on the small data-set. This work also draws a comparison between the HDFS (Hadoop Distributed File System) and LFS performances.

Keywords: HDFS, LFS, DFS, Read, Write, Update, Commodity hardware, fault-tolerant

Edition: Volume 3 Issue 9, September 2014

Pages: 1174 - 1183

Share this Article

How to Cite this Article?

Linthala Srinithya, Dr. G. Venkata Rami Reddy, "Performance Evaluation of Hadoop Distributed File System and Local File System", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=SEP14344, Volume 3 Issue 9, September 2014, 1174 - 1183

120 PDF Views | 102 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'HDFS'

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2837 - 2842

Challenges for HDFS to Read and Write Using Different Technologies

Sunil Kumar S, Sanjeev G Kanabargi

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1844 - 1847

A Providing Security on Cloud Data Hadoop using Symmetric Encryption and Identity Authentication

Kale Rohitkumar Bhausaheb, R.L.Paikrao

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015

Pages: 1424 - 1430

Hadoop Distributed File System and Map Reduce Processing on Multi-Node Cluster

Dr. G. Venkata Rami Reddy, CH. V. V. N. Srikanth Kumar

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 1661 - 1667

Performance Enhancement of MapReduce Framework in Big Data Application Using Load Balancing with Cache

Sushant Shirish Nagavkar, Ashishkumar

Share this Article

Similar Articles with Keyword 'LFS'

Research Paper, Computer Science & Engineering, Saudi Arabia, Volume 5 Issue 5, May 2016

Pages: 2480 - 2485

Test Pattern Generation for Integrated Circuit Test Using Distance between Vectors

Emad Aldeen Widaat Alla Musa, Dr. Abdelrahman Elsharif Karrar, Dr. Abu Khari Bin Aain

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1174 - 1183

Performance Evaluation of Hadoop Distributed File System and Local File System

Linthala Srinithya, Dr. G. Venkata Rami Reddy

Share this Article

Similar Articles with Keyword 'DFS'

Dissertation Chapters, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1721 - 1725

Secured Load Rebalancing for Distributed Files System in Cloud

Jayesh D. Kamble, Y. B. Gurav

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2993 - 2996

Survey Paper on Load Rebalancing for Distributed File Systems in Clouds

Juhi Shah, D. N. Rewadkar

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2837 - 2842

Challenges for HDFS to Read and Write Using Different Technologies

Sunil Kumar S, Sanjeev G Kanabargi

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1844 - 1847

A Providing Security on Cloud Data Hadoop using Symmetric Encryption and Identity Authentication

Kale Rohitkumar Bhausaheb, R.L.Paikrao

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015

Pages: 1424 - 1430

Hadoop Distributed File System and Map Reduce Processing on Multi-Node Cluster

Dr. G. Venkata Rami Reddy, CH. V. V. N. Srikanth Kumar

Share this Article

Similar Articles with Keyword 'Read'

Research Paper, Computer Science & Engineering, India, Volume 9 Issue 11, November 2020

Pages: 470 - 478

Ensuring Video Integrity Using Watermark - Chaining by SVD and DWT

Aditya Tiwari, Ayush Pandey

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 4, April 2013

Pages: 474 - 478

Wireless Energy Meter and Billing via SMS

P.V. Santhoshi Roja, B. Kiran Babu, V. Samson Deva Kumar

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 7 Issue 4, April 2018

Pages: 137 - 140

Intelligent Health and Education Trust Recommendation System

Bhavin Rathod; Deepraj Sawant; Tejas Shetye; Silviya D'Monte

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1525 - 1529

Blowfish Algorithm by Modify Randomness for S-Boxes using Fuzzy Value and Apply Encryption or Decryption on Image

Maulik P. Chaudhari, Neha Parmar

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2297 - 2299

Measuring and Comparing Semantic Structure of Ontology

Nirmitee N. Kurhekar, Prof. L. J. Sankpal

Share this Article

Similar Articles with Keyword 'Write'

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 3092 - 3094

Performance Monitoring and Improvement by VMM in Cloud System

Shafali Gupta, Payal Kulkarni

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 5, May 2014

Pages: 1443 - 1445

Natural Language Interface to Databases: A Survey

Manika Tyagi

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 938 - 943

HCR Using K-Means Clustering Algorithm

Meha Mathur, Anil Saroliya

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 5, May 2014

Pages: 1166 - 1171

Literature Survey on a New Advanced Refactoring Based Approach for Parallelism Using Heterogeneous Parallel Architectures

Shanthi Makka, Bharat Bushan Sagar

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1520 - 1522

Survey of Various Techniques for Signature Recognition and Verification

Sharayu S. Sangekar, D. C. Dhanwani

Share this Article

Similar Articles with Keyword 'Update'

Research Paper, Computer Science & Engineering, China, Volume 9 Issue 4, April 2020

Pages: 1544 - 1554

Recent Developments on Probabilistic Graphical Model Applied in Data Analysis

Kan'Sam Nadjak, Guisheng Yin

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2067 - 2068

An Analysis of Mobile Applications Security; Issue and Aspects from the Users Perspective

Ashish A Kulkarni, Dr. Shivaji R. Madan

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 5, May 2016

Pages: 2242 - 2246

Efficient and Secure Auditing of Cloud Data with Key -Updating

Niranjana S, Manjusha M S

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 9, September 2015

Pages: 1737 - 1740

Enabling Data Dynamics and Achieving Access Control and Assured Deletion in Cloud

Nilam Musale, Vilas Gaikwad

Share this Article

Research Paper, Computer Science & Engineering, Ghana, Volume 4 Issue 2, February 2015

Pages: 2448 - 2452

Reliable and Rapid Routing Configurations for Network Recovery

William Asiedu K. O. Boateng

Share this Article

Similar Articles with Keyword 'Commodity hardware'

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1183 - 1187

Memory Management in BigData

Yanish Pradhananga, Shridevi C. Karande

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 538 - 541

A Table Driven Dynamic Load Balancing Scheme for Distributed System

Antim Panghal, A.K Sharma

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1179 - 1184

Survey on Schedulers Optimization to Handle Multiple Jobs in Hadoop Cluster

Shivaraj B. G., Nagaraj Naik

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1174 - 1183

Performance Evaluation of Hadoop Distributed File System and Local File System

Linthala Srinithya, Dr. G. Venkata Rami Reddy

Share this Article

Similar Articles with Keyword 'fault-tolerant'

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2701 - 2704

Review on Self Organized Trust Model for Distributed Systems

Suyog Ashokrao Nagare

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 3, March 2014

Pages: 845 - 848

Byzantine Fault Tolerance in Large Scale Reliable Storage System

Dhiraj M. Bochare, A. S. Alvi

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1174 - 1183

Performance Evaluation of Hadoop Distributed File System and Local File System

Linthala Srinithya, Dr. G. Venkata Rami Reddy

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 380 - 383

An Algorithm for Distributed Fault-Tolerant Topology Control in Heterogeneous Wireless Sensor Network

Apeksha R. Buchude, Mohasin B. Tamboli

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 190 - 192

An Efficient Buffer less Rank Based Fault Tolerance Network on Chip System

Subodh Kakran

Share this Article
Top