Survey Paper on Big Data Processing and Hadoop Components
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Most Trusted Research Journal Since Year 2012

ISSN: 2319-7064



Survey Paper | Computer Science & Engineering | India | Volume 3 Issue 10, October 2014

Survey Paper on Big Data Processing and Hadoop Components

Poonam S. Patil, Rajesh. N. Phursule

As big data continues down its path of growth, a major challenge has become how to deal with the explosion of data and analysis of this data. For such data-intensive applications, the Apache Hadoop Framework has recently attracted a lot of attention. This framework Adopted MapReduce, it is an programming model and an associated implementation for processing and generating large data sets. Hadoop Provides: Distributed File System, Job scheduling, Resource Management Capabilities, and Java API for writing Application E.g. Java Map-Reduce, Streaming MapReduce, Crunch, Pig latin, Hive, Oozie etc. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associated with the same intermediate key. Many real world tasks are expressible in this model, Hadoop gives the flexibility to use any language to write an algorithms. In this paper we will briefly introduce the MapReduce framework based on Hadoop and the current state-of-the-art in MapReduce algorithms for big data analysis.

Keywords: Big data, Hadoop, MapReduce, Hive, Hbase, Distributed Data, Relational Database, NoSql

Edition: Volume 3 Issue 10, October 2014

Pages: 585 - 590

Share this Article

How to Cite this Article?

Poonam S. Patil, Rajesh. N. Phursule, "Survey Paper on Big Data Processing and Hadoop Components", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=OCT14251, Volume 3 Issue 10, October 2014, 585 - 590

53 PDF Views | 45 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Big data'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 9, September 2015

Pages: 1774 - 1780

Real Time Tweet Summarization and Sentiment Analysis of Game Tournament

Vikrant Hole, Mukta Takalikar

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 6, June 2017

Pages: 1711 - 1716

Live Data Stream Classification for Reducing Query Processing Time: Design and Analysis

Spraha Kamriya, Vandana Kate

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 1676 - 1680

A Survey on Big Data Mining Algorithms

S. Sivasankar, T. Prabhakaran

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1164 - 1169

A Survey on Scalable Big Data Analytics Platform

Ravindra Phule, Madhav Ingle

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 2435 - 2438

A Scalable Approach for Scheduled Data Anonymization Using MapReduce on Cloud

Surumi K S, Joyal Ulahannan

Share this Article

Similar Articles with Keyword 'Hadoop'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1096 - 1101

Parallel Data Shuffling for Hadoop Acceleration with Network Levitated Merge and RDMA for Interconnectivity

Kishorkumar Shinde, Venkatesan N.

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 6, June 2017

Pages: 1711 - 1716

Live Data Stream Classification for Reducing Query Processing Time: Design and Analysis

Spraha Kamriya, Vandana Kate

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 1690 - 1693

Extended Best Peer: A Peer-to-Peer Based System by Corporate Network for Data Sharing

Chandre P.R, Bhavsar Harshada

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1646 - 1650

Performance Analysis of Multi-Node Hadoop Clusters using Amazon EC2 Instances

Ruchi Mittal, Ruhi Bagga

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 1967 - 1970

Survey on Recommender System using Distributed Framework

Sonali B. Ghodake, R. S. Paswan

Share this Article

Similar Articles with Keyword 'MapReduce'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 1096 - 1101

Parallel Data Shuffling for Hadoop Acceleration with Network Levitated Merge and RDMA for Interconnectivity

Kishorkumar Shinde, Venkatesan N.

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 3, March 2017

Pages: 1206 - 1209

Improved Fuzzy Rule Based Classification System Using Feature Selection and Bagging for Large Datasets

Akil Kumar A., Mithunkumar P., Kiruthiga R., Anitha R., V. Priya

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 6, June 2017

Pages: 1711 - 1716

Live Data Stream Classification for Reducing Query Processing Time: Design and Analysis

Spraha Kamriya, Vandana Kate

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1164 - 1169

A Survey on Scalable Big Data Analytics Platform

Ravindra Phule, Madhav Ingle

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1483 - 1486

A Study of Differentially Private Frequent Itemset Mining

Trupti Kenekar, A. R. Dani

Share this Article

Similar Articles with Keyword 'Hive'

Informative Article, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 2027 - 2029

Speed-Constrained Multi-Objective PSO for Optimization of Problem

Prachi Gupta, Dr. Ramachandra Pujeri

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 1425 - 1427

Analytical Study on Human Texture Skin Diseases

Harminder Kaur, Prabhneet Sandhu, Pallavi Verma

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 1434 - 1436

Method for Repossession of Content Based Video using Speech and Text Information

Manasi A. Kabade, U.A. Jogalekar

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1233 - 1238

Logo Detection and Recognition from the Images As Well As Videos

Meera Sambhaji Sawalkar, Mrunalinee Patole

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 7, July 2014

Pages: 1598 - 1601

A Novel Approach to Improve the Privacy of Information Brokering in Semantic Web

Supriya S. Sankpal, Rupali A. Mahajan

Share this Article

Similar Articles with Keyword 'Hbase'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1328 - 1330

Comparative Analysis of HBase Data Storage Model and RDBMS for Location based Application

Chandrakant Nitnaware, Amreen Khan

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1445 - 1448

Impala: Open Source, Native Analytic Database for Apache Hadoop - A Review Paper

Prof. Pramod Patil, Amit Patange

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1011 - 1014

Temperature Monitoring and Alert Generation System ? An IoT Implementation

Shardul S. Thakre, Pratik S. Jain

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 585 - 590

Survey Paper on Big Data Processing and Hadoop Components

Poonam S. Patil, Rajesh. N. Phursule

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 1620 - 1624

Hadoop: Understanding the Big Data Processing Method

Deepak Chandra Upreti, Pawan Sharma, Dr. Yaduvir Singh

Share this Article

Similar Articles with Keyword 'Distributed Data'

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 9, September 2015

Pages: 1590 - 1593

Secure Data Retrieval Using CP-ABE Approach For Decentralized Disruption-Tolerant Military Networks

Karpe Navanath R. Patil Kalyani S. Panchabuddhe Priyanka P.

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 9, September 2015

Pages: 2058 - 2061

Privacy Preserved Public Auditing for Distributed Data

Anes P. A., Neethu Francis

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1592 - 1597

Privacy Conserving Gradient Descent Method Applied for Neural Network with Distributed Datasets

Sachin P. Yadav, Amit B. Chougule

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 2084 - 2088

Implementation of Efficient Privacy Preserving Data Analysis for Secure Data Transmission

Shital Gawahale, Rekha Jadhav

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 12, December 2015

Pages: 1290 - 1293

A Review on Need of MapReduce in Big Data Application

Sushant Shirish Nagavkar, Ashishkumar

Share this Article

Similar Articles with Keyword 'Relational Database'

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 5, May 2017

Pages: 1902 - 1905

Scalable Key Termed Based Search System: Experimental Results and Analysis

Bhagyashree Deshmukh, Shyam Gupta

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2452 - 2455

A Review on Big Data Management and NoSQL Databases in Digital Forensics

Nikhil Mangle, Prof. Praful B. Sambhare

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 572 - 576

A Research Article on Data Mining in Addition to Process Mining: Similarities and Dissimilarities

S. Sowjanya Chintalapati, Ch.G.V.N.Prasad, J. Sowjanya, R.Vineela

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 10, October 2015

Pages: 2153 - 2156

Effective Watermarking Techniques on Structured Datasets

Mini Joswin, Deeksha Bhardwaj

Share this Article

Research Paper, Computer Science & Engineering, Indonesia, Volume 6 Issue 7, July 2017

Pages: 2100 - 2107

Ontology Based Image Retrieval in the Compressed Domain

Suhendro Irianto, Boby Bachry

Share this Article

Similar Articles with Keyword 'NoSql'

Review Papers, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 2452 - 2455

A Review on Big Data Management and NoSQL Databases in Digital Forensics

Nikhil Mangle, Prof. Praful B. Sambhare

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1328 - 1330

Comparative Analysis of HBase Data Storage Model and RDBMS for Location based Application

Chandrakant Nitnaware, Amreen Khan

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 506 - 509

A Random Walk through the Dark Side of NoSQL Databases in Big Data Analytics

Kudakwashe Zvarevashe, Tatenda Trust Gotora

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 8 Issue 11, November 2019

Pages: 1523 - 1527

Big Data and Its Evolution in Data Warehouses

Rachita Kansal

Share this Article

Research Paper, Computer Science & Engineering, United States of America, Volume 8 Issue 12, December 2019

Pages: 1818 - 1822

Security Analysis of MongoDB and its Comparison with Relational Databases

Sukriti Bharti

Share this Article
Top