Hadoop Performance Improvement using Metadata and Securing with Oauth Token
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Most Trusted Research Journal Since Year 2012

ISSN: 2319-7064



Research Paper | Computer Science & Engineering | India | Volume 7 Issue 11, November 2018

Hadoop Performance Improvement using Metadata and Securing with Oauth Token

Swapnali A. Salunkhe, Amol B. Rajmane

Initially Hadoop was designed without performance and security aspects. It was just used to process big data in parallel fashion. But now days user needs big data with high speed and with security features. But Hadoop has some limitations while executing the job. These limitations are reduces the efficiency of hadoop and increases the job execution time. It is mostly because of the job processing method of current hadoop system, scheduling and resource allocation. The proposed system replaces the current job processing method by using different one. Proposed system matches a new job with previously executed jobs. If a match found then same results are displayed to user and if not then it will execute new job. If a matching rate is high then execution time will automatically decreases. The proposed system also focuses on security constraints of current hadoop system. Current hadoop system does secure data while uploading and downloading it from system. Data in hadoop system is secured with OAuth authorization token token with AES algorithm for encryption and decryption. Proposed system authorizes hadoop user and encrypts data while uploading and downloading data from hadoop system. The encryption time of data is also less so it does not affect the performance of hadoop. So the proposed system decreases the execution time by metadata matching technique and secures with real time encryption algorithm

Keywords: Hadoop, Bigdata, Map Reduce, OAuth token, Real Time Encryption Algorithm

Edition: Volume 7 Issue 11, November 2018

Pages: 1951 - 1955

Share this Article

How to Cite this Article?

Swapnali A. Salunkhe, Amol B. Rajmane, "Hadoop Performance Improvement using Metadata and Securing with Oauth Token", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=ART20192301, Volume 7 Issue 11, November 2018, 1951 - 1955

580 PDF Views | 320 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Hadoop'

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 1967 - 1970

Survey on Recommender System using Distributed Framework

Sonali B. Ghodake, R. S. Paswan

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 1690 - 1693

Extended Best Peer: A Peer-to-Peer Based System by Corporate Network for Data Sharing

Chandre P.R, Bhavsar Harshada

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015

Pages: 1249 - 1251

Survey on Resource Allocation in Phase-Level using MapReduce in Hadoop

Suryakant S. Bhalke

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 6, June 2017

Pages: 1711 - 1716

Live Data Stream Classification for Reducing Query Processing Time: Design and Analysis

Spraha Kamriya, Vandana Kate

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 3150 - 3153

Enhancing the Hadoop Performance through Data Placement in Heterogeneous Hadoop Cluster

A Ankita Poovaiah, Gopal B

Share this Article

Similar Articles with Keyword 'Bigdata'

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 1676 - 1680

A Survey on Big Data Mining Algorithms

S. Sivasankar, T. Prabhakaran

Share this Article

Case Studies, Computer Science & Engineering, India, Volume 5 Issue 4, April 2016

Pages: 1486 - 1492

An Outlook on India?s Healthcare System with a Medical Case Study and Review on Big Data and its Importance in Healthcare

Saikrishna Depuru, Dr. R. Raj Kumar

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017

Pages: 378 - 381

Developing Patterns in Security Challenges for Coordination of IOT, Bigdata, Network Security: A Survey

M. Aruna, Vadduri V S N S A D Bhavani, Sanapathi Anusha

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1183 - 1187

Memory Management in BigData

Yanish Pradhananga, Shridevi C. Karande

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 6 Issue 10, October 2017

Pages: 1271 - 1272

An Approach for Outsourced Big Data to Provide Security

Veladandi Divya

Share this Article

Similar Articles with Keyword 'Map Reduce'

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 1690 - 1693

Extended Best Peer: A Peer-to-Peer Based System by Corporate Network for Data Sharing

Chandre P.R, Bhavsar Harshada

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 2112 - 2115

Approach to Solve NP Complete Problem Using Game Theoretic Scheduling Algorithm and Map-Reduce on Clouds

V. Mogal, Shekhar H. Pingale

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2762 - 2766

Large Scale Data Shared by Peer to Peer Based System in Shared Network

Bhavsar Harshada V., Dr. S. V. Gumaste, Prof. Deokate Gajanan S.

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 1240 - 1244

Implementing K-Means Clustering Algorithm Using MapReduce Paradigm

Botcha Chandrasekhara Rao, Medara Rambabu

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 2768 - 2769

Distributed Data Storage and Retrieval on Cloud by using Hadoop

N. Brahmanaidu, Shaik Riaz

Share this Article

Similar Articles with Keyword 'Real Time Encryption Algorithm'

Survey Paper, Computer Science & Engineering, India, Volume 6 Issue 7, July 2017

Pages: 51 - 54

A Survey on Performance and Security of Hadoop

Swapnali A. Salunkhe, Amol B. Rajmane

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 7 Issue 11, November 2018

Pages: 1951 - 1955

Hadoop Performance Improvement using Metadata and Securing with Oauth Token

Swapnali A. Salunkhe, Amol B. Rajmane

Share this Article
Top