A Methodological Survey on MapReduce for Identification of Duplicate Images
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064

Views: 138 , Downloads: 121 | CTR: 88 % | Weekly Popularity: ⮙1

Survey Paper | Computer Science & Engineering | India | Volume 5 Issue 1, January 2016

A Methodological Survey on MapReduce for Identification of Duplicate Images

Amol S. Deshmukh, Prof. P. D. Lambhate

Duplicate image identification for deduplication is a specialized data compression technique for eliminating duplicate copies of repeating data in storage. The technique is used to improve storage utilization by avoiding duplicate data. With the explosive growth of digital data, deduplication schemes are widely employed to backup data and minimize network and storage overhead by detecting and eliminating redundancy among data. In this paper we propose the Duplicate image identification using MapReduce technique which improves efficiency and reliability of the System. MapReduce is simple and parallel computing techniques normally used for analyzing the huge data. Traditional deduplication schemes works if and only if the second image having the same underlying bits as first. This restricts the performance of many applications as exact images need to be there if want to succeed. In many practical applications where the storage restriction is present, users uploads the modified images varying with the quality or resolution. Experimental results demonstrate in a real dataset, the proposed approach not only effectively saves storage space, but also significantly improves the retrieval precision of duplicate images. In addition, the selection of the images can meet the requirements of peoples perception.

Keywords: Duplicate image identification, Deduplication, MapReduce technique, big data, data partitioning, Pearson Correlation

Edition: Volume 5 Issue 1, January 2016

Pages: 206 - 210

Share this Article

How to Cite this Article?

Amol S. Deshmukh, Prof. P. D. Lambhate, "A Methodological Survey on MapReduce for Identification of Duplicate Images", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=NOV152632, Volume 5 Issue 1, January 2016, 206 - 210

138 PDF Views | 121 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Deduplication'

Views: 127 , Downloads: 100 | CTR: 79 % | Weekly Popularity: ⮙4

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1685 - 1688

An Advanced Data De-duplication Using Novel Variable Size Hashing Technique for Text Files Using Hybrid Cloud Architecture

Haritha Nair, Varsha Botre, Hina Khan, Pritee Nalage, Hiranwale S.B.

Share this Article

Views: 127 , Downloads: 101 | CTR: 80 % | Weekly Popularity: ⮙4

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1812 - 1814

A Survey on Deduplication Scheme in Cloud Storage

Deepa.D, Revathi.M

Share this Article

Views: 133 , Downloads: 104 | CTR: 78 % | Weekly Popularity: ⮙2

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1696 - 1700

Data Security Policies in Cloud: A Survey

Kasundra Punitkumar R., Shikha J. Pachouly

Share this Article

Views: 139 , Downloads: 106 | CTR: 76 % | Weekly Popularity: ⮙3

Review Papers, Computer Science & Engineering, India, Volume 6 Issue 3, March 2017

Pages: 1613 - 1618

Review of Various Encryption and Compression Mechanisms Used within Deduplication in Cloud Computing

Nancy Digra, Sandeep Sharma

Share this Article

Views: 118 , Downloads: 108 | CTR: 92 % | Weekly Popularity: ⮙2

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 2, February 2016

Pages: 2217 - 2219

A Hybrid Cloud Approach for Secure Authorized Deduplication

Sunita S. Velapure, S. S. Barde

Share this Article

Similar Articles with Keyword 'MapReduce technique'

Views: 138 , Downloads: 121 | CTR: 88 % | Weekly Popularity: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 206 - 210

A Methodological Survey on MapReduce for Identification of Duplicate Images

Amol S. Deshmukh, Prof. P. D. Lambhate

Share this Article

Views: 150 , Downloads: 128 | CTR: 85 % | Weekly Popularity: ⮙5

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 423 - 426

A Survey on Parallel Method for Rough Set using MapReduce Technique for Data Mining

Varda C. Dhande, B.V. Pawar

Share this Article

Similar Articles with Keyword 'big data'

Views: 125 , Downloads: 101 | CTR: 81 % | Weekly Popularity: ⮙1

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 7, July 2015

Pages: 2241 - 2244

Backup Anomaly Identification with R and Hadoop

Ravindra Phule, Madhav Ingle

Share this Article

Views: 118 , Downloads: 103 | CTR: 87 % | Weekly Popularity: ⮙4

Informative Article, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1482 - 1485

Overview of Big Data

Nivedita Manohar

Share this Article

Views: 132 , Downloads: 104 | CTR: 79 % | Weekly Popularity: ⮙2

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015

Pages: 1164 - 1169

A Survey on Scalable Big Data Analytics Platform

Ravindra Phule, Madhav Ingle

Share this Article

Views: 137 , Downloads: 105 | CTR: 77 % | Weekly Popularity: ⮙1

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 3150 - 3153

Enhancing the Hadoop Performance through Data Placement in Heterogeneous Hadoop Cluster

A Ankita Poovaiah, Gopal B

Share this Article

Views: 143 , Downloads: 106 | CTR: 74 % | Weekly Popularity: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2214 - 2216

Privacy-Preserving Mining of Association Rules in Cloud

Vishal Ravindra Redekar, Dr. K.N.Honwadkar

Share this Article

Similar Articles with Keyword 'Pearson Correlation'

Views: 137 , Downloads: 110 | CTR: 80 % | Weekly Popularity: ⮙3

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 1967 - 1970

Survey on Recommender System using Distributed Framework

Sonali B. Ghodake, R. S. Paswan

Share this Article

Views: 138 , Downloads: 121 | CTR: 88 % | Weekly Popularity: ⮙1

Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 1, January 2016

Pages: 206 - 210

A Methodological Survey on MapReduce for Identification of Duplicate Images

Amol S. Deshmukh, Prof. P. D. Lambhate

Share this Article
Top