Downloads: 111 | Views: 170

Review Papers | Aerospace Engineering | India | Volume 6 Issue 1, January 2017

Progressive Detection of Duplicate Data

Deepa Bhattacharya | Sapna Patle

Abstract: Data duplicate detection is the process of identifying multiple representations of same or real world entities. Nowadays, data duplicate detection methods are needed to process larger datasets in shorter time maintaining the quality of the datasets and also the entities duplicated becomes increasingly difficult. This application focus on the duplicates in hierarchical datas like XML file. The data can be detected using the detection methods. Here the datasets are loaded in the applications and the processing, extraction, cleaning, separation and detection are carried out to remove the duplicated data. Comprehensive experiments show that our progressive algorithms can double the efficiency over time of traditional duplicate detection and significantly improve upon related work

Keywords: Duplicate detection, entity resolution, progressiveness, and data cleaning

Edition: Volume 6 Issue 1, January 2017,

Pages: 1647 - 1649