Downloads: 111
Survey Paper | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014
A Survey on Duplicate Detection in Hierarchical Data
Nikhil Gawande, S. R. Todamal
Abstract: Although there has been a lot work done on identifying duplicates in relational data, but only a few solutions focus on identifying duplicates in more complex hierarchical structures, like XML data. In this paper, we have demonstrated the novel method for XML duplicate detection, called XMLDup. XMLDup method implements the Bayesian network to calculate and determine the probability of two XML nodes, considering not only the information within the XML nodes, but also the way that the information is structured. In addition, to increase the efficiency of the network evaluation, a novel pruning strategy, capable of significant gains over the unoptimized version of the algorithm, is presented. Through experiments and comparisons, we show that our algorithm is able to achieve high precision and recall scores in several datasets. XMLDup method helps us to improve both efficiency and of effectiveness.
Keywords: duplicate detection, record linkage, entity resolution, XML, Bayesian networks, data cleaning, optimization
Edition: Volume 3 Issue 12, December 2014,
Pages: 751 - 754
How to Cite this Article?
Nikhil Gawande, S. R. Todamal, "A Survey on Duplicate Detection in Hierarchical Data", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=SUB14438, Volume 3 Issue 12, December 2014, 751 - 754
How to Share this Article?
Similar Articles with Keyword 'duplicate detection'
Downloads: 93
Informative Article, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020
Pages: 85 - 88CBCD Methods in Video Copy Detection
Jan Mary Thomas
Downloads: 103
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 2676 - 2680Effective and Efficient XML Duplicate Detection Using Levenshtein Distance Algorithm
Shital Gaikwad, Nagaraju Bogiri
Similar Articles with Keyword 'record linkage'
Downloads: 107
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2296 - 2300Clustering Tree based Implementation of Record Linkage on Many-to-Many Relation
V. Balvannanathan, R. Siva
Downloads: 112
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015
Pages: 1217 - 1219Removing Dedepulication Using Pattern Serach Suffix Arrays
Pratiksha Dhande, Supriya Kumari, Sushmita Tupe, Laukik Shah
Similar Articles with Keyword 'entity resolution'
Downloads: 107
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2296 - 2300Clustering Tree based Implementation of Record Linkage on Many-to-Many Relation
V. Balvannanathan, R. Siva
Downloads: 122
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 6 Issue 11, November 2017
Pages: 330 - 333Rule-Based Method for Entity Resolution Using Optimized Root Discovery (ORD)
Liji S, Nithya M
Similar Articles with Keyword 'XML'
Downloads: 102
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015
Pages: 3021 - 3028Smart Type-Ahead Search in XML
Supriya. N. Chaudhari, Vaishali M. Deshmukh
Downloads: 103
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 5, May 2014
Pages: 1628 - 1631A Survey On XML-Injection Attack Detection Systems
Swati Ramesh Kesharwani, Aarti Deshpande
Similar Articles with Keyword 'Bayesian networks'
Downloads: 40
Research Paper, Computer Science & Engineering, China, Volume 9 Issue 4, April 2020
Pages: 1544 - 1554Recent Developments on Probabilistic Graphical Model Applied in Data Analysis
Kan'Sam Nadjak, Guisheng Yin
Downloads: 127
Review Papers, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015
Pages: 2058 - 2061Medical Diagnosis for Liver Cancer using Classification Techniques
Reetu, Narender Kumar
Similar Articles with Keyword 'data cleaning'
Downloads: 105
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 1850 - 1856A Review on Detection of Outliers Over High Dimensional Streaming Data Using Cluster Based Hybrid Approach
Abhishek B. Mankar, Namrata Ghuse
Downloads: 109
Review Papers, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015
Pages: 2180 - 2182Review of Improved Cross Redundant Data Cleaning Algorithm for RFID and WSN Integration
Jayashri M. Dupare, N. U. Sambhe
Similar Articles with Keyword 'optimization'
Downloads: 1
Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021
Pages: 948 - 951Survey on Various Image Segmentation Techniques
Babita Chauhan
Downloads: 1
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 9, September 2021
Pages: 939 - 945Load Balancing in Cloud Computing Using Optimization Algorithm
Manpreet Kaur, Dr. Amandeep Kaur
Similar Articles with Keyword 'duplicate'
Downloads: 93
Informative Article, Computer Science & Engineering, India, Volume 9 Issue 12, December 2020
Pages: 85 - 88CBCD Methods in Video Copy Detection
Jan Mary Thomas
Downloads: 100
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 11, November 2015
Pages: 1147 - 1150Enhance QoS of Lossy Wireless Sensor Network by In-Network Data Aggregation
Harshada Kupade, Madhav Ingle
Similar Articles with Keyword 'detection'
Downloads: 134
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015
Pages: 2246 - 2249Packet Analysis with Network Intrusion Detection System
Rashmi Hebbar, Mohan K
Downloads: 1
Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 5, May 2021
Pages: 948 - 951Survey on Various Image Segmentation Techniques
Babita Chauhan
Similar Articles with Keyword 'record'
Downloads: 0
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 11, November 2021
Pages: 1044 - 1052A Comprehensive Study of Various Sorting Algorithms
Cherukuri Nischay Sai
Downloads: 3
Research Paper, Computer Science & Engineering, India, Volume 10 Issue 4, April 2021
Pages: 1292 - 1297Supply Chain Using Blockchain (Healthcare Industry)
Prof. Mangesh G. Ingale, Shyam Jamman Parmeshwar, Yash G. Purohit, Divyani Sable, Vishaksha Kachane
Similar Articles with Keyword 'linkage'
Downloads: 102
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 3225 - 3227NCPR: Plummeting Direction-Finding Overhead In MANETs
S. R. Pawar, P. A. Jadhav
Downloads: 105
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2133 - 2136One Class Clustering Tree for Implementing Many to Many Data Linkage
Ravi R, Michael G
Similar Articles with Keyword 'entity'
Downloads: 82
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 3, March 2013
Pages: 165 - 167Statistical Analysis of DCT Coefficients for Ascertaining Ears Biometrics
Nisha, Jatinder Kansal, JPS Raina
Downloads: 99
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1486 - 1489Mobile Based Marketing System Using Privacy and Security Aware Location Based Rewarding System
Digvijay A. Patil, Yogesh B. Gurav
Similar Articles with Keyword 'resolution'
Downloads: 7
Survey Paper, Computer Science & Engineering, India, Volume 10 Issue 7, July 2021
Pages: 113 - 116Semantic Segmentation using Deep Learning Approaches - A Study
Salim Ahmed Ali, Dr. B. G. Prasad
Downloads: 102
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 1011 - 1013Transplantation of Native Android Apps onto J2ME Platform
Revati M. Wahul, Meenakshi Chandak, Neha Pandit, Kalyani Mote