Downloads: 120
Review Papers | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014
Anomaly Detection of Online Data using Oversampling Principal Component Analysis
Supriya A. Bagane, J. L. Chaudhari
Abstract: Anomaly detection is very important topic in data mining and machine learning. This technique is helpful in many real world applications such as intrusion or credit card fraud detection, fault detection in safety critical systems, and military surveillance for enemy activities. Anomaly detection is basically used to find the patterns in data that do not conform to their expected behavior. Such patterns are termed as anomalies, outliers, discordant observations, exceptions, aberrations etc in different application domains. From all these terms anomalies and outliers can be used interchangeably. Outlier detection methods can be used to deal with extremely unbalanced data distribution problems. Most of the anomaly detection methods are implemented in batch mode due to which they cannot be extended to large scale problems. If we extend them to large scale problems, they will result in sacrificing computation and memory requirements. To tackle this problem we proposed oversampling Principal Component Analysis (osPCA) scheme in this paper. This technique aims at detecting the presence of outliers from large amount of data. In previously proposed Principal Component Analysis methods, it is required to store entire data matrix or covariance matrix, but this is not the case with our osPCA approach. So it can be extended to large scale or online problems. Principal Component Analysis is used to find the principal direction of the data and oversampling technique will duplicate the target instance multiple times to amplify the effect of outliers. By oversampling the target instance and extracting the principal directions of the data the osPCA allows us to determine the anomaly in target instance according to the variations in the resulting dominant eigenvector. This online updating technique allows us to efficiently calculate dominant eigenvector without eigen analysis or storing entire covariance matrix. Compared with the other anomaly detection methods the required computational costs and memory requirements are significantly reduced.
Keywords: Anomaly detection, principal Component Analysis, outlier, oversampling
Edition: Volume 3 Issue 12, December 2014,
Pages: 687 - 690
How to Cite this Article?
Supriya A. Bagane, J. L. Chaudhari, "Anomaly Detection of Online Data using Oversampling Principal Component Analysis", International Journal of Science and Research (IJSR), https://www.ijsr.net/get_abstract.php?paper_id=28111405, Volume 3 Issue 12, December 2014, 687 - 690
How to Share this Article?
Similar Articles with Keyword 'Anomaly detection'
Downloads: 108
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015
Pages: 984 - 986Survey for Detecting Malicious user using Trust Evaluation and User Correlation for Protecting Online Reputation Systems
Vrushali G. Chabilwad, A. D. Gujar
Downloads: 108
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2011 - 2014Attack Detection and Mitigation for AGC
Pooja A Kulkarni, Harshal A Karande
Similar Articles with Keyword 'principal Component Analysis'
Downloads: 105
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 1537 - 1542Remote Sensing Satellite Image Fusion Using Fast Curvelet Transforms
Namratha H. N., Raghu M. T.
Downloads: 105
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 2369 - 2371Analysis on PLSR in Contrast with PCR
Abhimanyu Kumar
Similar Articles with Keyword 'outlier'
Downloads: 71
Research Paper, Computer Science & Engineering, Sweden, Volume 9 Issue 12, December 2020
Pages: 1137 - 1139Predicting Diabetes using Gradient Boosting is a Machine Learning Technique
Ali Adam Mohammad
Downloads: 104
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015
Pages: 2016 - 2019A Survey on Outlier Detection Methods
Rajani S Kadam, Prakash R Devale
Similar Articles with Keyword 'oversampling'
Downloads: 122
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 809 - 812A Hybrid Approach for Smoothening and Denoising of an Image Using Enhanced Oversampling Algorithm
Ashish Trivedi, Sanjivani Shantaiya
Downloads: 127
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 3, March 2013
Pages: 216 - 220Sigma Delta Modulator with Improved Performance through Evolutionary Algorithm
T. K. Bandopadyay, Manish Saxena, Raghav Shrivastava
Similar Articles with Keyword 'Anomaly'
Downloads: 134
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015
Pages: 2246 - 2249Packet Analysis with Network Intrusion Detection System
Rashmi Hebbar, Mohan K
Downloads: 106
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 5, May 2015
Pages: 2085 - 2089Implementation and Analysis of DoS Attack Detection Algorithms
Rupesh Jaiswal, Dr. Shashikant Lokhande, Aditya Gulavani
Similar Articles with Keyword 'detection'
Downloads: 134
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015
Pages: 2246 - 2249Packet Analysis with Network Intrusion Detection System
Rashmi Hebbar, Mohan K
Downloads: 0
Student Project, Computer Science & Engineering, India, Volume 11 Issue 1, January 2022
Pages: 455 - 459Real World IoT Applications in Daily Domain
Eega Vivek Reddy, J Bala Krishna, Huzaifa Saad
Similar Articles with Keyword 'principal'
Downloads: 105
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 1537 - 1542Remote Sensing Satellite Image Fusion Using Fast Curvelet Transforms
Namratha H. N., Raghu M. T.
Downloads: 105
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 2369 - 2371Analysis on PLSR in Contrast with PCR
Abhimanyu Kumar
Similar Articles with Keyword 'Component'
Downloads: 134
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015
Pages: 2246 - 2249Packet Analysis with Network Intrusion Detection System
Rashmi Hebbar, Mohan K
Downloads: 2
Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 1380 - 1382A Literature Review of Enhancing Security in Mobile Ad-Hoc Networks Using Trust Management Security Scheme
Rajshree Ambatkar, Purnima Selokar
Similar Articles with Keyword 'Analysis'
Downloads: 108
Survey Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016
Pages: 1375 - 1390A Survey of Thinning Techniques on Two Dimensional Binary Images
Moumita Sarkar, Santanu Chatterjee
Downloads: 119 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Research Paper, Computer Science & Engineering, India, Volume 5 Issue 8, August 2016
Pages: 991 - 995A Study and Comparative Analysis of Cryptographic Algorithms for Various File Formats
M. Meena, A. Komathi