Review Papers | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014
Anomaly Detection of Online Data using Oversampling Principal Component Analysis
Supriya A. Bagane, J. L. Chaudhari
Anomaly detection is very important topic in data mining and machine learning. This technique is helpful in many real world applications such as intrusion or credit card fraud detection, fault detection in safety critical systems, and military surveillance for enemy activities. Anomaly detection is basically used to find the patterns in data that do not conform to their expected behavior. Such patterns are termed as anomalies, outliers, discordant observations, exceptions, aberrations etc in different application domains. From all these terms anomalies and outliers can be used interchangeably. Outlier detection methods can be used to deal with extremely unbalanced data distribution problems. Most of the anomaly detection methods are implemented in batch mode due to which they cannot be extended to large scale problems. If we extend them to large scale problems, they will result in sacrificing computation and memory requirements. To tackle this problem we proposed oversampling Principal Component Analysis (osPCA) scheme in this paper. This technique aims at detecting the presence of outliers from large amount of data. In previously proposed Principal Component Analysis methods, it is required to store entire data matrix or covariance matrix, but this is not the case with our osPCA approach. So it can be extended to large scale or online problems. Principal Component Analysis is used to find the principal direction of the data and oversampling technique will duplicate the target instance multiple times to amplify the effect of outliers. By oversampling the target instance and extracting the principal directions of the data the osPCA allows us to determine the anomaly in target instance according to the variations in the resulting dominant eigenvector. This online updating technique allows us to efficiently calculate dominant eigenvector without eigen analysis or storing entire covariance matrix. Compared with the other anomaly detection methods the required computational costs and memory requirements are significantly reduced.
Keywords: Anomaly detection, principal Component Analysis, outlier, oversampling
Edition: Volume 3 Issue 12, December 2014
Pages: 687 - 690
How to Cite this Article?
Supriya A. Bagane, J. L. Chaudhari, "Anomaly Detection of Online Data using Oversampling Principal Component Analysis", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=28111405, Volume 3 Issue 12, December 2014, 687 - 690
134 PDF Views | 110 PDF Downloads
Similar Articles with Keyword 'Anomaly detection'
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015
Pages: 1825 - 1828Link-Anomaly Detection in Twitter Streams
Shari P S
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 2011 - 2014Attack Detection and Mitigation for AGC
Pooja A Kulkarni, Harshal A Karande
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015
Pages: 984 - 986Survey for Detecting Malicious user using Trust Evaluation and User Correlation for Protecting Online Reputation Systems
Vrushali G. Chabilwad, A. D. Gujar
Research Paper, Computer Science & Engineering, Iraq, Volume 6 Issue 12, December 2017
Pages: 1547 - 1551Attack Detection Based on Data Mining Techniques
Dr. Buthynna Fahran, Dr. Mohammed Najm, Mustafa Abdulsamea Abdulhamed
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015
Pages: 3054 - 3057A Hybrid System Using Genetic Algorithm for Anomaly Intrusion Detection
Arpitha J, Nagaraj Naik
Similar Articles with Keyword 'principal Component Analysis'
M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014
Pages: 897 - 899Removal of PCA Based Estimated Noise in Processed Images
Neethu Mohan
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 1764 - 1769Principal Component Analysis Based Classification Technique for Basmati Rice Grain Analysis
Rubi Kambo, Amit Yerpude
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 2369 - 2371Analysis on PLSR in Contrast with PCR
Abhimanyu Kumar
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 4, April 2014
Pages: 618 - 622Survey Paper on Different Approaches for Noise Level Estimation and Denoising of an Image
Bheem Prasad Ram, Sachi Choudhary
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 647 - 650Improvement in Recognition Rate by Using Linear Regression with Principal Component Analysis
Tanvi Ahuja, Vinit Agarwal
Similar Articles with Keyword 'outlier'
Research Paper, Computer Science & Engineering, Sweden, Volume 9 Issue 12, December 2020
Pages: 1137 - 1139Predicting Diabetes using Gradient Boosting is a Machine Learning Technique
Ali Adam Mohammad
Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015
Pages: 2016 - 2019A Survey on Outlier Detection Methods
Rajani S Kadam, Prakash R Devale
Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014
Pages: 1629 - 1633Graph Presentation in GMine System using Efficient Algorithm
Shafali Gupta, Ulka Panchal
Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014
Pages: 1850 - 1856A Review on Detection of Outliers Over High Dimensional Streaming Data Using Cluster Based Hybrid Approach
Abhishek B. Mankar, Namrata Ghuse
Comparative Studies, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015
Pages: 1865 - 1867Improved the Correctness and Reduce the Error of DBSCAN using Ant Colony Optimization
Subodh Shrivastava, Brajesh Patel
Similar Articles with Keyword 'oversampling'
Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015
Pages: 809 - 812A Hybrid Approach for Smoothening and Denoising of an Image Using Enhanced Oversampling Algorithm
Ashish Trivedi, Sanjivani Shantaiya
Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014
Pages: 687 - 690Anomaly Detection of Online Data using Oversampling Principal Component Analysis
Supriya A. Bagane, J. L. Chaudhari
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 3, March 2013
Pages: 216 - 220Sigma Delta Modulator with Improved Performance through Evolutionary Algorithm
T. K. Bandopadyay, Manish Saxena, Raghav Shrivastava
Research Paper, Computer Science & Engineering, India, Volume 2 Issue 5, May 2013
Pages: 133 - 137A Hybrid Approach of Module Sequence Generation using Neural Network for Software Architecture
Manjot Kalsi, Janpreet Singh
Research Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016
Pages: 144 - 147Cluster in High Dimensional Data to Detect Outlier
Sonali. A. Patil, Snehal. S. Thokale