Anomaly Detection of Online Data using Oversampling Principal Component Analysis
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Open Access | Fully Refereed | Peer Reviewed International Journal

ISSN: 2319-7064

Review Papers | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014

Anomaly Detection of Online Data using Oversampling Principal Component Analysis

Supriya A. Bagane, J. L. Chaudhari

Anomaly detection is very important topic in data mining and machine learning. This technique is helpful in many real world applications such as intrusion or credit card fraud detection, fault detection in safety critical systems, and military surveillance for enemy activities. Anomaly detection is basically used to find the patterns in data that do not conform to their expected behavior. Such patterns are termed as anomalies, outliers, discordant observations, exceptions, aberrations etc in different application domains. From all these terms anomalies and outliers can be used interchangeably. Outlier detection methods can be used to deal with extremely unbalanced data distribution problems. Most of the anomaly detection methods are implemented in batch mode due to which they cannot be extended to large scale problems. If we extend them to large scale problems, they will result in sacrificing computation and memory requirements. To tackle this problem we proposed oversampling Principal Component Analysis (osPCA) scheme in this paper. This technique aims at detecting the presence of outliers from large amount of data. In previously proposed Principal Component Analysis methods, it is required to store entire data matrix or covariance matrix, but this is not the case with our osPCA approach. So it can be extended to large scale or online problems. Principal Component Analysis is used to find the principal direction of the data and oversampling technique will duplicate the target instance multiple times to amplify the effect of outliers. By oversampling the target instance and extracting the principal directions of the data the osPCA allows us to determine the anomaly in target instance according to the variations in the resulting dominant eigenvector. This online updating technique allows us to efficiently calculate dominant eigenvector without eigen analysis or storing entire covariance matrix. Compared with the other anomaly detection methods the required computational costs and memory requirements are significantly reduced.

Keywords: Anomaly detection, principal Component Analysis, outlier, oversampling

Edition: Volume 3 Issue 12, December 2014

Pages: 687 - 690

Share this Article

How to Cite this Article?

Supriya A. Bagane, J. L. Chaudhari, "Anomaly Detection of Online Data using Oversampling Principal Component Analysis", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=28111405, Volume 3 Issue 12, December 2014, 687 - 690

134 PDF Views | 110 PDF Downloads

Download Article PDF



Similar Articles with Keyword 'Anomaly detection'

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015

Pages: 1825 - 1828

Link-Anomaly Detection in Twitter Streams

Shari P S

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 2011 - 2014

Attack Detection and Mitigation for AGC

Pooja A Kulkarni, Harshal A Karande

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 1, January 2015

Pages: 984 - 986

Survey for Detecting Malicious user using Trust Evaluation and User Correlation for Protecting Online Reputation Systems

Vrushali G. Chabilwad, A. D. Gujar

Share this Article

Research Paper, Computer Science & Engineering, Iraq, Volume 6 Issue 12, December 2017

Pages: 1547 - 1551

Attack Detection Based on Data Mining Techniques

Dr. Buthynna Fahran, Dr. Mohammed Najm, Mustafa Abdulsamea Abdulhamed

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 3054 - 3057

A Hybrid System Using Genetic Algorithm for Anomaly Intrusion Detection

Arpitha J, Nagaraj Naik

Share this Article

Similar Articles with Keyword 'principal Component Analysis'

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 3 Issue 10, October 2014

Pages: 897 - 899

Removal of PCA Based Estimated Noise in Processed Images

Neethu Mohan

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1764 - 1769

Principal Component Analysis Based Classification Technique for Basmati Rice Grain Analysis

Rubi Kambo, Amit Yerpude

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2369 - 2371

Analysis on PLSR in Contrast with PCR

Abhimanyu Kumar

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 4, April 2014

Pages: 618 - 622

Survey Paper on Different Approaches for Noise Level Estimation and Denoising of an Image

Bheem Prasad Ram, Sachi Choudhary

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 647 - 650

Improvement in Recognition Rate by Using Linear Regression with Principal Component Analysis

Tanvi Ahuja, Vinit Agarwal

Share this Article

Similar Articles with Keyword 'outlier'

Research Paper, Computer Science & Engineering, Sweden, Volume 9 Issue 12, December 2020

Pages: 1137 - 1139

Predicting Diabetes using Gradient Boosting is a Machine Learning Technique

Ali Adam Mohammad

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015

Pages: 2016 - 2019

A Survey on Outlier Detection Methods

Rajani S Kadam, Prakash R Devale

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 3 Issue 6, June 2014

Pages: 1629 - 1633

Graph Presentation in GMine System using Efficient Algorithm

Shafali Gupta, Ulka Panchal

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 1850 - 1856

A Review on Detection of Outliers Over High Dimensional Streaming Data Using Cluster Based Hybrid Approach

Abhishek B. Mankar, Namrata Ghuse

Share this Article

Comparative Studies, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1865 - 1867

Improved the Correctness and Reduce the Error of DBSCAN using Ant Colony Optimization

Subodh Shrivastava, Brajesh Patel

Share this Article

Similar Articles with Keyword 'oversampling'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 809 - 812

A Hybrid Approach for Smoothening and Denoising of an Image Using Enhanced Oversampling Algorithm

Ashish Trivedi, Sanjivani Shantaiya

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 687 - 690

Anomaly Detection of Online Data using Oversampling Principal Component Analysis

Supriya A. Bagane, J. L. Chaudhari

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 3, March 2013

Pages: 216 - 220

Sigma Delta Modulator with Improved Performance through Evolutionary Algorithm

T. K. Bandopadyay, Manish Saxena, Raghav Shrivastava

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 5, May 2013

Pages: 133 - 137

A Hybrid Approach of Module Sequence Generation using Neural Network for Software Architecture

Manjot Kalsi, Janpreet Singh

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 144 - 147

Cluster in High Dimensional Data to Detect Outlier

Sonali. A. Patil, Snehal. S. Thokale

Share this Article
Top