International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
www.ijsr.net | Most Trusted Research Journal Since Year 2012

ISSN: 2319-7064



Review Papers | Computer Science & Engineering | India | Volume 3 Issue 12, December 2014

Anomaly Detection of Online Data using Oversampling Principal Component Analysis

Supriya A. Bagane, J. L. Chaudhari

Anomaly detection is very important topic in data mining and machine learning. This technique is helpful in many real world applications such as intrusion or credit card fraud detection, fault detection in safety critical systems, and military surveillance for enemy activities. Anomaly detection is basically used to find the patterns in data that do not conform to their expected behavior. Such patterns are termed as anomalies, outliers, discordant observations, exceptions, aberrations etc in different application domains. From all these terms anomalies and outliers can be used interchangeably. Outlier detection methods can be used to deal with extremely unbalanced data distribution problems. Most of the anomaly detection methods are implemented in batch mode due to which they cannot be extended to large scale problems. If we extend them to large scale problems, they will result in sacrificing computation and memory requirements. To tackle this problem we proposed oversampling Principal Component Analysis (osPCA) scheme in this paper. This technique aims at detecting the presence of outliers from large amount of data. In previously proposed Principal Component Analysis methods, it is required to store entire data matrix or covariance matrix, but this is not the case with our osPCA approach. So it can be extended to large scale or online problems. Principal Component Analysis is used to find the principal direction of the data and oversampling technique will duplicate the target instance multiple times to amplify the effect of outliers. By oversampling the target instance and extracting the principal directions of the data the osPCA allows us to determine the anomaly in target instance according to the variations in the resulting dominant eigenvector. This online updating technique allows us to efficiently calculate dominant eigenvector without eigen analysis or storing entire covariance matrix. Compared with the other anomaly detection methods the required computational costs and memory requirements are significantly reduced.

Keywords: Anomaly detection, principal Component Analysis, outlier, oversampling

Edition: Volume 3 Issue 12, December 2014

Pages: 687 - 690

Share this Article

How to Cite this Article?

Supriya A. Bagane, J. L. Chaudhari, "Anomaly Detection of Online Data using Oversampling Principal Component Analysis", International Journal of Science and Research (IJSR), https://www.ijsr.net/search_index_results_paperid.php?id=28111405, Volume 3 Issue 12, December 2014, 687 - 690

39 PDF Views | 36 PDF Downloads

Download Article PDF

Similar Articles with Keyword 'Anomaly detection'

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 2011 - 2014

Attack Detection and Mitigation for AGC

Pooja A Kulkarni, Harshal A Karande

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 2, February 2015

Pages: 1825 - 1828

Link-Anomaly Detection in Twitter Streams

Shari P S

Share this Article

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 3151 - 155

A Survey: Recent Autonomous Security Techniques for Detection & Avoidance of Network Attacks

Supriya Gupta, Ankur Goyal

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 11, November 2014

Pages: 2677 - 2680

Survey of Novel Method for Online Classification in Data Mining

Jadhav Bharat S, Gumaste S.V.

Share this Article

Research Paper, Computer Science & Engineering, Sudan, Volume 4 Issue 4, April 2015

Pages: 742 - 748

Assembly Classifier Approach to Analyze Intrusion Detection Dataset in Networks by Using Data Mining Techniques

Ayad Mohammed Mahyoub Ghaleb, Samani A. Talab

Share this Article

Similar Articles with Keyword 'principal Component Analysis'

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 4, April 2014

Pages: 618 - 622

Survey Paper on Different Approaches for Noise Level Estimation and Denoising of an Image

Bheem Prasad Ram, Sachi Choudhary

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1247 - 1250

A Survey on Facial Expression Recognition Techniques

Swati Mishra, Avinash Dhole

Share this Article

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 4, April 2015

Pages: 1537 - 1542

Remote Sensing Satellite Image Fusion Using Fast Curvelet Transforms

Namratha H. N., Raghu M. T.

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 2369 - 2371

Analysis on PLSR in Contrast with PCR

Abhimanyu Kumar

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 11, November 2016

Pages: 1393 - 1398

Human Gait Recognition Based on Gait Energy Image

Mayur Popade, Anita Thengade

Share this Article

Similar Articles with Keyword 'outlier'

M.Tech / M.E / PhD Thesis, Computer Science & Engineering, India, Volume 4 Issue 9, September 2015

Pages: 1233 - 1237

Novel Class Detection for Feature Evolving Data Streams

Harshada Wagaskar, Prof. Gayatri Bhandari

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 9, September 2014

Pages: 1121 - 1123

Survey on Categorization and Detection of Adaptive Novel Class of Feature Evolving Data Streams

Chaitrali T. Chavan, Prof. Vinod S. Wadne

Share this Article

Comparative Studies, Computer Science & Engineering, India, Volume 4 Issue 6, June 2015

Pages: 1865 - 1867

Improved the Correctness and Reduce the Error of DBSCAN using Ant Colony Optimization

Subodh Shrivastava, Brajesh Patel

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 4 Issue 8, August 2015

Pages: 2016 - 2019

A Survey on Outlier Detection Methods

Rajani S Kadam, Prakash R Devale

Share this Article

Survey Paper, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 1188 - 1192

Outlier Detection Based on Surfeit Entropy for Large Scale Categorical Data Set

Neha L. Bagal

Share this Article

Similar Articles with Keyword 'oversampling'

Review Papers, Computer Science & Engineering, India, Volume 3 Issue 12, December 2014

Pages: 687 - 690

Anomaly Detection of Online Data using Oversampling Principal Component Analysis

Supriya A. Bagane, J. L. Chaudhari

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 2 Issue 5, May 2013

Pages: 133 - 137

A Hybrid Approach of Module Sequence Generation using Neural Network for Software Architecture

Manjot Kalsi, Janpreet Singh

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 5 Issue 7, July 2016

Pages: 144 - 147

Cluster in High Dimensional Data to Detect Outlier

Sonali. A. Patil, Snehal. S. Thokale

Share this Article

Research Paper, Computer Science & Engineering, India, Volume 4 Issue 3, March 2015

Pages: 809 - 812

A Hybrid Approach for Smoothening and Denoising of an Image Using Enhanced Oversampling Algorithm

Ashish Trivedi, Sanjivani Shantaiya

Share this Article



Top