Finding Pegasus: Enhancing Unsupervised Anomaly Detection in High-Dimensional Data using a Manifold-Based Approach
원문 초록
Unsupervised machine learning methods are well suited to searching for anomalies at scale but can struggle with the high-dimensional representation of many modern datasets, hence dimensionality reduction (DR) is often performed first. In this paper we analyse unsupervised anomaly detection (AD) from the perspective of the manifold created in DR. We present an idealised illustration, "Finding Pegasus", and a novel formal framework with which we categorise AD methods and their results into "on manifold" and "off manifold". We define these terms and show how they differ. We then use this insight to develop an approach of combining AD methods which significantly boosts AD recall without sacrificing precision in situations employing high DR. When tested on MNIST data, our approach of combining AD methods improves recall by as much as 16 percent compared with simply combining with the best standalone AD method (Isolation Forest), a result which shows great promise for its application to real-world data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Deep Symmetric Autoencoders from the Eckart-Young-Schmidt Perspective
RoBiS: Robust Binary Segmentation for High-Resolution Industrial Images
CostFilter-AD: Enhancing Anomaly Detection through Matching Cost Filtering
Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomization
Learning Normal Patterns in Musical Loops
Unsupervised anomaly detection in MeV ultrafast electron diffraction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.