Machine Learning Model Drift Detection Via Weak Data Slices
원문 초록
Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation. However, it is often the case that actual labels are difficult and expensive to get, for example, because they require expert judgment. Therefore, there is a need for methods that detect likely degradation in ML operation without labels. We propose a method that utilizes feature space rules, called data slices, for drift detection. We provide experimental indications that our method is likely to identify that the ML model will likely change in performance, based on changes in the underlying data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Lite-RVFL: A Lightweight Random Vector Functional-Link Neural Network for Learning Under Concept Drift
Describing Nonstationary Data Streams in Frequency Domain
Early Concept Drift Detection via Prediction Uncertainty
Structuring the Processing Frameworks for Data Stream Evaluation and Application
SUDS: A Strategy for Unsupervised Drift Sampling
A method to benchmark high-dimensional process drift detection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.