Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shift
원문 초록
A biosignal is a signal that can be continuously measured from human bodies, such as respiratory sounds, heart activity (ECG), brain waves (EEG), etc, based on which, machine learning models have been developed with very promising performance for automatic disease detection and health status monitoring. However, dataset shift, i.e., data distribution of inference varies from the distribution of the training, is not uncommon for real biosignal-based applications. To improve the robustness, probabilistic models with uncertainty quantification are adapted to capture how reliable a prediction is. Yet, assessing the quality of the estimated uncertainty remains a challenge. In this work, we propose a framework to evaluate the capability of the estimated uncertainty in capturing different types of biosignal dataset shifts with various degrees. In particular, we use three classification tasks based on respiratory sounds and electrocardiography signals to benchmark five representative uncertainty quantification methods. Extensive experiments show that, although Ensemble and Bayesian models could provide relatively better uncertainty estimations under dataset shifts, all tested models fail to meet the promise in trustworthy prediction and model calibration. Our work paves the way for a comprehensive evaluation for any newly developed biosignal classifiers.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Classification of Hand-Grasp Movements of Stroke Patients using EEG Data
Imagined speech classification using EEG
AFPM: Alignment-based Frame Patch Modeling for Cross-Dataset EEG Decoding
EEG Foundation Challenge: From Cross-Task to Cross-Subject EEG Decoding
Low-Density 3D Point Cloud Classification
Speech Imagery BCI Training Using Game with a Purpose
토론
이 논문과 연결된 포럼 글이 아직 없습니다.