Beyond Confusion: A Fine-grained Dialectical Examination of Human Activity Recognition Benchmark Datasets
원문 초록
The research of machine learning (ML) algorithms for human activity recognition (HAR) has made significant progress with publicly available datasets. However, most research prioritizes statistical metrics over examining negative sample details. While recent models like transformers have been applied to HAR datasets with limited success from the benchmark metrics, their counterparts have effectively solved problems on similar levels with near 100% accuracy. This raises questions about the limitations of current approaches. This paper aims to address these open questions by conducting a fine-grained inspection of six popular HAR benchmark datasets. We identified for some parts of the data, none of the six chosen state-of-the-art ML methods can correctly classify, denoted as the intersect of false classifications (IFC). Analysis of the IFC reveals several underlying problems, including ambiguous annotations, irregularities during recording execution, and misaligned transition periods. We contribute to the field by quantifying and characterizing annotated data ambiguities, providing a trinary categorization mask for dataset patching, and stressing potential improvements for future data collections.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SEZ-HARN: Self-Explainable Zero-shot Human Activity Recognition Network
Through-the-Wall Radar Human Activity Recognition WITHOUT Using Neural Networks
Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset
DeepConvContext: A Multi-Scale Approach to Timeseries Classification in Human Activity Recognition
Label Leakage in Federated Inertial-based Human Activity Recognition
MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devices
토론
이 논문과 연결된 포럼 글이 아직 없습니다.