Language-centered Human Activity Recognition
원문 초록
Human Activity Recognition (HAR) using Inertial Measurement Unit (IMU) sensors is critical for applications in healthcare, safety, and industrial production. However, variations in activity patterns, device types, and sensor placements create distribution gaps across datasets, reducing the performance of HAR models. To address this, we propose LanHAR, a novel system that leverages Large Language Models (LLMs) to generate semantic interpretations of sensor readings and activity labels for cross-dataset HAR. This approach not only mitigates cross-dataset heterogeneity but also enhances the recognition of new activities. LanHAR employs an iterative re-generation method to produce high-quality semantic interpretations with LLMs and a two-stage training framework that bridges the semantic interpretations of sensor readings and activity labels. This ultimately leads to a lightweight sensor encoder suitable for mobile deployment, enabling any sensor reading to be mapped into the semantic interpretation space. Experiments on four public datasets demonstrate that our approach significantly outperforms state-of-the-art methods in both cross-dataset HAR and new activity recognition. The source code will be made publicly available.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SEZ-HARN: Self-Explainable Zero-shot Human Activity Recognition Network
Through-the-Wall Radar Human Activity Recognition WITHOUT Using Neural Networks
Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset
DeepConvContext: A Multi-Scale Approach to Timeseries Classification in Human Activity Recognition
Label Leakage in Federated Inertial-based Human Activity Recognition
MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devices
토론
이 논문과 연결된 포럼 글이 아직 없습니다.