Trustworthy Image Semantic Communication with GenAI: Explainablity, Controllability, and Efficiency
원문 초록
Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in interpretability, operability, and compatibility. To address these limitations, we propose a novel trustworthy ISC framework. This approach leverages text extraction and segmentation mapping techniques to convert images into explainable semantics, while employing Generative Artificial Intelligence (GenAI) for multiple downstream inference tasks. We also introduce a multi-rate ISC transmission protocol that dynamically adapts to both the received explainable semantic content and specific task requirements at the receiver. Simulation results demonstrate that our framework achieves explainable learning, decoupled training, and compatible transmission in various application scenarios. Finally, some intriguing research directions and application scenarios are identified.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Adaptive Semantic Token Communication for Transformer-based Edge Inference
SCU: An Efficient Machine Unlearning Scheme for Deep Learning Enabled Semantic Communications
SpikACom: A Neuromorphic Computing Framework for Green Communications
GenSC-6G: A Prototype Testbed for Integrated Generative AI, Quantum, and Semantic Communication
Large Model Empowered Streaming Speech Semantic Communications
Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.