Semantic Feature Decomposition based Semantic Communication System of Images with Large-scale Visual Generation Models
원문 초록
The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced communication efficiency, anti-noise ability and semantic fidelity. Therefore, we proposed a novel paradigm based on Semantic Feature Decomposition (SeFD) for the integration of semantic communication and large-scale visual generation models to achieve high-performance, highly interpretable and controllable image communication. According to this paradigm, a Texture-Color based Semantic Communication system of Images TCSCI is proposed. TCSCI decomposing the images into their natural language description (text), texture and color semantic features at the transmitter. During the transmission, features are transmitted over the wireless channel, and at the receiver, a large-scale visual generation model is utilized to restore the image through received features. TCSCI can achieve extremely compressed, highly noise-resistant, and visually similar image semantic communication, while ensuring the interpretability and editability of the transmission process. The experiments demonstrate that the TCSCI outperforms traditional image communication systems and existing semantic communication systems under extreme compression with good anti-noise performance and interpretability.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Adaptive Semantic Token Communication for Transformer-based Edge Inference
SCU: An Efficient Machine Unlearning Scheme for Deep Learning Enabled Semantic Communications
SpikACom: A Neuromorphic Computing Framework for Green Communications
GenSC-6G: A Prototype Testbed for Integrated Generative AI, Quantum, and Semantic Communication
Large Model Empowered Streaming Speech Semantic Communications
Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.