BrainDecoder: Style-Based Visual Decoding of EEG Signals
원문 초록
Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of EEG, primarily focusing on reconstructing the semantic content of visual stimuli. In this paper, we present a novel visual decoding pipeline that, in addition to recovering the content, emphasizes the reconstruction of the style, such as color and texture, of images viewed by the subject. Unlike previous methods, this ``style-based'' approach learns in the CLIP spaces of image and text separately, facilitating a more nuanced extraction of information from EEG signals. We also use captions for text alignment simpler than previously employed, which we find work better. Both quantitative and qualitative evaluations show that our method better preserves the style of visual stimuli and extracts more fine-grained semantic information from neural signals. Notably, it achieves significant improvements in quantitative results and sets a new state-of-the-art on the popular Brain2Image dataset.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
eegFloss: A Python package for refining sleep EEG recordings using machine learning models
DBConformer: Dual-Branch Convolutional Transformer for EEG Decoding
AGTCNet: A Graph-Temporal Approach for Principled Motor Imagery EEG Classification
Cross-Modal Epileptic Signal Harmonization: Frequency Domain Mapping Quantization for Pre-training a Unified Neurophysiological Transformer
Efficient and faithful reconstruction of dynamical attractors using homogeneous differentiators
On using AI for EEG-based BCI applications: problems, current challenges and future trends
토론
이 논문과 연결된 포럼 글이 아직 없습니다.