Nonlinear State-Space Generalizations of Graph Convolutional Neural Networks
원문 초록
Graph convolutional neural networks (GCNNs) learn compositional representations from network data by nesting linear graph convolutions into nonlinearities. In this work, we approach GCNNs from a state-space perspective revealing that the graph convolutional module is a minimalistic linear state-space model, in which the state update matrix is the graph shift operator. We show that this state update may be problematic because it is nonparametric, and depending on the graph spectrum it may explode or vanish. Therefore, the GCNN has to trade its degrees of freedom between extracting features from data and handling these instabilities. To improve such trade-off, we propose a novel family of nodal aggregation rules that aggregate node features within a layer in a nonlinear state-space parametric fashion allowing for a better trade-off. We develop two architectures within this family inspired by the recurrence with and without nodal gating mechanisms. The proposed solutions generalize the GCNN and provide an additional handle to control the state update and learn from the data. Numerical results on source localization and authorship attribution show the superiority of the nonlinear state-space generalization models over the baseline GCNN.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text
Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greek
MATCHED: Multimodal Authorship-Attribution To Combat Human Trafficking in Escort-Advertisement Data
OCEAN: Open-World Contrastive Authorship Identification
Decoding MIE: A Novel Dataset Approach Using Topic Extraction and Affiliation Parsing
Towards Effective Authorship Attribution: Integrating Class-Incremental Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.