Group Invariant Global Pooling
원문 초록
Much work has been devoted to devising architectures that build group-equivariant representations, while invariance is often induced using simple global pooling mechanisms. Little work has been done on creating expressive layers that are invariant to given symmetries, despite the success of permutation invariant pooling in various molecular tasks. In this work, we present Group Invariant Global Pooling (GIGP), an invariant pooling layer that is provably sufficiently expressive to represent a large class of invariant functions. We validate GIGP on rotated MNIST and QM9, showing improvements for the latter while attaining identical results for the former. By making the pooling process group orbit-aware, this invariant aggregation method leads to improved performance, while performing well-principled group aggregation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory
ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encoding
Artificial Neuronal Ensembles with Learned Context Dependent Gating
Learning unfolded networks with a cyclic group structure
Learning Invariant Representations for Equivariant Neural Networks Using Orthogonal Moments
Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groups
토론
이 논문과 연결된 포럼 글이 아직 없습니다.