Extending Universal Intelligence Models with Formal Notion of Representation
원문 초록
Solomonoff induction is known to be universal, but incomputable. Its approximations, namely, the Minimum Description (or Message) Length (MDL) principles, are adopted in practice in the efficient, but non-universal form. Recent attempts to bridge this gap leaded to development of the Representational MDL principle that originates from formal decomposition of the task of induction. In this paper, possible extension of the RMDL principle in the context of universal intelligence agents is considered, for which introduction of representations is shown to be an unavoidable meta-heuristic and a step toward efficient general intelligence. Hierarchical representations and model optimization with the use of information-theoretic interpretation of the adaptive resonance are also discussed.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
OpenDPDv2: A Unified Learning and Optimization Framework for Neural Network Digital Predistortion
FedRef: Communication-Efficient Bayesian Fine Tuning with Reference Model
G$^{2}$D: Boosting Multimodal Learning with Gradient-Guided Distillation
From Tiny Machine Learning to Tiny Deep Learning: A Survey
BotTrans: A Multi-Source Graph Domain Adaptation Approach for Social Bot Detection
GFRIEND: Generative Few-shot Reward Inference through EfficieNt DPO
토론
이 논문과 연결된 포럼 글이 아직 없습니다.