Information-Theoretic Bounds and Approximations in Neural Population Coding
원문 초록
While Shannon's mutual information has widespread applications in many disciplines, for practical applications it is often difficult to calculate its value accurately for high-dimensional variables because of the curse of dimensionality. This paper is focused on effective approximation methods for evaluating mutual information in the context of neural population coding. For large but finite neural populations, we derive several information-theoretic asymptotic bounds and approximation formulas that remain valid in high-dimensional spaces. We prove that optimizing the population density distribution based on these approximation formulas is a convex optimization problem which allows efficient numerical solutions. Numerical simulation results confirmed that our asymptotic formulas were highly accurate for approximating mutual information for large neural populations. In special cases, the approximation formulas are exactly equal to the true mutual information. We also discuss techniques of variable transformation and dimensionality reduction to facilitate computation of the approximations.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Improved Dimensionality Reduction for Inverse Problems in Nuclear Fusion and High-Energy Astrophysics
On relative universality, regression operator, and conditional independence
Active Learning for Manifold Gaussian Process Regression
The kernel of graph indices for vector search
Distributed Lyapunov Functions for Nonlinear Networks
Model-Based Real-Time Pose and Sag Estimation of Overhead Power Lines Using LiDAR for Drone Inspection
토론
이 논문과 연결된 포럼 글이 아직 없습니다.