Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics
원문 초록
Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approaches are interrelated by considering dynamical systems as representative of flows on a low-dimensional manifold. Building on this concept, we propose a new decomposed dynamical system model that represents complex non-stationary and nonlinear dynamics of time series data as a sparse combination of simpler, more interpretable components. Our model is trained through a dictionary learning procedure, where we leverage recent results in tracking sparse vectors over time. The decomposed nature of the dynamics is more expressive than previous switched approaches for a given number of parameters and enables modeling of overlapping and non-stationary dynamics. In both continuous-time and discrete-time instructional examples we demonstrate that our model can well approximate the original system, learn efficient representations, and capture smooth transitions between dynamical modes, focusing on intuitive low-dimensional non-stationary linear and nonlinear systems. Furthermore, we highlight our model's ability to efficiently capture and demix population dynamics generated from multiple independent subnetworks, a task that is computationally impractical for switched models. Finally, we apply our model to neural "full brain" recordings of C. elegans data, illustrating a diversity of dynamics that is obscured when classified into discrete states.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
CORAD: Correlation-Aware Compression of Massive Time Series using Sparse Dictionary Coding
Emergence of Functionally Differentiated Structures via Mutual Information Optimization in Recurrent Neural Networks
A Review of the Long Horizon Forecasting Problem in Time Series Analysis
Decomposing MLP Activations into Interpretable Features via Semi-Nonnegative Matrix Factorization
The interplay of robustness and generalization in quantum machine learning
Interpreting Large Text-to-Image Diffusion Models with Dictionary Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.