Differentiable Causal Computations via Delayed Trace
원문 초록
We investigate causal computations taking sequences of inputs to sequences of outputs where the $n$th output depends on the first $n$ inputs only. We model these in category theory via a construction taking a Cartesian category $C$ to another category $St(C)$ with a novel trace-like operation called "delayed trace", which misses yanking and dinaturality axioms of the usual trace. The delayed trace operation provides a feedback mechanism in $St(C)$ with an implicit guardedness guarantee. When $C$ is equipped with a Cartesian differential operator, we construct a differential operator for $St(C)$ using an abstract version of backpropagation through time, a technique from machine learning based on unrolling of functions. This obtains a swath of properties for backpropagation through time, including a chain rule and Schwartz theorem. Our differential operator is also able to compute the derivative of a stateful network without requiring the network to be unrolled.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SelfDRSC++: Self-Supervised Dual Reversed Rolling Shutter Correction via Video Interpolation
Rolling Shutter Correction with Intermediate Distortion Flow Estimation
UniINR: Event-guided Unified Rolling Shutter Correction, Deblurring, and Interpolation
Stochastic Unrolled Federated Learning
Neural Image Re-Exposure
A Compound Gaussian Least Squares Algorithm and Unrolled Network for Linear Inverse Problems
토론
이 논문과 연결된 포럼 글이 아직 없습니다.