Analyzing Upper Bounds on Mean Absolute Errors for Deep Neural Network Based Vector-to-Vector Regression
원문 초록
In this paper, we show that, in vector-to-vector regression utilizing deep neural networks (DNNs), a generalized loss of mean absolute error (MAE) between the predicted and expected feature vectors is upper bounded by the sum of an approximation error, an estimation error, and an optimization error. Leveraging upon error decomposition techniques in statistical learning theory and non-convex optimization theory, we derive upper bounds for each of the three aforementioned errors and impose necessary constraints on DNN models. Moreover, we assess our theoretical results through a set of image de-noising and speech enhancement experiments. Our proposed upper bounds of MAE for DNN based vector-to-vector regression are corroborated by the experimental results and the upper bounds are valid with and without the "over-parametrization" technique.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
On Efficient Estimation of Distributional Treatment Effects under Covariate-Adaptive Randomization
DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience
Robust One-step Speech Enhancement via Consistency Distillation
MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement
Active Learning for Manifold Gaussian Process Regression
The kernel of graph indices for vector search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.