Stable Prediction with Model Misspecification and Agnostic Distribution Shift
원문 초록
For many machine learning algorithms, two main assumptions are required to guarantee performance. One is that the test data are drawn from the same distribution as the training data, and the other is that the model is correctly specified. In real applications, however, we often have little prior knowledge on the test data and on the underlying true model. Under model misspecification, agnostic distribution shift between training and test data leads to inaccuracy of parameter estimation and instability of prediction across unknown test data. To address these problems, we propose a novel Decorrelated Weighting Regression (DWR) algorithm which jointly optimizes a variable decorrelation regularizer and a weighted regression model. The variable decorrelation regularizer estimates a weight for each sample such that variables are decorrelated on the weighted training data. Then, these weights are used in the weighted regression to improve the accuracy of estimation on the effect of each variable, thus help to improve the stability of prediction across unknown test data. Extensive experiments clearly demonstrate that our DWR algorithm can significantly improve the accuracy of parameter estimation and stability of prediction with model misspecification and agnostic distribution shift.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Nearness of Neighbors Attention for Regression in Supervised Finetuning
Optimizing Blood Transfusions and Predicting Shortages in Resource-Constrained Areas
Why Regression? Binary Encoding Classification Brings Confidence to Stock Market Index Price Prediction
Gaussian Process Regression With Interpretable Sample-Wise Feature Weights
Prediction of Chronic Kidney Disease - A Machine Learning Perspective
Efficient energy consumption prediction model for a data analytic-enabled industry building in a smart city
토론
이 논문과 연결된 포럼 글이 아직 없습니다.