Moment Multicalibration for Uncertainty Estimation
원문 초록
We show how to achieve the notion of "multicalibration" from H\'ebert-Johnson et al. [2018] not just for means, but also for variances and other higher moments. Informally, it means that we can find regression functions which, given a data point, can make point predictions not just for the expectation of its label, but for higher moments of its label distribution as well-and those predictions match the true distribution quantities when averaged not just over the population as a whole, but also when averaged over an enormous number of finely defined subgroups. It yields a principled way to estimate the uncertainty of predictions on many different subgroups-and to diagnose potential sources of unfairness in the predictive power of features across subgroups. As an application, we show that our moment estimates can be used to derive marginal prediction intervals that are simultaneously valid as averaged over all of the (sufficiently large) subgroups for which moment multicalibration has been obtained.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Conformal Prediction under Levy-Prokhorov Distribution Shifts: Robustness to Local and Global Perturbations
On the relationship between prediction intervals, tests of sharp nulls and inference on realized treatment effects in settings with few treated units
STACI: Spatio-Temporal Aleatoric Conformal Inference
Online Selective Conformal Prediction: Errors and Solutions
Conformal forecasting for surgical instrument trajectory
The kernel of graph indices for vector search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.