Mitigating loss of variance in ensemble data assimilation: machine learning-based and distance-free localizations for better covariance estimation
원문 초록
We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results by mitigating loss of variance due to sampling errors. We also analyze the suitability of several machine learning models and the balance between accuracy and computational cost of the covariance estimations. We introduce two distance-free localization techniques leveraging machine learning methods specifically tailored for tabular data. The methods are integrated into the Ensemble Smoother with Multiple Data Assimilation (ES-MDA) framework. The results show that the proposed localizations improve covariance accuracy and enhance data assimilation and uncertainty quantification results. We observe reduced variance loss for the input variables using the proposed methods. Furthermore, we compare several machine learning models, assessing their suitability for the problem in terms of computational cost, and quality of the covariance estimation and data match. The influence of ensemble size is also investigated, providing insights into balancing accuracy and computational efficiency. Our findings demonstrate that certain machine learning models are more suitable for this problem. This study introduces two novel methods that mitigate variance loss for model parameters in ensemble-based data assimilation, offering practical solutions that are easy to implement and do not require any additional numerical simulation or hyperparameter tuning.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Structure and asymptotic preserving deep neural surrogates for uncertainty quantification in multiscale kinetic equations
Bayesian Probabilistic Matrix Factorization
Statistical Machine Learning for Astronomy -- A Textbook
From Roots to Rewards: Dynamic Tree Reasoning with RL
Interpretable Bayesian Tensor Network Kernel Machines with Automatic Rank and Feature Selection
DCR: Quantifying Data Contamination in LLMs Evaluation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.