Cross-functional transferability in universal machine learning interatomic potentials
원문 초록
The rapid development of universal machine learning interatomic potentials (uMLIPs) has demonstrated the possibility for generalizable learning of the universal potential energy surface. In principle, the accuracy of uMLIPs can be further improved by bridging the model from lower-fidelity datasets to high-fidelity ones. In this work, we analyze the challenge of this transfer learning problem within the CHGNet framework. We show that significant energy scale shifts and poor correlations between GGA and r$^2$SCAN pose challenges to cross-functional data transferability in uMLIPs. By benchmarking different transfer learning approaches on the MP-r$^2$SCAN dataset of 0.24 million structures, we demonstrate the importance of elemental energy referencing in the transfer learning of uMLIPs. By comparing the scaling law with and without the pre-training on a low-fidelity dataset, we show that significant data efficiency can still be achieved through transfer learning, even with a target dataset of sub-million structures. We highlight the importance of proper transfer learning and multi-fidelity learning in creating next-generation uMLIPs on high-fidelity data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Benchmarking Deep Learning and Vision Foundation Models for Atypical vs. Normal Mitosis Classification with Cross-Dataset Evaluation
Benchmarking histopathology foundation models in a multi-center dataset for skin cancer subtyping
The Catechol Benchmark: Time-series Solvent Selection Data for Few-shot Machine Learning
Disentangling coincident cell events using deep transfer learning and compressive sensing
Calibrated and Robust Foundation Models for Vision-Language and Medical Image Tasks Under Distribution Shift
Generalizing Vision-Language Models to Novel Domains: A Comprehensive Survey
토론
이 논문과 연결된 포럼 글이 아직 없습니다.