Regression Trees Know Calculus
원문 초록
Regression trees have emerged as a preeminent tool for solving real-world regression problems due to their ability to deal with nonlinearities, interaction effects and sharp discontinuities. In this article, we rather study regression trees applied to well-behaved, differentiable functions, and determine the relationship between node parameters and the local gradient of the function being approximated. We find a simple estimate of the gradient which can be efficiently computed using quantities exposed by popular tree learning libraries. This allows the tools developed in the context of differentiable algorithms, like neural nets and Gaussian processes, to be deployed to tree-based models. To demonstrate this, we study measures of model sensitivity defined in terms of integrals of gradients and demonstrate how to compute them for regression trees using the proposed gradient estimates. Quantitative and qualitative numerical experiments reveal the capability of gradients estimated by regression trees to improve predictive analysis, solve tasks in uncertainty quantification, and provide interpretation of model behavior.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
STRIDE: Sparse Techniques for Regression in Deep Gaussian Processes
Statistical Machine Learning for Astronomy -- A Textbook
Uncertainty Quantification in SVM prediction
Modèles de Substitution pour les Modèles à base d'Agents : Enjeux, Méthodes et Applications
Integrative Analysis and Imputation of Multiple Data Streams via Deep Gaussian Processes
Discovery of Probabilistic Dirichlet-to-Neumann Maps on Graphs
토론
이 논문과 연결된 포럼 글이 아직 없습니다.