Equitability Analysis of the Maximal Information Coefficient, with Comparisons
원문 초록
A measure of dependence is said to be equitable if it gives similar scores to equally noisy relationships of different types. Equitability is important in data exploration when the goal is to identify a relatively small set of strongest associations within a dataset as opposed to finding as many non-zero associations as possible, which often are too many to sift through. Thus an equitable statistic, such as the maximal information coefficient (MIC), can be useful for analyzing high-dimensional data sets. Here, we explore both equitability and the properties of MIC, and discuss several aspects of the theory and practice of MIC. We begin by presenting an intuition behind the equitability of MIC through the exploration of the maximization and normalization steps in its definition. We then examine the speed and optimality of the approximation algorithm used to compute MIC, and suggest some directions for improving both. Finally, we demonstrate in a range of noise models and sample sizes that MIC is more equitable than natural alternatives, such as mutual information estimation and distance correlation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Closed-Form Information Capacity of Canonical Signaling Models
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Large Language Models are Efficient Learners of Noise-Robust Speech Recognition
On the Properties and Estimation of Pointwise Mutual Information Profiles
MINDE: Mutual Information Neural Diffusion Estimation
Rethinking Negative Pairs in Code Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.