Multi-category Angle-based Classifier Refit
원문 초록
Classification is an important statistical learning tool. In real application, besides high prediction accuracy, it is often desirable to estimate class conditional probabilities for new observations. For traditional problems where the number of observations is large, there exist many well developed approaches. Recently, high dimensional low sample size problems are becoming increasingly popular. Margin-based classifiers, such as logistic regression, are well established methods in the literature. On the other hand, in terms of probability estimation, it is known that for binary classifiers, the commonly used methods tend to under-estimate the norm of the classification function. This can lead to biased probability estimation. Remedy approaches have been proposed in the literature. However, for the simultaneous multicategory classification framework, much less work has been done. We fill the gap in this paper. In particular, we give theoretical insights on why heavy regularization terms are often needed in high dimensional applications, and how this can lead to bias in probability estimation. To overcome this difficulty, we propose a new refit strategy for multicategory angle-based classifiers. Our new method only adds a small computation cost to the problem, and is able to attain prediction accuracy that is as good as the regular margin-based classifiers. On the other hand, the improvement of probability estimation can be very significant. Numerical results suggest that the new refit approach is highly competitive.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
소프트 어텐션을 통한 피부암 분류 성능 향상
Soft-Attention Improves Skin Cancer Classification Performance
임상 응용 분야에서 신경망(neural network)은 입력 영상에서 가장 중요한 영역에 집중하고 이를 강조할 수 있어야 합니다. 소프트 어텐션(Soft-Attention) 메커니즘은 신경망이 이러한 목표를 달성할 수 있도록 합니다. 본 논문에서는 심층 신경망 구조에서 소프트 어텐션의 효과를 조사합니다. 소프트 어텐션의 핵심 목적은 중요한 특징의 가치를 높이고 노이즈를 유발하는 특징을 억제하는 것입니다. 저자들은 피부 병변을 분류(classification)할 때 소프트 어텐션 메커니즘을 적용한 경우와 적용하지 않은 경우의 VGG, ResNet, InceptionResNetv2, DenseNet 구조의 성능을 비교합니다. 기존 네트워크에 소프트 어텐션을 결합했을 때 HAM10000 데이터셋(dataset) [25]에서 93.7%의 정밀도(precision)를 달성하여 기준선(baseline)[16]보다 4.7% 향상된 성능을 보였습니다. 또한, 소프트 어텐션 결합을 통해 ISIC-2017 데이터셋 [2]에서 기준선[31] 대비 민감도 점수를 3.8% 개선하며 91.6%를 달성했습니다. 코드는 GitHub에서 공개되어 있습니다.
Using Instruction-Tuned Large Language Models to Identify Indicators of Vulnerability in Police Incident Narratives
Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices
STRAPPER: Preference-based Reinforcement Learning via Self-training Augmentation and Peer Regularization
Unlocking the Use of Raw Multispectral Earth Observation Imagery for Onboard Artificial Intelligence
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution
토론
이 논문과 연결된 포럼 글이 아직 없습니다.