Variability Matters : Evaluating inter-rater variability in histopathology for robust cell detection
원문 초록
Large annotated datasets have been a key component in the success of deep learning. However, annotating medical images is challenging as it requires expertise and a large budget. In particular, annotating different types of cells in histopathology suffer from high inter- and intra-rater variability due to the ambiguity of the task. Under this setting, the relation between annotators' variability and model performance has received little attention. We present a large-scale study on the variability of cell annotations among 120 board-certified pathologists and how it affects the performance of a deep learning model. We propose a method to measure such variability, and by excluding those annotators with low variability, we verify the trade-off between the amount of data and its quality. We found that naively increasing the data size at the expense of inter-rater variability does not necessarily lead to better-performing models in cell detection. Instead, decreasing the inter-rater variability with the expense of decreasing dataset size increased the model performance. Furthermore, models trained from data annotated with lower inter-labeler variability outperform those from higher inter-labeler variability. These findings suggest that the evaluation of the annotators may help tackle the fundamental budget issues in the histopathology domain
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Style-Aligned Image Composition for Robust Detection of Abnormal Cells in Cytopathology
A Comparison of Deep Learning Methods for Cell Detection in Digital Cytology
Real-Time Cell Sorting with Scalable In Situ FPGA-Accelerated Deep Learning
TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Model
Simulation of Nanorobots with Artificial Intelligence and Reinforcement Learning for Advanced Cancer Cell Detection and Tracking
TSBP: Improving Object Detection in Histology Images via Test-time Self-guided Bounding-box Propagation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.