ICON$^2$: Reliably Benchmarking Predictive Inequity in Object Detection
원문 초록
As computer vision systems are being increasingly deployed at scale in high-stakes applications like autonomous driving, concerns about social bias in these systems are rising. Analysis of fairness in real-world vision systems, such as object detection in driving scenes, has been limited to observing predictive inequity across attributes such as pedestrian skin tone, and lacks a consistent methodology to disentangle the role of confounding variables e.g. does my model perform worse for a certain skin tone, or are such scenes in my dataset more challenging due to occlusion and crowds? In this work, we introduce ICON$^2$, a framework for robustly answering this question. ICON$^2$ leverages prior knowledge on the deficiencies of object detection systems to identify performance discrepancies across sub-populations, compute correlations between these potential confounders and a given sensitive attribute, and control for the most likely confounders to obtain a more reliable estimate of model bias. Using our approach, we conduct an in-depth study on the performance of object detection with respect to income from the BDD100K driving dataset, revealing useful insights.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
FeDa4Fair: Client-Level Federated Datasets for Fairness Evaluation
Ref-Long: Benchmarking the Long-context Referencing Capability of Long-context Language Models
IndianBailJudgments-1200: A Multi-Attribute Dataset for Legal NLP on Indian Bail Orders
Point Cloud Compression and Objective Quality Assessment: A Survey
DuET: Dual Incremental Object Detection via Exemplar-Free Task Arithmetic
Low-Density 3D Point Cloud Classification
토론
이 논문과 연결된 포럼 글이 아직 없습니다.