Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governance
원문 초록
Calls for engagement with the public in Artificial Intelligence (AI) research, development, and governance are increasing, leading to the use of surveys to capture people's values, perceptions, and experiences related to AI. In this paper, we critically examine the state of human participant surveys associated with these topics. Through both a reflexive analysis of a survey pilot spanning six countries and a systematic literature review of 44 papers featuring public surveys related to AI, we explore prominent perspectives and methodological nuances associated with surveys to date. We find that public surveys on AI topics are vulnerable to specific Western knowledge, values, and assumptions in their design, including in their positioning of ethical concepts and societal values, lack sufficient critical discourse surrounding deployment strategies, and demonstrate inconsistent forms of transparency in their reporting. Based on our findings, we distill provocations and heuristic questions for our community, to recognize the limitations of surveys for meeting the goals of engagement, and to cultivate shared principles to design, deploy, and interpret surveys cautiously and responsibly.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Generative AI and Creativity: A Systematic Literature Review and Meta-Analysis
Explicit and Implicit Representations in AI-based 3D Reconstruction for Radiology: A Systematic Review
AI-driven Personalized Privacy Assistants: a Systematic Literature Review
Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review
Online Continual Learning: A Systematic Literature Review of Approaches, Challenges, and Benchmarks
Large Language Models in Computer Science Education: A Systematic Literature Review
토론
이 논문과 연결된 포럼 글이 아직 없습니다.