AutoNLU: Detecting, root-causing, and fixing NLU model errors
원문 초록
Improving the quality of Natural Language Understanding (NLU) models, and more specifically, task-oriented semantic parsing models, in production is a cumbersome task. In this work, we present a system called AutoNLU, which we designed to scale the NLU quality improvement process. It adds automation to three key steps: detection, attribution, and correction of model errors, i.e., bugs. We detected four times more failed tasks than with random sampling, finding that even a simple active learning sampling method on an uncalibrated model is surprisingly effective for this purpose. The AutoNLU tool empowered linguists to fix ten times more semantic parsing bugs than with prior manual processes, auto-correcting 65% of all identified bugs.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Understanding and Tackling Label Errors in Individual-Level Nature Language Understanding
Near-Polynomially Competitive Active Logistic Regression
Vision Language Action Models in Robotic Manipulation: A Systematic Review
CriticLean: Critic-Guided Reinforcement Learning for Mathematical Formalization
A Survey on Vision-Language-Action Models for Autonomous Driving
Where, What, Why: Towards Explainable Driver Attention Prediction
토론
이 논문과 연결된 포럼 글이 아직 없습니다.