Bayesian Methods for Semi-supervised Text Annotation
원문 초록
Human annotations are an important source of information in the development of natural language understanding approaches. As under the pressure of productivity annotators can assign different labels to a given text, the quality of produced annotations frequently varies. This is especially the case if decisions are difficult, with high cognitive load, requires awareness of broader context, or careful consideration of background knowledge. To alleviate the problem, we propose two semi-supervised methods to guide the annotation process: a Bayesian deep learning model and a Bayesian ensemble method. Using a Bayesian deep learning method, we can discover annotations that cannot be trusted and might require reannotation. A recently proposed Bayesian ensemble method helps us to combine the annotators' labels with predictions of trained models. According to the results obtained from three hate speech detection experiments, the proposed Bayesian methods can improve the annotations and prediction performance of BERT models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Vision Language Action Models in Robotic Manipulation: A Systematic Review
EduCoder: An Open-Source Annotation System for Education Transcript Data
A Survey on Vision-Language-Action Models for Autonomous Driving
Probably Approximately Correct Labels
Dialect Normalization using Large Language Models and Morphological Rules
EdgeProfiler: A Fast Profiling Framework for Lightweight LLMs on Edge Using Analytical Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.