On Cross-Dataset Generalization in Automatic Detection of Online Abuse
원문 초록
NLP research has attained high performances in abusive language detection as a supervised classification task. While in research settings, training and test datasets are usually obtained from similar data samples, in practice systems are often applied on data that are different from the training set in topic and class distributions. Also, the ambiguity in class definitions inherited in this task aggravates the discrepancies between source and target datasets. We explore the topic bias and the task formulation bias in cross-dataset generalization. We show that the benign examples in the Wikipedia Detox dataset are biased towards platform-specific topics. We identify these examples using unsupervised topic modeling and manual inspection of topics' keywords. Removing these topics increases cross-dataset generalization, without reducing in-domain classification performance. For a robust dataset design, we suggest applying inexpensive unsupervised methods to inspect the collected data and downsize the non-generalizable content before manually annotating for class labels.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Multi-Task Benchmark for Abusive Language Detection in Low-Resource Settings
AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages
An In-Depth Analysis of Adversarial Discriminative Domain Adaptation for Digit Classification
Towards Efficient and Explainable Hate Speech Detection via Model Distillation
KNN-MMD: Cross Domain Wireless Sensing via Local Distribution Alignment
BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.