TCBERT: A Technical Report for Chinese Topic Classification BERT
원문 초록
Bidirectional Encoder Representations from Transformers or BERT~\cite{devlin-etal-2019-bert} has been one of the base models for various NLP tasks due to its remarkable performance. Variants customized for different languages and tasks are proposed to further improve the performance. In this work, we investigate supervised continued pre-training~\cite{gururangan-etal-2020-dont} on BERT for Chinese topic classification task. Specifically, we incorporate prompt-based learning and contrastive learning into the pre-training. To adapt to the task of Chinese topic classification, we collect around 2.1M Chinese data spanning various topics. The pre-trained Chinese Topic Classification BERTs (TCBERTs) with different parameter sizes are open-sourced at \url{https://huggingface.co/IDEA-CCNL}.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Evaluating Large Language Models for Phishing Detection, Self-Consistency, Faithfulness, and Explainability
QuickCharNet: An Efficient URL Classification Framework for Enhanced Search Engine Optimization
Multiview Contrastive Learning for Unsupervised Domain Adaptation in Brain–Computer Interfaces
Open-World Social Event Classification
Topic Classification from Text Using Decision Tree, K-NN and Multinomial Naïve Bayes
Efficient Calisthenics Skills Classification through Foreground Instance Selection and Depth Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.