https://github.com/google-research/electra
공식 코드ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.
Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
BAM! Born-Again Multi-Task Networks for Natural Language Understanding
Mention Memory: incorporating textual knowledge into Transformers through entity mention attention
TableFormer: Robust Transformer Modeling for Table-Text Encoding
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation
An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference
Towards preserving word order importance through Forced Invalidation
Encoder-Agnostic Adaptation for Conditional Language Generation
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding
How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets
Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging
Doctor XAvIer: Explainable Diagnosis on Physician-Patient Dialogues and XAI Evaluation
Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data
Exophoric Pronoun Resolution in Dialogues with Topic Regularization
Bot or Human? Detecting ChatGPT Imposters with A Single Question
Training Multilingual Pre-trained Language Model with Byte-level Subwords
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order
TinyBERT: Distilling BERT for Natural Language Understanding
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation
ViDeBERTa: A powerful pre-trained language model for Vietnamese
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.