arXiv:2104.06439
공식 코드 · Papers with Code
Zhestyatsky at SemEval-2021 Task 2: ReLU over Cosine Similarity for BERT Fine-tuning
원문 초록
This paper presents our contribution to SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation (MCL-WiC). Our experiments cover English (EN-EN) sub-track from the multilingual setting of the task. We experiment with several pre-trained language models and investigate an impact of different top-layers on fine-tuning. We find the combination of Cosine Similarity and ReLU activation leading to the most effective fine-tuning procedure. Our best model results in accuracy 92.7%, which is the fourth-best score in EN-EN sub-track.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Prompt Tuning Vision Language Models with Margin Regularizer for Few-Shot Learning under Distribution Shifts
LLM-BABYBENCH: Understanding and Evaluating Grounded Planning and Reasoning in LLMs
1$^{st}$ Place Solution of WWW 2025 EReL@MIR Workshop Multimodal CTR Prediction Challenge
Feature Fusion Revisited: Multimodal CTR Prediction for MMCTR Challenge
Quadratic Interest Network for Multimodal Click-Through Rate Prediction
FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.