SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding
원문 초록
This paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification task aimed at identifying whether a sentence contains an idiomatic expression, and (b) a task based on semantic text similarity which requires the model to adequately represent potentially idiomatic expressions in context. Each subtask includes different settings regarding the amount of training data. Besides the task description, this paper introduces the datasets in English, Portuguese, and Galician and their annotation procedure, the evaluation metrics, and a summary of the participant systems and their results. The task had close to 100 registered participants organised into twenty five teams making over 650 and 150 submissions in the practice and evaluation phases respectively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
Information Leakage of Sentence Embeddings via Generative Embedding Inversion Attacks
Intrinsic vs. Extrinsic Evaluation of Czech Sentence Embeddings: Semantic Relevance Doesn't Help with MT Evaluation
Factors affecting the in-context learning abilities of LLMs for dialogue state tracking
Mechanistic Decomposition of Sentence Representations
Rethinking the Understanding Ability across LLMs through Mutual Information
토론
이 논문과 연결된 포럼 글이 아직 없습니다.