Driving Context into Text-to-Text Privatization
원문 초록
\textit{Metric Differential Privacy} enables text-to-text privatization by adding calibrated noise to the vector of a word derived from an embedding space and projecting this noisy vector back to a discrete vocabulary using a nearest neighbor search. Since words are substituted without context, this mechanism is expected to fall short at finding substitutes for words with ambiguous meanings, such as \textit{'bank'}. To account for these ambiguous words, we leverage a sense embedding and incorporate a sense disambiguation step prior to noise injection. We encompass our modification to the privatization mechanism with an estimation of privacy and utility. For word sense disambiguation on the \textit{Words in Context} dataset, we demonstrate a substantial increase in classification accuracy by $6.05\%$.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc
Fietje: An open, efficient LLM for Dutch
LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses?
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset
PejorativITy: Disambiguating Pejorative Epithets to Improve Misogyny Detection in Italian Tweets
토론
이 논문과 연결된 포럼 글이 아직 없습니다.