Learning Phonotactics from Linguistic Informants
원문 초록
We propose an interactive approach to language learning that utilizes linguistic acceptability judgments from an informant (a competent language user) to learn a grammar. Given a grammar formalism and a framework for synthesizing data, our model iteratively selects or synthesizes a data-point according to one of a range of information-theoretic policies, asks the informant for a binary judgment, and updates its own parameters in preparation for the next query. We demonstrate the effectiveness of our model in the domain of phonotactics, the rules governing what kinds of sound-sequences are acceptable in a language, and carry out two experiments, one with typologically-natural linguistic data and another with a range of procedurally-generated languages. We find that the information-theoretic policies that our model uses to select items to query the informant achieve sample efficiency comparable to, and sometimes greater than, fully supervised approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Fietje: An open, efficient LLM for Dutch
MELA: Multilingual Evaluation of Linguistic Acceptability
JCoLA: Japanese Corpus of Linguistic Acceptability
NoCoLA: The Norwegian Corpus of Linguistic Acceptability
CUE: An Uncertainty Interpretation Framework for Text Classifiers Built on Pre-Trained Language Models
LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.