Is text normalization relevant for classifying medieval charters?
원문 초록
This study examines the impact of historical text normalization on the classification of medieval charters, specifically focusing on document dating and locating. Using a data set of Middle High German charters from a digital archive, we evaluate various classifiers, including traditional and transformer-based models, with and without normalization. Our results indicate that the given normalization minimally improves locating tasks but reduces accuracy for dating, implying that original texts contain crucial features that normalization may obscure. We find that support vector machines and gradient boosting outperform other models, questioning the efficiency of transformers for this use case. Results suggest a selective approach to historical text normalization, emphasizing the significance of preserving some textual characteristics that are critical for classification tasks in document analysis.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Digestion Algorithm in Hierarchical Symbolic Forests: A Fast Text Normalization Algorithm and Semantic Parsing Framework for Specific Scenarios and Lightweight Deployment
VNLP: Turkish NLP Package
Multi-Task Learning for Front-End Text Processing in TTS
Extending Whisper with prompt tuning to target-speaker ASR
Text normalization for low-resource languages: the case of Ligurian
indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages
토론
이 논문과 연결된 포럼 글이 아직 없습니다.