arXiv:2201.06907
Improve Sentence Alignment by Divide-and-conquer
원문 초록
In this paper, we introduce a divide-and-conquer algorithm to improve sentence alignment speed. We utilize external bilingual sentence embeddings to find accurate hard delimiters for the parallel texts to be aligned. We use Monte Carlo simulation to show experimentally that using this divide-and-conquer algorithm, we can turn any quadratic time complexity sentence alignment algorithm into an algorithm with average time complexity of O(NlogN). On a standard OCR-generated dataset, our method improves the Bleualign baseline by 3 F1 points. Besides, when computational resources are restricted, our algorithm is faster than Vecalign in practice.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LLMs Are Not Scorers: Rethinking MT Evaluation with Generation-Based Methods
Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
Sentence Embeddings as an intermediate target in end-to-end summarisation
JTCSE: Joint Tensor-Modulus Constraints and Cross-Attention for Unsupervised Contrastive Learning of Sentence Embeddings
Information Leakage of Sentence Embeddings via Generative Embedding Inversion Attacks
From Neurons to Semantics: Evaluating Cross-Linguistic Alignment Capabilities of Large Language Models via Neurons Alignment
토론
이 논문과 연결된 포럼 글이 아직 없습니다.