상용 대규모 언어 모델(LLM)은 토큰 단위로 과금·지연·컨텍스트를 제한하는데, 20개 아프리카 언어와 11개 프론티어 토크나이저를 병렬 코퍼스(FLORES-200+)로 측정한 결과 영어보다 토큰화 프리미엄이 항상 발생하며(GPT-5/o200k_base 중앙값 1.88배, N’Ko 최대 8.92배) 추론 비용·지연·유효 컨텍스트 윈도우 손실로 이어진다. Gemma 4가 평균 프리미엄을 3.31배에서 2.38배로 줄이지만 페널티를 없애지는 못하며, afri-fertility 측정 도구·리더보드·완화 가이드를 공개한다.
Large language models (LLMs) are increasingly multilingual, yet open models continue to underperform relative to proprietary systems, with the gap most pronounced for African languages. Continued pre-training (CPT) offers a practical route to language adaptation, but improvements on demanding capabilities such as mathematical reasoning often remain limited. This limitation is driven in part by the uneven domain coverage and missing task-relevant knowledge that characterize many low-resource language corpora. We present \texttt{AfriqueLLM}, a suite of open LLMs adapted to 20 African languages through CPT on 26B tokens. We perform a comprehensive empirical study across five base models spanning sizes and architectures, including Llama 3.1, Gemma 3, and Qwen 3, and systematically analyze how CPT data composition shapes downstream performance. In particular, we vary mixtures that include math, code, and synthetic translated data, and evaluate the resulting models on a range of multilingual benchmarks. Our results identify data composition as the primary driver of CPT gains. Adding math, code, and synthetic translated data yields consistent improvements, including on reasoning-oriented evaluations. Within a fixed architecture, larger models typically improve performance, but architectural choices dominate scale when comparing across model families. Moreover, strong multilingual performance in the base model does not reliably predict post-CPT outcomes; robust architectures coupled with task-aligned data provide a more dependable recipe. Finally, our best models improve long-context performance, including document-level translation. Models and code have been released on [Huggingface](https://huggingface.co/collections/McGill-NLP/afriquellm) and [Github](https://github.com/McGill-NLP/AfriqueLLM).