Papers with Code 아카이브
Continual Pretraining
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 3
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
LLaVA-c: Continual Improved Visual Instruction Tuning
Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation
A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP
Enhance Mobile Agents Thinking Process Via Iterative Preference Learning
Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning
Efficient Domain-adaptive Continual Pretraining for the Process Industry in the German Language
TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them
AfroXLMR-Social: Adapting Pre-trained Language Models for African Languages Social Media Text
Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge
Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study
Demystifying Domain-adaptive Post-training for Financial LLMs
NyayaAnumana & INLegalLlama: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision Analysis
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models
Alchemy: Amplifying Theorem-Proving Capability through Symbolic Mutation
The Construction of Instruction-tuned LLMs for Finance without Instruction Data Using Continual Pretraining and Model Merging
DoPAMine: Domain-specific Pre-training Adaptation from seed-guided data Mining
AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy
LangSAMP: Language-Script Aware Multilingual Pretraining
Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approach
A Practitioner's Guide to Continual Multimodal Pretraining
RedWhale: An Adapted Korean LLM Through Efficient Continual Pretraining
Scaling Granite Code Models to 128K Context
Bilingual Adaptation of Monolingual Foundation Models
70B-parameter large language models in Japanese medical question-answering
Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective
Open Generative Large Language Models for Galician
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM
Towards Lifelong Learning of Large Language Models: A Survey
LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models
Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Cross-sensor self-supervised training and alignment for remote sensing
ChuXin: 1.6B Technical Report
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.