https://github.com/optsuite/LOZO
공식 코드Enhancing Zeroth-order Fine-tuning for Language Models with Low-rank Structures
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Enhancing Zeroth-order Fine-tuning for Language Models with Low-rank Structures
Label Privacy in Split Learning for Large Models with Parameter-Efficient Training
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks
Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report
Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning
Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarios
Learning to Route Among Specialized Experts for Zero-Shot Generalization
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks
MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling
MemControl: Mitigating Memorization in Diffusion Models via Automated Parameter Selection
KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting
Less Could Be Better: Parameter-efficient Fine-tuning Advances Medical Vision Foundation Models
APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Training
RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models
Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.