Papers with Code 아카이브
parameter-efficient fine-tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 10
Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Gradient Inversion Attacks on Parameter-Efficient Fine-Tuning
Matching Markets Meet LLMs: Algorithmic Reasoning with Ranked Preferences
WeightLoRA: Keep Only Necessary Adapters
Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian Laws
Uni-LoRA: One Vector is All You Need
LoRA as a Flexible Framework for Securing Large Vision Systems
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection
On Fairness of Task Arithmetic: The Role of Task Vectors
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning
MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
Weight Spectra Induced Efficient Model Adaptation
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics
DA-VPT: Semantic-Guided Visual Prompt Tuning for Vision Transformers
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
Boosting Domain Incremental Learning: Selecting the Optimal Parameters is All You Need
Noise-Robustness Through Noise: Asymmetric LoRA Adaption with Poisoning Expert
Zero-Shot Adaptation of Parameter-Efficient Fine-Tuning in Diffusion Models
InfoSAM: Fine-Tuning the Segment Anything Model from An Information-Theoretic Perspective
LoKI: Low-damage Knowledge Implanting of Large Language Models
Train with Perturbation, Infer after Merging: A Two-Stage Framework for Continual Learning
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
Permissioned LLMs: Enforcing Access Control in Large Language Models
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning
DLP: Dynamic Layerwise Pruning in Large Language Models
UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter-Efficient Fine-Tuning of Large Models
Parameter-Efficient Fine-Tuning with Column Space Projection
Universal Reasoner: A Single, Composable Plug-and-Play Reasoner for Frozen LLMs
Optimization-Inspired Few-Shot Adaptation for Large Language Models
CLaDMoP: Learning Transferrable Models from Successful Clinical Trials via LLMs
AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
Activation Control for Efficiently Eliciting Long Chain-of-thought Ability of Language Models
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval
Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.