https://github.com/clin0212/hydralora
공식 코드HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
MU-Bench: A Multitask Multimodal Benchmark for Machine Unlearning
Harnessing the Power of Large Language Model for Uncertainty Aware Graph Processing
Re-Imagining Multimodal Instruction Tuning: A Representation View
IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Models
Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion Forecasting Models
Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Models
UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning
FLoRA: Enhancing Vision-Language Models with Parameter-Efficient Federated Learning
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Privacy-Preserved Automated Scoring using Federated Learning for Educational Research
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
VELoRA: A Low-Rank Adaptation Approach for Efficient RGB-Event based Recognition
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning
Rethinking Few-Shot Adaptation of Vision-Language Models in Two Stages
IncreLoRA: Incremental Parameter Allocation Method for Parameter-Efficient Fine-tuning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.