https://github.com/jl-er/rwkv-peft
Balancing LoRA Performance and Efficiency with Simple Shard Sharing
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Balancing LoRA Performance and Efficiency with Simple Shard Sharing
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Explicit Visual Prompting for Universal Foreground Segmentations
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.