parameter-efficient fine-tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 3
- 보존된 평가 기록
- 10
Parameter-Efficient Fine-Tuning (PEFT) is a technique used to adapt pre-trained models to new tasks with minimal changes to the model's parameters. This approach is particularly useful in scenarios where computational resources are limited or when it is desirable to maintain the original model's performance on the initial task.
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/cloneofsimo/lora
https://github.com/cloudygoose/fewshot_lama
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
https://github.com/cornell-zhang/llm-datatypes
https://github.com/daniel-furman/sft-demos
https://github.com/davisyoshida/lorax
https://github.com/debjitpaul/refiner
https://github.com/dexter-gt-86/sinklora
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
https://github.com/dongping-chen/mixset
https://github.com/dreamboat26/fuzzy-logic
https://github.com/durham/rwkv-finetune-script
https://github.com/erikaawang/probing-multilingual-dynamics
https://github.com/explainableml/delora
Advancing Parameter Efficiency in Fine-tuning via Representation Editing
https://github.com/facebookresearch/large_concept_model
Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation
https://github.com/facebookresearch/pytorch-dp
https://github.com/facico/chinese-vicuna
https://github.com/flagai-open/aquila2
https://github.com/flagalpha/llama2-chinese
https://github.com/flowersteam/lamorel
https://github.com/google-deepmind/thunnini
https://github.com/gt-ripl/selective-projection-decay
https://github.com/h2oai/alpaca-lora
https://github.com/h2oai/h2o-llmstudio
https://github.com/haoychen3/DMIH
Hiding Images in Diffusion Models by Editing Learned Score Functions
https://github.com/heekhero/DTL
https://github.com/hellokevin07/elastictrainer
https://github.com/hitz-zentroa/this-is-not-a-dataset
https://github.com/hiyouga/llama-efficient-tuning
https://github.com/huggingface/text-generation-inference
https://github.com/if001/rwkv-lm-lora-ja
https://github.com/ikergarcia1996/sequence-labeling-llms
https://github.com/internlm/xtuner
https://github.com/ist-daslab/panzamail
RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
https://github.com/ivan-tang-3d/viewrefer3d
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models
https://github.com/jackaduma/Alpaca-LoRA-RLHF-PyTorch
https://github.com/jerrywu-code/susgen
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.