#####   ######  #####    ###    #   #  ###  #   #  ######
##  ##  ##      ##  ##  ## ##   #   #   #   #   #  ##
#####   ####    #####   #   #   #   #   #   #   #  ####
##  #   ##      ##      ## ##    # #    #    # #   ##
##   #  ######  ##       ###      #    ###    #    ######

$ curl repovive.com/roadmaps/llm-fine-tuning/fine-tuning-tools-frameworks/peft-library

░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░██████████████████████████████████████████████████████████████████████████████████████

#####   ######  #####    ###    #   #  ###  #   #  ######
##  ##  ##      ##  ##  ## ##   #   #   #   #   #  ##
#####   ####    #####   #   #   #   #   #   #   #  ####
##  #   ##      ##      ## ##    # #    #    # #   ##
##   #  ######  ##       ###      #    ###    #    ######

$ curl repovive.com/roadmaps/llm-fine-tuning/fine-tuning-tools-frameworks/peft-library

Repovive

PEFT Library - Fine-Tuning Tools & Frameworks | LLM Fine-Tuning | Repovive

Repovive.

LLM Fine-Tuning10 sections · 313 units1h total

Open in Course

PEFT Library

PEFT implements parameter-efficient methods:

from peft import LoraConfig, get_peft_model
config = LoraConfig(r=16, lora_alpha=32, target_modules=["q_proj", "v_proj"])
model = get_peft_model(model, config)

LoRA, QLoRA, DoRA, adapters, prefix tuning, and more. All work with the same interface. Switching methods is a config change.