GenAI – What Is Hugging Face PEFT ?
Table Of Contents:
- What Is Hugging Face PEFT ?
- What Is PEFT ?
- Features of Hugging Face PEFT .
- Example: Using LoRA via Hugging Face PEFT
- Supported Techniques in PEFT Library
(1) What Is Hugging Face PEFT ?
(2) What Is PEFT ?
(3) Features Of Hugging Face PEFT .
(4) Example: Using LoRA via Hugging Face PEFT
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import get_peft_model, LoraConfig, TaskType
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-hf")
# Define LoRA configuration
lora_config = LoraConfig(
r=8,
lora_alpha=16,
target_modules=["q_proj", "v_proj"],
lora_dropout=0.05,
task_type=TaskType.CAUSAL_LM
)
# Apply PEFT using LoRA
model = get_peft_model(model, lora_config)
(5) Supported Techniques in PEFT Library
(6) Install Hugging Face PEFT
pip install peft
(7) How To Fine tune the close source llm models like gpt, claude, gemini ,titan
