test-finetuned

This model is a fine-tuned version of gpt2 using LoRA (Low-Rank Adaptation).

Model Details

• Base Model: gpt2
• Fine-tuning Method: LoRA (Low-Rank Adaptation)
• Training Framework: PEFT + TRL

Usage

from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel

base_model = AutoModelForCausalLM.from_pretrained("gpt2")
tokenizer = AutoTokenizer.from_pretrained("gpt2")
model = PeftModel.from_pretrained(base_model, "riprayt/test-finetuned")