NewstaR/Dauntic
Viewer • Updated • 1k • 16
How to use NewstaR/CNC-7b-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("bn22/Mistral-7B-Instruct-v0.1-sharded")
model = PeftModel.from_pretrained(base_model, "NewstaR/CNC-7b-lora")CNC-7b is a lora adapter for Mistral-7b (Instruct) intended to be clear, concise, and helpful in short text conversations. It is designed for conversational agents and assistants.
CNC-7b was trained on synthetic conversational data generated by Newstar using ChatGPT. The data was shaped using custom instructions to encourage clear, concise, and helpful responses.
CNC-7b was evaluated on a test set of human-human conversations to measure whether responses were clear, concise, and on-topic.
Base model
mistralai/Mistral-7B-v0.1