Instructions to use DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1")
model = AutoModelForCausalLM.from_pretrained("DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1

SGLang

How to use DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1 with Docker Model Runner:
```
docker model run hf.co/DebateLabKIT/Phi-4-Argunaut-1-SFT-dev1
```

ggbetz commited on Aug 3, 2025

Commit

b83feef

verified ·

1 Parent(s): e27c76d

Training in progress, step 3850

Browse files

Files changed (8) hide show

README.md +2 -2
model-00001-of-00006.safetensors +1 -1
model-00002-of-00006.safetensors +1 -1
model-00003-of-00006.safetensors +1 -1
model-00004-of-00006.safetensors +1 -1
model-00005-of-00006.safetensors +1 -1
model-00006-of-00006.safetensors +1 -1
training_args.bin +1 -1

README.md CHANGED Viewed

@@ -4,8 +4,8 @@ library_name: transformers
 model_name: Phi-4-Argunaut-1-SFT-dev1
 tags:
 - generated_from_trainer
-- trl
 - sft
 licence: license
 ---
@@ -27,7 +27,7 @@ print(output["generated_text"])
 ## Training procedure
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/ggbetz/argunauts-training/runs/fty4u6p2)
 This model was trained with SFT.

 model_name: Phi-4-Argunaut-1-SFT-dev1
 tags:
 - generated_from_trainer
 - sft
+- trl
 licence: license
 ---
 ## Training procedure
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/ggbetz/argunauts-training/runs/4wfukxy1)
 This model was trained with SFT.

model-00001-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4b015fa5a8ab77a92b61db88f9865d0a867e5cba548cd157b605c180777a1fcc
 size 4933658528

 version https://git-lfs.github.com/spec/v1
+oid sha256:7c30a238f860bae24c819ea55c17d57dc857d43e4114b71f7b0e55179384c0e8
 size 4933658528

model-00002-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3acdc3ad688b56e991b51b64fa2711217e44230eb5865c17bb089078df2838f8
 size 4954693112

 version https://git-lfs.github.com/spec/v1
+oid sha256:3c679b76dc45d655716e90d3cd55bf2440b47bf60d551c44890377ef2717e599
 size 4954693112

model-00003-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:da9564bb14da3eeee60ec9a287e27adfeada531021ac54e192266b839a92c6fd
 size 4902243992

 version https://git-lfs.github.com/spec/v1
+oid sha256:aadd8aa627d47896678b212c89b825b633706149a212b6969f9123efe45bc050
 size 4902243992

model-00004-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e84f059a81e9b27d3fa7f9ed07266164ff02b6c0832e86f1b562a2f69d7838cb
 size 4954672440

 version https://git-lfs.github.com/spec/v1
+oid sha256:d2672f16924f136830f2f53e76acea59ee2155f3ef791365c345f5ad1fe8ea70
 size 4954672440

model-00005-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:431f81cfb26bdbab17cf0b288c90e90af875ac6e5a1a835e537e0d0a728c774a
 size 4954672432

 version https://git-lfs.github.com/spec/v1
+oid sha256:e197fc5249c8863f0a5872f0912e18fc6f5d1483537163b4b8ae2d3058ecf1be
 size 4954672432

model-00006-of-00006.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f192eeea1ce695dcf7630c57b363e5d9f2ab40afb902eaaf8c7d0895de703379
 size 4619116224

 version https://git-lfs.github.com/spec/v1
+oid sha256:2f4b15452266baffa43ac8b5221ddf5a0a5198ece89d8bf3b5c1015de8210337
 size 4619116224

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6f5267be219f16a52ae7f37e2a355ed6a502e772607cb414dae048cfbf67692e
 size 7096

 version https://git-lfs.github.com/spec/v1
+oid sha256:8ca7910d5c8ad29347a372060ae589805c7adad0b9ada1a2b673017209bd0bcf
 size 7096