README.md

---
license: agpl-3.0
library_name: collectorvision
tags:
- onnx
- object-detection
- card-detection
- mobilevit
base_model: apple/mobilevit-xx-small
---

# Cornelius — CCG Card Corner Detector

MobileViT-XXS backbone with a SimCC coordinate classification head, trained to locate the four corners of a CCG card (Magic: The Gathering, Pokémon, etc.) in a photograph or video frame.

## Model details

| Property | Value |
|---|---|
| Architecture | MobileViT-XXS + SimCC head |
| Input | 384×384 RGB, ImageNet-normalised |
| Outputs | corners (8 floats, normalised [0,1]), presence logit, sharpness scalar |
| Parameters | ~1.82M |
| File size | 8.6 MB (fp32 ONNX) |
| Codename | cornelius |
| Version | 1.0.0 (epoch 45) |

## Outputs

- **corners** — 8 floats `[x0,y0, x1,y1, x2,y2, x3,y3]` in TL→TR→BR→BL order, normalised [0,1]
- **presence** — raw logit; unreliable on blank images, prefer the sharpness gate
- **sharpness** — mean peak of the 8 SimCC softmax distributions; blank frames ≈ 0.008, valid cards ≈ 0.03–0.07

## Usage

The easiest way to use Cornelius is through the [CollectorVision](https://github.com/HanClinto/CollectorVision) library, which wires it into a full detect → dewarp → embed → identify pipeline:

```python
import collector_vision as cvg

cvid = cvg.Identifier(cvg.HFD("HanClinto/milo", "scryfall-mtg"))
result = cvid.identify("photo.jpg")
print(result.ids)  # {"scryfall_id": "..."}
```

### Direct ONNX usage

```python
import onnxruntime as ort
import numpy as np
from PIL import Image

session = ort.InferenceSession("model.onnx")

# Preprocess: resize to 384×384, ImageNet normalise, NCHW float32
img = Image.open("photo.jpg").convert("RGB").resize((384, 384))
x = np.array(img, dtype=np.float32) / 255.0
x = (x - [0.485, 0.456, 0.406]) / [0.229, 0.224, 0.225]
x = x.transpose(2, 0, 1)[None]  # (1, 3, 384, 384)

corners, presence, sharpness = session.run(None, {"pixel_values": x})
# corners: (1, 8) — x0,y0,x1,y1,x2,y2,x3,y3 normalised [0,1], TL→TR→BR→BL
# presence: (1, 1) — raw logit
# sharpness: (1, 1) — use > 0.02 as a card-present gate

if sharpness[0, 0] > 0.02:
    pts = corners[0].reshape(4, 2)  # (4, 2) normalised corners
```

## Part of CollectorVision

Used together with [HanClinto/milo](https://huggingface.co/HanClinto/milo) in the [CollectorVision](https://github.com/HanClinto/CollectorVision) inference library.