Production inference for encoder models with vLLM plugins.
colbert, colpali, GLiNER, GLiNER2 etc. — github.com/ddickmann/vllm-factory
Dennis PRO
doubledsbv
AI & ML interests
None yet
Recent Activity
updated a model 1 day ago
latence/granite-4.1-guardian-W8A16 published a model 1 day ago
latence/granite-4.1-guardian-W8A16 updated a model 9 days ago
latence/privacy-filter-GLiNER-v0.1Organizations
models 25
doubledsbv/vllm-wheel
Updated
doubledsbv/latenceai-wheels
Updated
doubledsbv/docint-ocr-error
0.1B • Updated • 4
doubledsbv/KafkaLM-15B-GRPO_LoRA_Exp
Updated
doubledsbv/Llama-4-Scout-17B-16E-Text
Text Generation • 108B • Updated • 4
doubledsbv/KafkaLM-Llama-3.1-6B-NoDistil
Text Generation • 6B • Updated • 5
doubledsbv/KafkaLM-15B-NoDistil
Text Generation • 16B • Updated • 6
doubledsbv/Llama-3.1-8B-2of4-NO-KL
Updated
doubledsbv/Llama-3.1-70B-2of4-NO-KL
Updated
doubledsbv/Llama-3.1-405B-16of64
Updated
datasets 11
doubledsbv/pii_synthetic
Viewer • Updated • 900k • 5 • 1
doubledsbv/classifier_raw_hf
Viewer • Updated • 20.3M • 22
doubledsbv/router_GRPO
Viewer • Updated • 1.68M • 11
doubledsbv/test_sft
Viewer • Updated • 40.4k • 7
doubledsbv/kd_sample
Viewer • Updated • 10k • 11
doubledsbv/kafka_dpo_v2
Viewer • Updated • 59.9k • 13
doubledsbv/kafka_sft_refined
Viewer • Updated • 612k • 19
doubledsbv/wiki_ger_RAG_v0.1_2024_05_04
Viewer • Updated • 12.2k • 2
doubledsbv/booksum_ger_RAG_v0.1_2024_05_04
Viewer • Updated • 8.54k • 3
doubledsbv/llama-3-dataset
Viewer • Updated • 550k • 16