宋小猫

SongXiaoMao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated 2 days ago

使用VLLM启动会报错

#3 opened 2 days ago by

SongXiaoMao

New activity in Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled 4 days ago

Tokenizer class TokenizersBackend does not exist in vllm v0.17.1

11

#26 opened 9 days ago by

putcn

New activity in Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled 4 days ago

How does the VLLM start this model?

#4 opened 4 days ago by

SongXiaoMao

New activity in huihui-ai/Huihui-Qwen3.5-122B-A10B-abliterated-GGUF 10 days ago

Can you make a quantitative model? Qwen3.5-122B-A10B-GPTQ-Int4

#2 opened 10 days ago by

SongXiaoMao

New activity in Qwen/QwQ-32B about 1 year ago

When will you fix the model replies missing</think>\n start tags

18

#19 opened about 1 year ago by

xldistance

When answering questions in Chinese, the model frequently terminates prematurely (outputs the end token). Is this a common problem?

1

#40 opened about 1 year ago by

zhangw355

missing opening <think>

20

#4 opened about 1 year ago by

chriswritescode

New activity in Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ about 1 year ago

AWQ q6

1

#1 opened about 1 year ago by

D-r-e

New activity in unsloth/DeepSeek-R1-GGUF about 1 year ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

9

#24 opened about 1 year ago by

SongXiaoMao

No think tokens visible

6

#15 opened about 1 year ago by

sudkamath

New activity in Tiiny/SmallThinker-3B-Preview about 1 year ago

How to Pair with Larger Models

4

#7 opened about 1 year ago by

windkkk

New activity in Qwen/QwQ-32B-Preview over 1 year ago

multi GPU inferencing

2

#18 opened over 1 year ago by

cjj2003

Use sample code to start error reporting

1

#45 opened over 1 year ago by

SongXiaoMao

vllm reply garbled

3

#29 opened over 1 year ago by

SongXiaoMao

vllm has problems running this model

3

#46 opened over 1 year ago by

SongXiaoMao

Can you officially support VLLM?

1

#48 opened over 1 year ago by

SongXiaoMao

New activity in TechxGenus/Mistral-Large-Instruct-2407-AWQ over 1 year ago

The model can be started using vllm, but no dialogue is possible.

3

#2 opened over 1 year ago by

SongXiaoMao