场景
并发16 个模型 · 46 条 run
▸场景说明文本问答-1K · 输入档位 1K · 并发 c1 / c2 / c4 / c8 / c16
| 模型 | 配置数 | TTFT P99 | TPOT P99 | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ▸Qwen3.5-0.8B | 0.8B | 1 | 5599.3 | 647.4 | 80.9 | 221 | 313 | 10.6 | 11.5 | 1.7G | 13.9G | 304K |
| ▸Qwen3.5-2B | 2B | 1 | 2883.7 | 333.4 | 41.7 | 357 | 525 | 21.1 | 22.5 | 4.3G | 16.7G | 365K |
| ▸Qwen3.6-35B-A3B | MoE 35B-A3B | 12 | 1690.3 | 251.1 | 31.4 | 869 | 1242 | 29.4 | 30.2 | 20.4G | 66.8G | 2.7M |
| ▸Qwen3.5-35B-A3B | MoE 35B-A3B | 5 | 1668.5 | 192.9 | 24.1 | 809 | 1498 | 32.9 | 43.0 | 34.2G | 25.4G | 333K |
| ▸Gemma 4 E2B | 2B | 1 | 1339.8 | 155.6 | 19.4 | 1705 | 3354 | 25.4 | 25.4 | 9.2G | 18.3G | 638K |
| ▸Gemma 4 E2B-it | 2B | 1 | 1334.4 | 154.6 | 19.3 | 1720 | 3382 | 25.5 | 25.6 | 9.2G | 18.3G | 641K |
| ▸Qwen3.5-4B | 4B | 1 | 1319.1 | 152.5 | 19.1 | 757 | 1189 | 46.2 | 50.1 | 8.6G | 24.5G | 200K |
| ▸Qwen3.5-9B | 9B | 9 | 764.5 | 103.3 | 12.9 | 690 | 924 | 76.1 | 76.8 | 17.7G | 33.1G | 271K |
| ▸Qwen3-32B | 32B | 1 | 753.7 | 87.2 | 10.9 | 215 | 251 | 90.5 | 90.5 | 19.4G | 45.0G | 369K |
| ▸Qwen3.6-27B | 27B | 1 | 665.8 | 77.0 | 9.6 | 1779 | 2769 | 89.8 | 97.2 | — | — | — |
| ▸DeepSeek-V4-Flash | — | 1 | 481.8 | 56.1 | 7.0 | 7721 | 8367 | 92.5 | 126.4 | — | — | — |
| ▸Gemma 4 E4B-it | 4B | 1 | 477.8 | 55.4 | 6.9 | 5524 | 12488 | 47.8 | 48.1 | 14.6G | 27.5G | 301K |
| ▸Qwen3.6-27B | 27B | 7 | 446.4 | 52.4 | 6.5 | 2901 | 4053 | 107.7 | 136.9 | 28.5G | 35.9G | 293K |
| ▸Qwen3.5-122B-A10B | MoE 122B-A10B | 1 | 430.2 | 49.8 | 6.2 | 6398 | 12091 | 70.4 | 78.9 | — | — | — |
| ▸Qwen3-Next-80B-A3B | MoE 80B-A3B | 1 | 413.8 | 48.0 | 6.0 | 8489 | 16453 | 38.1 | 38.6 | 74.9G | — | 436K |
| ▸Qwen3.5-27B | 27B | 2 | 404.0 | 46.7 | 5.8 | 2966 | 4143 | 147.2 | 160.0 | 28.5G | 76.9G | 314K |