L20实测Qwen3.8-27B
直接上结果，体感非常快，相比deepseek-v4-flash
| 并发 | 成功/请求 | 错误 | 总tok/s | 输出tok/s | TTFT中位/P95 | 延迟中位/P95 | >60s | >100s |
|---|---|---|---|---|---|---|---|---|
| 32 | 64/64 | 0 | 3840.4 | 1045.1 | 546/1459 ms | 31.4/32.3 s | 0 | 0 |
| 64 | 128/128 | 0 | 5857.2 | 1594.0 | 724/9810 ms | 44.9/52.1 s | 0 | 0 |
| 96 | 192/192 | 0 | 6892.3 | 1875.6 | 6366/14493 ms | 63.9/71.7 s | 113 | 0 |
| 128 | 256/256 | 0 | 7651.0 | 2082.1 | 5337/16152 ms | 76.7/83.5 s | 249 | 0 |
| 160 | 320/320 | 0 | 7591.1 | 2065.8 | 7659/88537 ms | 87.1/157.6 s | 316 | 87 |
| 192 | 384/384 | 0 | 7121.4 | 1938.0 | 21531/110332 ms | 88.6/177.7 s | 384 | 183 |