RTX5060Ti跑Qwen3提速

Reddit用户开源 garlic-inference，称通过自定义CUDA/C++在16GB显存的RTX 5060 Ti上以FP8运行Qwen3-30B-A3B，速度达50-54 tok/s。其表示相比llama.cpp约33-34 tok/s提升约50%，展示消费级显卡本地推理的优化空间。

事件进展（2 篇报道）

1. 2026-07-11 16:29
   Reddit r/LocalLLaMA Running Qwen3 30B A3B at 50 tok/s on RTX 5060 Ti
2. 2026-07-12 04:28
   Reddit r/LocalLLaMA I benched quad 5060Tis for code generation with Qwen3.6-27B so you don't have to (it's really good)

← 返回首页