Janas: Run LLMs larger than RAM by streaming experts from SSD

37 tok/s from Qwen3-Next-80B (a 48 GB model) on a laptop with 32 GB of memory, 24 without drafts, where llama.cpp manages 2.8; reading a prompt, 62 tok/s against 16. Janas-LLM was faster than llama.cp

事件进展（1 篇报道）

1. 2026-10-13 06:05
   Hacker News Janas: Run LLMs larger than RAM by streaming experts from SSD

← 返回首页