Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s
2 days ago · Hacker News
Global
& newspaper;
Read Full Article →
Sourced From
Hacker News
I built slotstream, a way to run Qwen3.8-Flash-Next 4-bit on a low-memory mac starting from 16GB, a 125B parameter model that would need 100GB+ memory/RAM, thanks to expert-offloading/ssd-streaming. Easy to install/update, and mac-native using MLX an…
Source: Hacker News — Read full article →
Content sourced from third parties. Copyright belongs to original publishers.
Source: Hacker News — Read full article at source →
Content sourced from third parties. Copyright belongs to original publishers. Only excerpt and link are stored under fair use.