Show HN: RunNburn – Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop

Source: Github.com· coderredlab· July 30, 2026
Show HN: RunNburn – Run a 295B Moe from a 98GB GGUF on a 64GB RAM Desktop

runNburn is an Apache-2.0 Rust inference engine for quantized GGUF models that are too big for your fast memory.The core idea: weights stay file-backed (mmap), host residency stays under an explicit byte budget (--ram-budget), and GPU caches are sized from de…

This story was reported by Github.com. Read the full original article:
Read on Github.com

More in Products & Launches

View all