Show HN: A minimalist proxy for your local LLM cluster (~1100 lines)
Hi all!I made this small proxy when I built a small GPU cluster at home and wanted to share it with friends while keeping speed limits and token accounting.I also put a lot of effort in making it work as quick as possible, and IMO the result is worth sharing!…



