rust-ai-serving-engine 0.1.6
Source: Pypi.org· August 7, 2026
Local GGUF model serving engine (pure-Rust Candle): chat-template generation, token streaming, session cache, and an OpenAI-compatible API with a Python binding.
This story was reported by Pypi.org. Read the full original article:
Read on Pypi.org 
