inferhost 0.8.7

Source: Pypi.org· 43451887+amirrouh@users.noreply.github.com· August 7, 2026

Self-hosted, multi-modal AI server for your own GPU: chat/vision LLMs (Qwen, Llama, Gemma, DeepSeek), text-to-speech (Kokoro, OuteTTS), and image generation (SDXL, Flux, Z-Image, Qwen-Image) behind one OpenAI-compatible endpoint. Wraps llama.cpp and stable-di…

This story was reported by Pypi.org. Read the full original article:
Read on Pypi.org

More in Products & Launches

View all