A self-hosted AI platform — inference, tool use, browser automation, image generation, speech synthesis, transcription, object storage, agentic code execution, and more — behind a single OpenAI-compatible endpoint. One docker-compose up.
README
A self-hosted AI platform. One docker-compose up.
Everything an AI-powered workflow needs — inference, tool use, browser automation, image generation, speech synthesis, transcription, object storage, agentic code execution, web search, an email gateway, a Telegram client, time-series forecasting, an async job queue, and a web UI — behind a single OpenAI-compatible endpoint at http://localhost:4000. Point any existing client at it and it works.
Models across multiple providers. Six providers offer free tiers (Groq, Cerebras, OpenRouter, HuggingFace, Mistral, Cohere) — but "free" means rate-limited and capped, not unlimited. See free-tier reality check for exact RPM/RPD/monthly caps before relying on a tier. Local providers run on your own hardware — CPU or NVIDIA GPU — with no network calls, no rate limits, and no usage costs (Ollama, talkies for ASR+TTS, vllm-wrap for text LLMs+embeddings, llamacpp-wrap for vision-VLMs incl. Surya OCR 2, stable-diffusion.cpp CPU, stable-diffusion.cpp CUDA, audiolla for audio production, predictalot for time-series forecasting). The gateway burns through providers in priority order and falls back automatically when one rate-limits or fails, so you're never paying for tokens you could have gotten free.
MCP tools across multiple servers. Any model with function calling can invoke them autonomously — the model orchestrates, you just prompt.