hanyeol/model-compose

<div align="center">

한국어 | 中文

</div>

---

model-compose

Deploy production-ready AI services in minutes.

One YAML file. Any model. Any protocol. Any runtime. Build chat APIs, RAG pipelines, autonomous agents, and MCP servers without writing application code — then deploy the same file anywhere, like docker-compose.

AI systems should not be locked into a single provider, runtime, or cloud. model-compose is built on four principles:

• Composable — Models, agents, workflows, tools, memory, and protocols are interchangeable building blocks.
• Portable — Define your AI system once, deploy anywhere without re-engineering.
• Hybrid-First — Bridge cloud APIs and local models on your own terms.
• Stream-Native — Data flows through workflows as it arrives — tokens, audio, frames, and events as first-class values.

<div align="center">

Quick Start · What You Can Build · Documentation · Examples

</div>

---

Quick Start

Install with uv:

uv pip install model-compose

Or with pip:

pip install model-compose

Create model-compose.yml:

controller:
  adapter:
    type: http-server
    port: 8080
  webui:
    port: 8081

workflow:
  job:
    component: chatgpt
    input:
      prompt