schmitech/orbit

<div align="center"> <a href="https://github.com/schmitech/orbit"> <img src="https://github.com/user-attachments/assets/b185730e-039d-4b9c-b953-858e9ad8e945" alt="ORBIT Logo" width="300"/> </a>

ORBIT

Open Retrieval-Based Inference Toolkit

Self-hosted, private AI gateway and unified RAG infrastructure for multi-model applications.

</div> <p align="center"> <a href="https://opensource.org/licenses/Apache-2.0"><img src="https://img.shields.io/badge/License-Apache_2.0-blue.svg?style=flat-square" alt="License"></a> <a href="https://www.python.org/downloads/"><img src="https://img.shields.io/badge/Python-3.12+-blue.svg?style=flat-square&logo=python&logoColor=white" alt="Python"></a> <a href="https://github.com/schmitech/orbit/releases"><img src="https://img.shields.io/github/v/release/schmitech/orbit?style=flat-square" alt="Latest Release"></a> <a href="https://github.com/schmitech/orbit/commits/main"><img src="https://img.shields.io/github/last-commit/schmitech/orbit?style=flat-square" alt="Last Commit"></a> <a href="https://github.com/schmitech/orbit/stargazers"><img src="https://img.shields.io/github/stars/schmitech/orbit?style=social&label=Star" alt="GitHub Stars"></a> </p> <p align="center"> <a href="docs/tutorial.md"><strong>Quick Tutorial</strong></a> &nbsp;•&nbsp; <a href="docker/README.md"><strong>Docker Guide</strong></a> &nbsp;•&nbsp; <a href="docs/cookbook/"><strong>Cookbook Recipes</strong></a> &nbsp;•&nbsp; <a href="docs/"><strong>Full Documentation</strong></a> </p> <p align="center"> Maintained by <a href="https://www.linkedin.com/in/remsy/"><strong>Remsy Schmilinsky</strong></a> </p>

---

💡 What is ORBIT?

Many organizations need to connect AI to their business data without:

1. Sending sensitive data to third-party SaaS vendors or cloud providers.
2. Rewriting frontend applications every time they switch LLMs.
3. Maintaining fragile glue code between models, vector databases, SQL query engines, a