raullenchai/Rapid-MLX

<img width="1600" height="800" alt="banner" src="https://github.com/user-attachments/assets/f3743bb7-7287-4b24-ac97-a7037974396f" /> <p align="center"> <h1 align="center">Rapid-MLX</h1> <p align="center"> <strong>Run AI on your Mac. Faster than anything else.</strong> </p> <p align="center"> <a href="LICENSE"><img src="https://img.shields.io/badge/License-Apache_2.0-blue.svg" alt="License"></a> <a href="https://www.python.org/downloads/"><img src="https://img.shields.io/badge/python-3.10+-blue.svg" alt="Python 3.10+"></a> <a href="tests/"><img src="https://img.shields.io/badge/tests-3300%2B-brightgreen.svg" alt="Tests"></a> <a href="https://support.apple.com/en-us/HT211814"><img src="https://img.shields.io/badge/Apple_Silicon-M1%20|%20M2%20|%20M3%20|%20M4-black.svg?logo=apple" alt="Apple Silicon"></a> <a href="https://github.com/raullenchai/Rapid-MLX/stargazers"><img src="https://img.shields.io/github/stars/raullenchai/Rapid-MLX?style=social" alt="GitHub stars"></a> </p> <p align="center"> Run local AI models on your Mac — no cloud, no API costs. Works with Cursor, Claude Code, and any OpenAI-compatible app. </p> <p align="center"> _{<a href="https://rapidmlx.com"><b>rapidmlx.com</b></a> · <a href="https://rapidmlx.com/desktop">Desktop app</a> · <a href="https://rapidmlx.com/performance/">Community benchmarks</a> · <a href="https://models.rapidmlx.com/">Model mirror</a>} </p> <p align="center"> <img src="https://raw.githubusercontent.com/raullenchai/Rapid-MLX/main/docs/assets/demo.gif" alt="Rapid-MLX demo — install, serve Gemma 4, chat, tool calling" width="700"> <br> <em>pip install → serve Gemma 4 26B → chat + tool calling → works with PydanticAI, LangChain, Aider, and more.</em> </p>

| | Your Mac | Model | Speed (tok/s) | What works | |:---|:---:|:---:|:---:|:---:| | 16 GB MacBook Air | Qwen3.5-4B | 147 tok/s | Chat, coding, tools | | 24 GB MacBook Pro | Qwen3.5-9B | 101 tok/s | Great all-rounder |