umiii100/local-rag-server
umiii100
Python2updated 4mo ago
Python2updated 4mo agoDeploy a local, multi-user RAG system to query PDF and DOCX documents using a local LLM without cloud or API dependencies.
ClaudeCodexCursorMCP
agent-skillsai-toolsantigravitycomfyuihybrid-searchlinuxmcpmcp-proxymcp-serverollamaopen-webuiprivacy-first
README
🤖 local-rag-server - Offline Document Chat Made Easy
📄 About local-rag-server
local-rag-server lets you chat with PDF and DOCX files on your computer. It works fully offline, so your documents stay private. The server runs locally on your Windows PC. It uses lightweight models and a simple web interface you open in your browser.
You don’t need any cloud accounts or API keys. Everything runs on your machine. It shows fast results when you search or ask questions about your documents.
Key points:
- Works with PDF and DOCX documents
- Runs entirely offline
- Uses efficient llama.cpp models in GGUF format
- Comes with a simple web interface
- Fast search with Qdrant vector database
- No need for cloud access or internet connection
🔥 Features
- Easy local setup: No coding or technical skills needed
- Supports common document types: PDF and Word files
- Privacy first: Your files never leave your computer
- Unified chat interface: Ask questions or search your documents
- Runs on Windows: Designed for desktop use
- Lightweight: Low resource usage even on modest PCs
- Open source code: Transparent and modifiable
🖥️ System Requirements
- Windows 10 or later (64-bit recommended)
- At least 4 GB of RAM (8 GB or more for large documents)
- 2 GHz processor or faster
- 500 MB free disk space for installation
- An active internet connection to download the setup files (not needed after install)
- Modern web browser (Chrome, Edge, Firefox)
🚀 Getting Started
Follow these steps to download and run local-rag-server on your Windows PC.
1. Download the Application
Visit the download page below to get the latest installer:
[![Download local-rag-server](https://img.shields.io/badge/Dow