$ account zylon-ai
PrivateGPT is a production-grade, private AI assistant platform that provides RAG (Retrieval-Augmented Generation) over ingested documents, tool/function calling, sandboxed code execution, web search, MCP (Model Context Protocol) integration, skill management, and multimodal support. It is built as a FastAPI server with background workers (Celery and ARQ) for asynchronous ingestion and task processing, and exposes a Claude API-compatible streaming interface. The architecture is modular: a core chat engine with an interceptor pipeline for request/response processing, a pluggable component system with registries for LLMs, embeddings, readers, vector stores, and sandboxes, and a two-tier scheduling system (local and distributed) for tool and chat execution. The codebase demonstrates strong engineering practices with dependency injection, registry patterns, and composable interceptors, but its dual scheduling backends, extensive monkey-patching of third-party libraries, and heavy reliance on llama-index introduce maintenance complexity and technical drift. Reusable highlights include the context stack builder for dynamic system prompt assembly, the interceptor chain pattern, the sandbox abstraction for secure code execution, and the citation parser with incremental streaming support. The project is actively maintained by Zylon and powers their enterprise offering, with 57k+ stars and frequent releases.