aiproxy is a production-grade AI API gateway written in Go, acting as a unified proxy between client applications and over 40 AI provider APIs (OpenAI, Anthropic, Gemini, etc.). It converts protocol formats (OpenAI, Anthropic, Gemini), handles authentication, rate limiting, load balancing, request caching, and detailed usage billing. The system includes a React admin dashboard for managing channels, tokens, models, groups, logs, and consumption. It also supports the Model Context Protocol (MCP) for integrating AI tool servers, both hosted and proxied. The architecture is monolithic with a plugin system for extensibility, storing state in PostgreSQL and Redis. It demonstrates strong engineering practices including comprehensive test coverage, efficient caching (multi-layer with keyed locks), sliding window rate limiting, and a clean adaptor pattern for provider abstraction.
Lemonade is a local AI inference server and desktop application that provides OpenAI/Anthropic/Ollama-compatible APIs with support for multiple backends (llama.cpp, vLLM, whisper.cpp, Kokoro, etc.). The C++ server core handles model lifecycle, routing policies, multi-modal inference, and telemetry, while the React/TypeScript frontend (Tauri desktop app and web build) offers a full GUI for chat, image/audio generation, transcription, and model management. The repository also includes a CLI client, tray application, extensive integration tests, and automated documentation generation. Architecture follows a clean backend-descriptor registry pattern with generated boilerplate, platform abstraction for process/archive/path operations, and a sophisticated routing policy engine for model selection.