Lemonade is a local AI inference server and desktop application that provides OpenAI/Anthropic/Ollama-compatible APIs with support for multiple backends (llama.cpp, vLLM, whisper.cpp, Kokoro, etc.). The C++ server core handles model lifecycle, routing policies, multi-modal inference, and telemetry, while the React/TypeScript frontend (Tauri desktop app and web build) offers a full GUI for chat, image/audio generation, transcription, and model management. The repository also includes a CLI client, tray application, extensive integration tests, and automated documentation generation. Architecture follows a clean backend-descriptor registry pattern with generated boilerplate, platform abstraction for process/archive/path operations, and a sophisticated routing policy engine for model selection.
Deep Java Library (DJL) is an engine-agnostic Java framework for deep learning that provides a unified interface for building, training, and deploying models across multiple backends (PyTorch, TensorFlow, MXNet, ONNX Runtime). The framework features a modular architecture with core APIs for model management, tensor operations, and training, complemented by engine-specific implementations and extensions for various modalities (CV, NLP, audio, time series). DJL enables Java developers to work with deep learning without needing to learn the intricacies of underlying frameworks, offering translator patterns for data preprocessing/postprocessing, a model zoo system for accessing pre-trained models, and flexible training configurations. The library is actively maintained with recent commits, extensive testing, and continuous integration workflows.
X-AnyLabeling is a cross-platform desktop application (PyQt6) for AI-assisted annotation of images, videos, and 3D point clouds. It serves as a unified interface for a vast model zoo including YOLO (v5-v26), SAM (1/2/3), Grounding DINO, Florence-2, PP-OCR, and many others, enabling auto-labeling for detection, segmentation, pose estimation, OCR, tracking, and more. The application features a plugin-based model architecture, abstracted inference engines (ONNX, TensorRT, PyTorch), and a comprehensive settings system. It also integrates an Ultralytics YOLO training pipeline and a secure in-app update mechanism. While primarily an application, it has a strong hybrid nature due to its deep integration of research code (vendored Grounding DINO, SAHI) and data pipeline utilities (format converters, COCO evaluators). The codebase demonstrates high craftsmanship in its model abstraction layer and inference engine design, though the sheer volume of integrated models introduces a medium risk of technical drift. It is actively maintained with a large community and extensive test coverage.
OnnxSlim is a Python library and CLI tool for optimizing ONNX models through graph rewriting. It applies elimination of redundant operations (e.g., no-op reshapes, slices, unsqueezes) and fusion of common patterns (Conv+BN, Conv+Add, GELU, etc.), combined with dead node elimination and shape inference. The architecture is modular: a core optimization pipeline orchestrates pattern matchers, a shape inference engine, and a vendored onnx_graphsurgeon for graph manipulation. The tool is used in production by NVIDIA TensorRT-Model-Optimizer, HuggingFace Optimum, and Ultralytics, confirming its practical value. The codebase demonstrates strong engineering with comprehensive tests, a clean CLI, and a well-organized package structure.
Silero VAD is a pre-trained enterprise-grade Voice Activity Detector library that provides speech detection capabilities for audio signals. The system consists of a core PyTorch model (also available in ONNX format) with Python utilities for audio processing, speech timestamp extraction, and streaming applications. It supports 8kHz and 16kHz sampling rates and includes a VADIterator class for real-time processing. The repository offers multi-language examples (C++, C#, Go, Haskell, Java, Rust) demonstrating integration, along with tools for model tuning and sequence-based ONNX optimization for improved performance on long audio files.
Fonnx is a Flutter plugin that enables cross-platform, on-device machine learning inference by wrapping the ONNX Runtime engine. It provides a unified Dart API that abstracts away the complexities of native FFI (for iOS, Android, macOS, Windows, Linux) and WebAssembly (for web), allowing developers to run models like OpenAI Whisper, Silero VAD, Magika, and various text embedding models without cloud dependencies. The codebase exhibits high software craftsmanship. Its architecture uses conditional Dart imports to cleanly separate native and web backends, employs Dart isolates for offloading heavy inference tasks, and implements a custom RPC protocol for web workers. A standout feature is its robust native memory management, including a C finalizer tested with sanitizers to prevent leaks during Flutter hot-restarts. While primarily a software library, it bridges the gap between ML research and production by bundling specific, optimized ONNX models and providing a deterministic test corpus with golden outputs. It is an excellent resource for Flutter developers building privacy-focused, offline-first AI applications, though its reliance on pinned native assets and specific build tooling introduces a moderate technical drift risk.
This repository implements a modern Automatic Number Plate Recognition (ANPR) pipeline as a production-ready application. It ingests images (via HTTP upload or WebSocket stream), runs detection using the `fast-alpr` library (YOLO-based ONNX model), performs OCR with `fast-plate-ocr`, applies post-processing (confusion-pair correction, Turkish plate format parsing, temporal majority voting), optionally tracks vehicles via an IoU-based multi-object tracker, and stores only HMAC-SHA256 hashed plate texts for privacy compliance. The system is exposed through a FastAPI REST API with WebSocket support and a HTMX web UI, plus a Typer CLI for inference and server management. It is containerized with Docker and publishes to PyPI and GHCR. The repository also contains a legacy directory (`legacy/`) with a complete YOLOv5 training pipeline for license plate detection, but that code is explicitly unmaintained and serves as historical reference only. The modern codebase is actively maintained, well-tested, and demonstrates strong software engineering practices including protocol-based abstractions, structured logging, Prometheus metrics, and privacy-by-design persistence.