ncnn is a high-performance neural network inference framework designed for mobile, embedded, and desktop deployment. It provides a self-contained C++ library with no mandatory external dependencies, supporting CPU inference with extensive SIMD optimizations (ARM NEON, x86 SSE/AVX/AVX512, RISC-V Vector, MIPS MSA, LoongArch LSX/LASX) and GPU inference via Vulkan. The framework includes a comprehensive set of neural network layers (convolution, pooling, normalization, activation, recurrent, attention, etc.) and supports multiple data types (float32, float16, bfloat16, int8). The companion pnnx tool converts models from PyTorch (TorchScript) and ONNX into ncnn format using a sophisticated graph rewriting pipeline. Python bindings and a model zoo are provided for rapid prototyping. The codebase is production-grade, used in Tencent applications like QQ and WeChat, and is actively maintained with support for modern architectures and operations (e.g., scaled dot-product attention, rotary embeddings).
Deep Java Library (DJL) is an engine-agnostic Java framework for deep learning that provides a unified interface for building, training, and deploying models across multiple backends (PyTorch, TensorFlow, MXNet, ONNX Runtime). The framework features a modular architecture with core APIs for model management, tensor operations, and training, complemented by engine-specific implementations and extensions for various modalities (CV, NLP, audio, time series). DJL enables Java developers to work with deep learning without needing to learn the intricacies of underlying frameworks, offering translator patterns for data preprocessing/postprocessing, a model zoo system for accessing pre-trained models, and flexible training configurations. The library is actively maintained with recent commits, extensive testing, and continuous integration workflows.
InsightFace is a comprehensive, production-grade face analysis ecosystem. It provides a Python package (`insightface`) with high-level APIs for face detection, recognition, attribute estimation, and face swapping, backed by ONNX Runtime. A C++ SDK (`inspireface`) enables on-device inference across Linux, Android, iOS, and embedded platforms with support for CUDA, TensorRT, CoreML, and Rockchip NPUs. A FastAPI server offers REST endpoints for face search and verification with SQLite persistence and license management. A PySide6 desktop GUI (Evaluation Studio) provides interactive workflows for verification, album management, and enterprise evaluation. The repository also contains extensive research code for training face recognition models (ArcFace, Partial FC, VPL) across PyTorch, MXNet, OneFlow, and PaddlePaddle, as well as detection (SCRFD, RetinaFace), 3D reconstruction, and face parsing. While the core application components are well-engineered and actively maintained, the research subprojects vary in maturity and may rely on outdated frameworks.