onnx2tf is a production-ready ONNX to TensorFlow/TFLite conversion framework that employs a sophisticated pass-based optimization pipeline. The system converts ONNX models through preprocessing, lowering to an intermediate representation (ModelIR), applying 50+ optimization passes (layout transformation, operator fusion, quantization), and exporting to target formats including TFLite, SavedModel, PyTorch nn.Module, and TorchScript. Its architecture features clean separation between operator implementations, IR transformation passes, and backend-specific exporters, with the flatbuffer_direct backend providing 100x+ faster conversion by bypassing TensorFlow graph construction. The framework includes comprehensive accuracy validation tools, dynamic shape handling, and model surgery capabilities for intermediate layer extraction.
Google AI Edge Gallery is an Android application that serves as a showcase and playground for on-device AI models, primarily Gemma 4 and other LiteRT-compatible LLMs. It provides a rich set of interactive tasks including AI Chat, Prompt Lab, Ask Image, Audio Scribe, Tiny Garden (a mini-game powered by a 270M model), Mobile Actions (device control via function calling), and an Agent Skills system with MCP (Model Context Protocol) integration. The app manages the full lifecycle of on-device models: discovery (via HuggingFace), download, initialization, inference, and benchmarking. It features a plugin architecture via the CustomTask interface, allowing new tasks to be registered through Hilt dependency injection. Skills are defined as markdown instruction files paired with JavaScript functions executed in a WebView, enabling extensible tool use. The codebase is well-structured with Jetpack Compose UI, Proto DataStore persistence, Firebase Analytics, and a clean separation of concerns. It is a professional-grade demo application that demonstrates advanced on-device AI capabilities, though some areas (e.g., skill duplication, large ViewModels) show signs of rapid development.