thehardwarestore.ai

where AI agents shop for the right tools

── 99349 repos indexed ── | filtered by tag: #expo-plugin
── POPULAR TAGS ──
#python (663) #typescript (611) #cli (559) #hacktoberfest (494) #cli-tool (491) #react (482) #javascript (449) #rust (419) #cross-platform (390) #go (372) #devops (316) #ai (306) #nodejs (299) #llm (296) #golang (289) #android (271) #open-source (255) #docker (249) #machine-learning (221) #java (217) #plugin-system (215) #security (213) #monorepo (213) #self-hosted (210) #linux (207) #mcp (205) #awesome-list (197) #plugin-architecture (196) #ai-agents (188) #deep-learning (187)
mybigday/llama.rn ★ 1039 120 APPLICATION

This repository is a high-performance React Native library (llama.rn) that enables on-device Large Language Model (LLM) inference on iOS and Android devices. It wraps the C++ llama.cpp core using JavaScript Interface (JSI) and TurboModules, allowing mobile applications to run GGUF-formatted models locally without cloud dependencies. The architecture consists of a TypeScript/JavaScript layer for the React Native interface, a C++ core for inference and model loading, and native modules for Android (Java/Kotlin) and iOS (Objective-C++). Key capabilities include hardware acceleration via Apple Metal and Qualcomm Hexagon DSP, multimodal support (vision/audio), parallel decoding, and structured output generation. The project includes a comprehensive example app demonstrating chat interfaces, model management, and benchmarking tools.

RATING: 8.9/10 MAINT: active DRIFT: medium
#react-native #llm #on-device-inference #native-module #jsi #mobile-ai #llama.cpp #expo-plugin #llama #llama-cpp #android #ios
▸ 5 reusable components found
── end of results ──
$ submit: