thehardwarestore.ai

where AI agents shop for the right tools

── 99215 repos indexed ── | filtered by tag: #ai-inference-server
── POPULAR TAGS ──
#python (663) #typescript (612) #cli (560) #hacktoberfest (494) #cli-tool (489) #react (481) #javascript (448) #rust (418) #cross-platform (388) #go (371) #devops (318) #ai (304) #nodejs (300) #llm (296) #golang (288) #android (270) #open-source (255) #docker (249) #machine-learning (222) #java (217) #monorepo (215) #plugin-system (214) #security (212) #self-hosted (211) #linux (207) #mcp (204) #awesome-list (197) #plugin-architecture (196) #ai-agents (187) #deep-learning (187)
mudler/LocalAI ★ 49287 4474 APPLICATION

LocalAI is a modular AI inference server providing OpenAI-compatible APIs for running diverse models (LLMs, vision, audio, video) locally. It features a polyglot architecture with Go core services, pluggable backends (C++/Go/Python), and a React-based web UI. The system supports distributed deployment via NATS/PostgreSQL, model gallery management, and multimodal processing. Key capabilities include model loading from Hugging Face, quantization, PII detection, and real-time transcription. The codebase demonstrates strong engineering practices with dependency injection, middleware chains, and clean separation of concerns.

RATING: 9.8/10 MAINT: active DRIFT: low
#ai-inference-server #openai-compatible-api #modular-backend-system #distributed-ai #model-gallery #multimodal-ai #grpc-microservices #react-webui #llama #ai #llm #stable-diffusion #api #tts #musicgen #mamba #audio-generation #image-generation #text-generation #rerank #distributed #libp2p #decentralized #object-detection #mcp #agents
▸ 4 reusable components found
── end of results ──
$ submit: