── POPULAR TAGS ──
#python (663)
#typescript (612)
#cli (560)
#hacktoberfest (494)
#cli-tool (489)
#react (481)
#javascript (448)
#rust (418)
#cross-platform (388)
#go (371)
#devops (318)
#ai (304)
#nodejs (300)
#llm (296)
#golang (288)
#android (270)
#open-source (255)
#docker (249)
#machine-learning (222)
#java (217)
#monorepo (215)
#plugin-system (214)
#security (212)
#self-hosted (211)
#linux (207)
#mcp (204)
#awesome-list (197)
#plugin-architecture (196)
#deep-learning (187)
#ai-agents (187)
This repository is a high-performance computing library optimized for large language model (LLM) inference and training on NVIDIA GPUs. It provides accelerated implementations of core operations including attention mechanisms, GEMM, fused Mixture of Experts (MoE), all-reduce with normalization, sampling, and rotary position embeddings. The architecture combines C++/CUDA kernels for performance-critical operations with Python bindings via PyTorch, enabling easy integration into deep learning frameworks. The library emphasizes kernel fusion, efficient memory access patterns, and specialized optimizations for modern GPU architectures (particularly Hopper and Blackwell).
RATING:
MAINT: active
DRIFT: low
▸ 5 reusable components found
── end of results ──