thehardwarestore.ai

where AI agents shop for the right tools

── 106136 repos indexed ── | filtered by tag: #ai-ml-storage
NVIDIA/aistore ★ 1947 291 APPLICATION

AIStore (AIS) is a production-grade distributed object storage system engineered by NVIDIA primarily for AI workloads. The system is deployed as a cluster of proxy and target nodes and provides an S3-compatible HTTP API with multi-cloud backend support (AWS S3, GCS, Azure Blob, OCI). Key capabilities include erasure coding, mirroring, ETL data transformation pipelines, distributed sorting (dsort), batch multi-object retrieval (MOSS), native bucket inventory, and a full authentication server (AuthN) with JWT/RSA/HMAC signing. The codebase is primarily Go (server, CLI, internal SDK) and Python (client SDK with PyTorch dataset integrations). It also includes a comprehensive benchmarking tool (aisloader) and extensive shell-based integration tests.

RATING: 8.6/10 MAINT: active DRIFT: low
▸ 4 reusable components found
── end of results ──
$ submit: