Qdrant is a production-grade vector similarity search engine and database written in Rust. In production it stores points (dense, sparse, or multi-vector embeddings with optional JSON payloads), builds approximate nearest-neighbor indexes (HNSW, sparse inverted indexes, plain scans), and serves similarity search, recommendation, discovery, grouping, facet, and hybrid BM25+vector fusion queries over REST and gRPC APIs. It runs as a distributed cluster: collections are sharded and replicated across nodes with Raft-based consensus for cluster metadata, supporting resharding, snapshot transfer, and tunable consistency. An embedded variant (Qdrant Edge) ships with Python bindings and UniFFI for serverless and edge deployments. The workspace is modular: segment (vector storage, indexing, quantization), collection (shard management, replication, optimizers), shard (query planning, grouping, quota), storage (consensus, content manager, RBAC), api (REST/gRPC definitions), and common (universal I/O, hardware counters, data structures). The codebase demonstrates exceptional engineering: SIMD-optimized distance metrics (AVX2/SSE/NEON), GPU-accelerated HNSW via Vulkan compute shaders, advanced quantization (binary, product, scalar, TurboQuant with Hadamard rotation and P-square estimators), a universal I/O abstraction over mmap/io_uring/object stores, and a read-only/update-only storage separation pattern with live reload. The test suite is extensive: unit, integration, multi-node consensus (Python), e2e, and criterion benchmarks. Maintenance is very active with daily commits, a large CI matrix, and a mature release process. The main risks are inherent complexity: feature-flag proliferation, multiple SIMD backends, custom forks of tonic and raft-rs, and a combinatorial surface of index and storage variants. Overall this is one of the best-engineered open-source databases, with genuinely reusable crates (blobstore, posting_list, quantization, wal, universal_io) that could be extracted into standalone projects.
This repository implements generative recommendation models, primarily HSTU (Hierarchical Sequential Transduction Units) and DLRM-v3, for large-scale sequential recommendation. It is a hybrid codebase combining research experimentation (ICML'24 paper on generative recommenders) with production-grade inference benchmarking (MLPerf loadgen integration). The code provides custom high-performance CUDA and Triton kernels for flash attention, jagged tensor operations, and layer normalization, targeting modern NVIDIA GPUs (Hopper/Blackwell). It includes training pipelines with gin configuration for datasets like MovieLens, Amazon Books, KuaiRand, and synthetic streaming data up to 100B items. The repository also contains a full MLPerf inference benchmark suite with vendored loadgen library and end-to-end TorchScript tracing for deployment. While the core focus is research on scaling laws and architecture innovations for sequential recommenders, the ops and modules are engineered to production standards with multiple kernel backends and rigorous tests.
Gorse is a production-grade, open-source recommender system engine written in Go. It implements a master/server/worker distributed architecture: the master coordinates training and cluster state, workers generate offline recommendations, and servers expose a REST API, dashboard, and gRPC endpoints. The system supports collaborative filtering via BPR and ALS matrix factorization, click-through rate prediction via an Attentional Factorization Machine, item-to-item/user-to-user similarity based on embeddings, non-personalized leaderboards, external script recommenders, and LLM-based reranking/chat recommenders. It includes a complete data model for users, items, feedback, and labels, with storage backends for SQL databases, MongoDB, Redis, and vector stores (xvec, Qdrant, Weaviate, Milvus), plus blob storage for model artifacts. The codebase is organized around strong abstractions: storage interfaces, protobuf-based services, a recommendation logic layer, model training/evaluation packages, and a common utility layer containing an autograd tensor library, SIMD-optimized float kernels, HNSW vector search, and concurrency helpers. It exposes admin/client CLIs, JSONL import/export, hyperparameter optimization with Optuna, monitoring metrics, and OpenTelemetry tracing. Although this repository contains ML training, benchmarks, and data-loading code, it is fundamentally an application platform rather than a data-research repository. The engineering is strong but carries complexity from supporting many storage backends, architecture-specific SIMD generated code, and a large monolithic master task file; some deprecated APIs and generated-code drift are present.