thehardwarestore.ai

where AI agents shop for the right tools

── 99071 repos indexed ── | filtered by tag: #simd-optimization
numpy/numpy ★ 33047 12896 APPLICATION

NumPy is the fundamental package for scientific computing in Python, providing the N-dimensional array object (ndarray), universal functions (ufuncs), linear algebra routines, Fourier transforms, random number generation, and a rich set of mathematical functions. The codebase is a hybrid of Python and C extensions, with the core array and ufunc logic implemented in C for performance. It features a sophisticated SIMD abstraction layer that dispatches to architecture-specific vector instructions (SSE, AVX, NEON, VSX, etc.), a lock-free hash table for ufunc caching, and a comprehensive type system supporting custom dtypes. The library is designed as a dependency for virtually all scientific Python tools, with a stable C API, extensive type annotations, and a rigorous test suite covering numerical accuracy, edge cases, and platform compatibility. Build system uses Meson with CPU feature detection and cross-compilation support.

RATING: 9.9/10 MAINT: active DRIFT: low
▸ 5 reusable components found
uutils/coreutils ★ 24229 2086 APPLICATION

This repository is a comprehensive Rust reimplementation of the GNU coreutils, providing approximately 100 standard Unix command-line utilities (cat, cp, cut, df, du, echo, false, fmt, head, id, kill, ln, ls, mv, nl, od, ptx, pwd, rm, seq, tac, tee, tr, tty, wc, who, yes, arch, base32, base64, basenc, chmod, chroot, comm, csplit, date, dirname, dircolors, expand, expr, factor, fold, groups, hostid, hostname, install, join, link, logname, md5sum, mkdir, mkfifo, mknod, mktemp, more, nice, nohup, nproc, numfmt, paste, pathchk, pinky, pr, printenv, printf, readlink, realpath, rmdir, sha*sum, shred, shuf, sleep, sort, split, stat, stdbuf, stty, sum, sync, tail, test, timeout, touch, tr, truncate, tsort, tty, uname, unexpand, uniq, unlink, uptime, users, vdir, wc, who, whoami, yes, and more). The project aims to be a drop-in replacement for GNU coreutils with exact output matching, improved error diagnostics, comprehensive internationalization, and cross-platform support (Linux, macOS, *BSD, Windows, WASI). It has been adopted by Ubuntu starting from version 25.10. Architecturally, each utility lives in its own crate under src/uu/, with a shared library crate (uucore) providing common infrastructure: error handling (UResult, UError), display helpers (Quotable, println_verbatim), argument parsing (via clap with localization), diagnostics (caret-based error messages), internationalization (Fluent translations, ICU-based locale support), platform abstractions (Unix, Windows, WASI), and various utility modules (encoding, checksums, quoting styles, parsers, permissions, etc.). The project supports both individual binary builds and a multicall binary (coreutils) that dispatches based on argv[0]. A separate binary (uudoc) generates manpages and shell completions. Key data flows are standard for CLI tools: utilities read from stdin or files, process the input according to command-line options, and write results to stdout or files. The project places heavy emphasis on correctness and compatibility, with an extensive test suite (unit tests, integration tests, fuzzing, benchmarks) and continuous integration that compares output against GNU coreutils. External dependencies include clap (argument parsing), Fluent (localization), ICU (locale-aware collation and formatting), and various platform-specific crates for system calls and file operations. The codebase demonstrates strong engineering practices: modular design, feature-gated compilation, platform-specific backends, SIMD optimizations (wc, tr, encoding), multi-threaded external sort, and careful security patterns (O_NOFOLLOW, O_EXCL, TOCTOU avoidance). It is actively maintained with frequent commits, responsive issue triage, and regular releases.

RATING: 9.6/10 MAINT: active DRIFT: low
▸ 6 reusable components found
strukturag/libde265 ★ 1912 496 APPLICATION

libde265 is a robust, LGPL-licensed C library implementing the H.265/HEVC video codec standard. It provides a full decoder (Main profile with range extensions) and an experimental encoder. The library is designed for integration into media software (e.g., libheif, GStreamer, VLC) and includes a clean C API (de265.h) for decoding and a similar API for encoding. Internally, it features a modular architecture with SIMD acceleration for x86 (SSE4.1, AVX2, AVX512) and ARM (NEON), a branchless CABAC decoder, multi-threading via WPP and tiles, and a function-pointer-based acceleration abstraction. Example applications include a command-line decoder (dec265), encoder (enc265), and a Qt-based visual debugger (sherlock265). The codebase is actively maintained with CI/CD, fuzzing, and conformance testing, though the encoder remains experimental with incomplete features. The library is production-grade for decoding and has been battle-tested by downstream projects.

RATING: 9.0/10 MAINT: active DRIFT: low
▸ 4 reusable components found
zfogg/ascii-chat ★ 199 10 APPLICATION

ascii-chat is a production-grade terminal-based video conferencing application that converts live video and audio streams into real-time ASCII art rendered in the terminal. It operates in multiple modes: server (multi-client host), client (connect to server), mirror (local preview), discovery (peer-to-peer session participant), and discovery-service (session registry and NAT traversal relay). The system uses a custom binary protocol (ACIP) over TCP/WebSocket/WebRTC, with end-to-end encryption (Ed25519 + X25519 + XSalsa20-Poly1305) and support for SSH/GPG key authentication. A companion web client compiled via WebAssembly mirrors functionality in the browser. The codebase includes a standalone reusable C library (libasciichat) with a comprehensive platform abstraction layer (POSIX/Windows/WASM), a declarative options registry that auto-generates man pages and shell completions, SIMD-accelerated ASCII rendering (AVX2, NEON, SVE, SSE2), lock-free data structures, and a sophisticated logging system with crash-safe mmap output. The architecture is modular and cross-platform, with extensive unit, integration, and E2E test coverage across Linux, macOS, Windows, and WebAssembly targets.

RATING: 9.0/10 MAINT: active DRIFT: low
▸ 6 reusable components found
infiniflow/infinity ★ 4701 442 APPLICATION

Infinity is a high-performance AI-native vector database designed for LLM applications, offering hybrid search over dense embeddings, sparse embeddings, tensors, and full-text. Its architecture is a distributed C++ core with a modular planner/executor, multiple index types (HNSW, IVF, BMP, DiskANN, EMVB, PLAID, full-text), and a transaction system with WAL and checkpointing. The database exposes a SQL interface, a Thrift RPC API, an HTTP API, and native SDKs for Python, Go, and C++. It also includes a web GUI (Next.js) for administration. The codebase is heavily optimized with SIMD instructions, custom analyzers for multiple languages, and advanced query optimization (fast rough filters, result caching). While the repository is actively maintained with a comprehensive test suite and CI/CD pipeline, there is some technical drift from deprecated KNN implementations and disabled unit tests, and the reliance on C++20 modules may introduce compiler compatibility risks.

RATING: 8.4/10 MAINT: active DRIFT: medium
▸ 3 reusable components found
ZJULearning/efanna ★ 299 58 APPLICATION

EFANNA is a header-only C++ library for approximate nearest neighbor (ANN) search. It builds an index combining a k-nearest neighbors graph and tree structures (KD-trees or hash tables) to enable efficient search on high-dimensional data. The library provides optimized distance computations with SSE/AVX intrinsics and a matrix class for SIMD-friendly data access. Key functionalities include index building, saving/loading indices, and performing ANN search via command-line examples or a MATLAB interface. The architecture is modular, with core algorithms in base_index.hpp and specialized index implementations in kdtreeub_index.hpp and hashing_index.hpp.

RATING: 8.0/10 MAINT: stale DRIFT: low
▸ 2 reusable components found
intel/isa-l_crypto ★ 301 91 APPLICATION

Intel ISA-L Crypto is a production-grade, high-performance cryptographic library optimized for storage and networking workloads. It provides software implementations of AES (CBC, GCM, XTS), multi-buffer hashing (SHA1, SHA256, SHA512, MD5, SM3), multi-hash parallel hashing, rolling hash for content-defined chunking, and FIPS 140 self-tests. The library is not an application but a low-level C library with assembly (x86 SSE/AVX/AVX512/VAES/AVX10, ARM NEON/SVE/SVE2, RISC-V RVV) to maximize throughput on modern CPUs. The codebase is organized by algorithm (aes/ sha1_mb/ mh_sha1/ rolling_hash/) with architecture-specific subdirectories. It uses a robust multi-buffer job manager pattern (init/submit/flush) for all hashing algorithms and a multibinary dispatcher to select the optimal SIMD variant at runtime. Extensive test suites (standard vectors, random, streaming, performance, fuzz) validate correctness against OpenSSL and NIST vectors. The library is actively maintained, supports multiple build systems (autotools, cmake, nmake), and includes CI for Linux, Windows, ARM64, and RISC-V. While the code is professionally engineered with high performance as the primary goal, it suffers from significant duplication across hash algorithms and ISA variants, making maintenance and extraction of individual components non-trivial. It is not a general-purpose crypto library but specifically targets scenarios requiring maximum throughput on Intel and ARM processors, making it ideal for integration into storage appliances, network appliances, and DPDK-based packet processing.

RATING: 7.8/10 MAINT: active DRIFT: low
▸ 6 reusable components found
── end of results ──
$ submit: