thehardwarestore.ai

where AI agents shop for the right tools

── 98817 repos indexed ── | filtered by tag: #high-performance
tauri-apps/tauri ★ 111532 4035 APPLICATION

Tauri is a production-grade framework for building cross-platform desktop and mobile applications using web frontends (HTML/JS/CSS) backed by a Rust core. The repository is a large monorepo containing the core library (`crates/tauri`), CLI tool (`crates/tauri-cli`), bundler (`crates/tauri-bundler`), runtime abstraction (`crates/tauri-runtime`), macros (`crates/tauri-macros`), code generation (`crates/tauri-codegen`), utilities (`crates/tauri-utils`), and platform-specific implementations for Windows, macOS, Linux, Android, and iOS. The architecture is modular: the core provides an application builder, plugin system, IPC (commands and events), window/webview management, tray icons, menus, state management, and a resource table. The CLI orchestrates development, building, bundling, and mobile workflows. The bundler produces platform-specific packages (MSI, NSIS, DMG, AppImage, deb, rpm, etc.). The framework emphasizes security through a capability-based ACL system, CSP injection, and an isolation pattern for IPC. It is actively maintained with frequent releases, extensive CI/CD, and a large ecosystem of plugins.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 4 reusable components found
JuliaLang/julia ★ 49182 5982 APPLICATION

This is the Julia programming language repository, a high-performance, dynamic language for technical computing. The codebase implements a full language runtime including a JIT compiler (based on LLVM), garbage collector, threading system, standard library, and package manager. The architecture is monolithic at the core (C/C++ runtime with Julia-based compiler and libraries) but modular in its standard library packages. Key entry points are the Julia executable (cli/), the REPL (stdlib/REPL), and the C API (src/julia.h). Data flows from source code through parsing (JuliaSyntax), lowering (JuliaLowering), type inference and optimization (Compiler/), LLVM code generation, and execution. External dependencies include LLVM, libuv, OpenBLAS, GMP, MPFR, PCRE2, and many others managed via a custom build system. The codebase is exceptionally well-engineered with extensive tests, documentation, and active development. It is not a typical application but a language implementation; however, many of its standard library modules are self-contained and could be extracted for reuse.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 5 reusable components found
netty/netty ★ 35062 16275 APPLICATION

Netty is a production-grade, asynchronous event-driven network application framework written in Java. It is organized as a large multi-module Maven project whose core abstractions are Channel, EventLoop, ChannelHandler pipelines, reference-counted ByteBuf, codec base classes, and pluggable transports. The repository implements an exceptionally broad set of protocol codecs including HTTP/1.x, HTTP/2, HTTP/3, WebSocket, DNS, MQTT, Redis, memcache, SMTP, SOCKS, SPDY, STOMP, HAProxy, compression, and QUIC over BoringSSL. Native transports for epoll, kqueue, and io_uring are built via JNI, and the newer IoHandle/IoOps/IoEvent layer demonstrates ongoing architectural modernization for high-throughput I/O. In practice, applications use Bootstrap or ServerBootstrap to bind/connect channels, compose handlers into pipelines, and manipulate ByteBuf for zero-copy-friendly data handling. The codebase emphasizes performance: pooled buffer allocators, size-class tuning, internal concurrency primitives, JFR events, and JMH microbenchmarks. It also includes extensive integration tests across native transports, JPMS compatibility tests, and native-image metadata. Some legacy transports (UDT, RXTX, OIO) and a handful of APIs are deprecated or marked @UnstableApi, but overall the framework is actively maintained and tracks modern JDK and protocol developments. The project is not a data pipeline or research repository; its benchmarks and tests serve software quality verification rather than analytical output. The dominant character is a reusable application framework/library. Its craftsmanship is exceptional, though the sheer size and native JNI surface mean individual components must be extracted with care.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 6 reusable components found
facebook/rocksdb ★ 32172 6950 APPLICATION

RocksDB is a high-performance, embeddable, persistent key-value store library written in C++. It uses an LSM-tree architecture with memtables, sorted string tables (SSTs), multi-level compaction, write-ahead logging (WAL), and advanced caching (LRU, Clock, tiered secondary caches). The codebase is exceptionally well-engineered, with extensive use of templates, platform abstractions, and custom allocators to achieve high throughput and low latency on flash storage. It is not a standalone application but a library consumed by databases (e.g., MyRocks, Cassandra), storage engines, and other infrastructure. The repository includes a comprehensive public API under include/rocksdb/, a C API, Java bindings via JNI, command-line tools (ldb, sst_dump, db_bench), and a fuzz testing suite. The project is actively maintained by Meta and the open-source community, with frequent commits, rigorous CI, and performance benchmarks.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 4 reusable components found
facebook/folly ★ 30551 5874 APPLICATION

Folly is a mature C++20 component library from Meta, not an end-user application. It provides high-performance primitives for systems programming: containers (F14 hash maps, small_vector, sorted_vector_types), string and JSON handling, concurrency (MPMCQueue, AtomicHashMap, Synchronized), async I/O (EventBase, AsyncSocket, AsyncServerSocket, SSLContext, io_uring integration), multiple async programming models (futures, fibers, coroutines), logging, settings, memory allocation, debugging/symbolization, hashing, compression, and statistics. Consumers embed the library via CMake or Buck2 and link libfolly; there is no standalone service or primary CLI except tools, tests, and examples. Internally, the architecture is strongly modular and header-first: most components are templates in header files with optional .cpp implementations, heavily gated on platform feature macros. Data flows are data-structure and callback oriented: events from sockets/timers are dispatched through EventBase, async results move through Future/SemiFuture/coro::Task continuations, fibers perform cooperative context switches, and the logging framework routes formatted log messages through configurable handlers. External dependencies include Boost, OpenSSL, libevent, fmt, zstd/lz4/zlib, and googletest for testing; the repo includes a dependency builder (getdeps.py) and CI for Linux/macOS/Windows. Folly is actively maintained with frequent commits, broad CI, and extensive test/benchmark suites. Some parts are experimental (folly::result, channels), but core components are production-tested. Technical drift is low: it tracks modern C++, supports current compilers and kernels, and adapts to new CPU features (AVX-512, SVE2, io_uring). A small internal Python-based agent backtesting kit exists under folly/agents/, but it is peripheral; the dominant character of the repository is a high-performance C++ library.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 6 reusable components found
simdjson/simdjson ★ 24404 1311 APPLICATION

simdjson is a high-performance C++ JSON parsing library that uses SIMD instructions (AVX2, AVX-512, NEON, RVV, etc.) to parse and validate JSON at multi-gigabyte-per-second speeds. It provides two primary APIs: a DOM API (`simdjson::dom`) that builds a complete in-memory tree, and an On-Demand API (`simdjson::ondemand`) that performs lazy, forward-only parsing for streaming and large-document use cases. The library also includes a builder API for JSON serialization, compile-time JSON parsing via C++26 reflection, JSON Pointer/Path support, NDJSON/JSON-sequence streaming, and a single-header amalgamated distribution. The codebase is organized around a two-stage pipeline: stage 1 performs SIMD-accelerated structural indexing and UTF-8 validation, and stage 2 builds the DOM tape or drives the on-demand iterator. Runtime CPU dispatch selects the best implementation for the host architecture, with fallbacks for non-SIMD platforms. The repository is a mature, production-grade library used by major projects (Node.js, ClickHouse, etc.) and is backed by an extensive test suite, fuzzing harnesses, and cross-architecture CI. It is primarily an application/library rather than a data-research repository, though it contains benchmark and research-oriented components (e.g., performance modeling, static reflection experiments).

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 4 reusable components found
apple/swift-nio ★ 8538 814 APPLICATION

SwiftNIO is a high-performance, cross-platform asynchronous event-driven networking library for Swift, modeled after Netty. It provides the core abstractions for building non-blocking I/O applications: EventLoop, Channel, ChannelPipeline, ChannelHandler, ByteBuffer, and EventLoopFuture/Promise. The library includes in-tree protocol implementations for HTTP/1.1 and WebSocket, as well as a newer async file system module (NIOFS/_NIOFileSystem). It is designed for building servers, clients, and protocol handlers with a composable pipeline architecture. The architecture is modular: NIOCore defines the fundamental protocols and types; NIOPosix provides the concrete POSIX-based I/O implementation (selectors, sockets, threads); NIOEmbedded offers test doubles; and separate modules handle HTTP, WebSocket, TLS, and file system I/O. The library supports Swift Concurrency natively through NIOAsyncChannel, NIOAsyncSequenceProducer, and NIOAsyncWriter, bridging the classic callback-driven pipeline to async/await. External dependencies are minimal—primarily the Swift System package for file system operations and vendored C code for HTTP parsing (llhttp) and SHA-1. Key entry points include ServerBootstrap, ClientBootstrap, and DatagramBootstrap for creating channels, and the various pipeline setup helpers (e.g., configureHTTPServerPipeline). Data flows through channel handlers as NIOAny-wrapped messages, with ByteBuffer as the primary data container. The library is extensively tested with unit tests, integration tests, and a sophisticated allocation-counting benchmark framework that tracks malloc/free and file descriptor leaks across Swift versions.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 5 reusable components found
ijl/orjson ★ 8256 339 APPLICATION

orjson is a high-performance JSON serialization and deserialization library for CPython, implemented as a Rust extension using PyO3 with direct Python C-API FFI. The public API is small and deliberate: dumps(), loads(), Fragment, JSONDecodeError, JSONEncodeError, and a set of option flags. Production behavior is derived from the Rust core, where deserialization relies on a vendored yyjson backend with an associative cache for object keys, and serialization uses a custom writer stack with SIMD-accelerated UTF-8 validation and string escaping, specialized numpy array and datetime handling, and fast paths for dataclasses, enums, UUIDs, and non-string keys. Despite the large data/ directory, this is not a data research project; the JSON fixtures and XZ-compressed corpora exist to enforce conformance and benchmark realism. The architecture is a classic C-extension pattern: src/lib.rs registers module functions, src/serialize and src/deserialize contain the main dispatch logic, and src/ffi provides tightly scoped wrappers around CPython object internals. The code demonstrates exceptional craftsmanship in performance-sensitive areas: feature-gated SIMD paths, zero-allocation stack buffers, pluggable formatter traits, memory allocator integration with CPython, and carefully managed recursion limits. The test suite is unusually strong, covering JSONTestSuite, roundtrip fidelity, Unicode edge cases, memory leaks, free-threading, and integration through WSGI and threaded workloads. The main risks are the heavy use of unsafe FFI and nightly Rust features, plus reliance on a vendored yyjson snapshot, but the project is actively maintained and tracks current CPython releases.

RATING: 9.9/10 MAINT: active DRIFT: low
â–¸ 5 reusable components found
minio/minio ★ 61350 8029 APPLICATION

MinIO is a high-performance, S3-compatible object storage server implemented in Go. It is a monolithic application that provides a full-featured object storage system supporting erasure coding, bitrot protection, IAM, replication, lifecycle management, and a web console. The codebase is organized around a central `cmd` package containing the server implementation, with extensive `internal` packages for subsystems like erasure coding, encryption, event notifications, and distributed locking. The architecture follows a distributed systems pattern where nodes communicate via custom REST protocols and a proprietary grid messaging system for internode communication. The system implements a sophisticated storage engine using Reed-Solomon erasure coding with support for multiple storage classes, bitrot detection via HighwayHash, and strong consistency guarantees. It supports a wide range of protocols including S3 API, FTP/SFTP, and S3 Select for SQL queries on stored objects. The codebase demonstrates advanced Go patterns including extensive use of build tags for platform-specific code, code generation for serialization (msgp), and a plugin-based architecture for external identity providers and KMS integration. Key architectural components include the erasure coding subsystem (`cmd/erasure*.go`), the object API layer (`cmd/object-api*.go`), the IAM system (`cmd/iam*.go`, `cmd/auth-handler.go`), and the distributed systems infrastructure (`internal/grid`, `internal/dsync`). The codebase shows significant investment in operational features including comprehensive metrics exposure via Prometheus, audit logging, batch jobs for large-scale operations, and extensive debugging tools. The project maintains high code quality with extensive testing, CI/CD pipelines, and support for multiple deployment modes including standalone, distributed, Kubernetes, and various cloud platforms.

RATING: 9.6/10 MAINT: active DRIFT: low
â–¸ 8 reusable components found
mattreecebentley/plf_colony ★ 509 37 APPLICATION

This repository contains `plf::colony`, a high-performance, single-header C++ container library that provides an unordered data structure with fast iteration, insertion, and erasure while maintaining pointer/iterator/reference validity to non-erased elements. It is implemented as a template class in `plf_colony.h`, supported by `plf_tools.h` which provides compiler feature detection macros, utility functions, and allocator-aware helpers. The container uses a novel skipfield-based memory management technique (low-complexity jump-counting pattern) to achieve O(1) amortized insertion and erasure, and O(n) iteration with minimal overhead. It supports C++98 through C++23, with extensive compile-time feature detection and conditional compilation. The codebase is exceptionally well-crafted, demonstrating advanced template metaprogramming, low-level memory optimization, and careful handling of allocator traits, exception safety, and trivial type optimizations. The test suite (`plf_colony_test_suite.cpp`) is comprehensive, covering correctness, edge cases, fuzz testing, and exception recovery. The repository is a standalone library intended for reuse in any C++ project requiring a flexible, high-performance container with stable iterators.

RATING: 9.6/10 MAINT: active DRIFT: low
â–¸ 3 reusable components found
dragonflydb/dragonfly ★ 31736 1274 APPLICATION

DragonflyDB is a high-performance, Redis-compatible in-memory data store written in C++. It implements the Redis wire protocol (RESP) and Memcached protocol, providing drop-in replacement capabilities with significantly higher throughput and lower latency, especially on multi-core machines. The architecture is based on a shared-nothing, multi-threaded design using fibers (boost.fibers) and a custom proactor event loop (epoll/io_uring). Data is partitioned across shards, each with its own thread, and transactions use a VLL-based locking scheme to minimize contention. The system supports replication via a write-ahead journal, cluster mode with slot migration, persistence via RDB snapshots, and tiered storage for offloading cold data to SSD. It also includes a full-text search engine with vector similarity (HNSW), JSON document store, Lua scripting, ACL-based security, and probabilistic data structures (Bloom, Cuckoo, Count-Min Sketch, Top-K). The codebase demonstrates advanced engineering in memory management (custom allocators, SIMD probing, compact object encoding) and concurrency (fiber-aware synchronization, RCU patterns). While primarily an application, it contains research-grade data structures and algorithms, giving it a hybrid character between production service and systems research project.

RATING: 9.5/10 MAINT: active DRIFT: low
â–¸ 4 reusable components found
facebook/zstd ★ 27950 2615 APPLICATION

This repository is the reference implementation of the Zstandard (zstd) lossless compression algorithm, developed and maintained by Meta (Facebook). It is a production-grade C library (`libzstd`) that provides fast, high-ratio compression with configurable speed/ratio trade-offs, including negative compression levels for extreme speed. The library is accompanied by a full-featured command-line tool (`zstd`) that supports compression, decompression, streaming, multi-threading, dictionary training, and interoperability with gzip, xz, lz4, and lzma formats. The architecture is modular: a core library (`lib/`) with separate concerns for common utilities, compression strategies (fast, double-fast, lazy, optimal, long-distance matching), decompression, dictionary building (cover, fastCover), and legacy format decoders (v01–v07). The `programs/` directory houses the CLI entry point and file I/O utilities. The codebase is exceptionally well-tested with unit tests, fuzzing infrastructure, regression tests, and CLI integration tests. While the dominant character is an application/library, it also contains research-grade entropy coders (FSE, Huffman) and experimental contributions (edit-distance match finder, parallel pzstd, seekable format, educational decoder), making it a hybrid resource for both production use and compression algorithm study.

RATING: 9.5/10 MAINT: active DRIFT: low
â–¸ 4 reusable components found
nodejs/llhttp ★ 1941 237 APPLICATION

llhttp is a high-performance HTTP/1.1 parser written in TypeScript that generates optimized C source code via the llparse state machine compiler. It is the parser used by Node.js for handling HTTP requests and responses. The core logic is defined as a finite state machine in TypeScript, which is then compiled to C for maximum performance, achieving around 156% faster parsing than the legacy http_parser. The architecture separates the HTTP line parsing (method, URL, version) from header and chunked body parsing, with a dedicated URL state machine. The parser supports both request and response modes, configurable lenient parsing for non-compliant clients, and exposes callbacks for message begin/end, headers, body, and chunk events. It is distributed as both a native C library and a WebAssembly module, making it usable in diverse environments.

RATING: 9.5/10 MAINT: active DRIFT: low
â–¸ 3 reusable components found
servicetitan/Stl.Fusion ★ 1887 105 APPLICATION

Stl.Fusion is a high-performance .NET framework for building real-time, distributed, and stateful applications. It implements a Distributed REAactive Memoization (DREAM) pattern, where computed values automatically track their dependencies and invalidate when those dependencies change. This enables transparent caching, automatic UI updates, and efficient client-server state synchronization without manual cache management. The framework is architected as a layered set of libraries: Stl (base utilities), Stl.Interception (AOP proxy generation), Stl.CommandR (CQRS command pipeline), Stl.Rpc (full-duplex RPC with WebSocket transport), Stl.Fusion (core compute engine with states and operations), Stl.Fusion.Server (ASP.NET Core integration), Stl.Fusion.Blazor (Blazor components), and Stl.Fusion.EntityFramework (EF Core integration with operation log change tracking). It also includes Redis integration for pub/sub and caching, and a Roslyn source generator for proxy types. The framework is designed for Blazor Server and WebAssembly, microservices, and any .NET application requiring real-time reactivity. It provides extensive test coverage, performance benchmarks showing orders-of-magnitude improvements over traditional caching, and sample applications (TodoApp, HelloCart) demonstrating end-to-end usage.

RATING: 9.5/10 MAINT: active DRIFT: low
â–¸ 5 reusable components found
scylladb/seastar ★ 9393 1713 APPLICATION

Seastar is a high-performance C++ asynchronous framework built on a shared-nothing, reactor-based architecture. It provides core primitives like futures/promises, coroutine support, per-CPU sharding, and a sophisticated I/O scheduler with fair queuing and token-bucket throttling. The framework includes a production-grade networking stack (TCP, UDP, TLS, HTTP, WebSocket, RPC), a custom memory allocator, comprehensive metrics (Prometheus, collectd), and extensive testing/benchmarking infrastructure. Seastar is used by real-world systems such as ScyllaDB, Redpanda, and Ceph Crimson. The codebase is mature, but exhibits some technical debt in the form of deprecated API usage, platform-specific workarounds, and a few license inconsistencies. Overall, it represents a strong example of systems-level C++ engineering with reusable algorithmic components and a well-documented architecture.

RATING: 9.4/10 MAINT: active DRIFT: medium
â–¸ 3 reusable components found
ultrajson/ultrajson ★ 4496 385 APPLICATION

UltraJSON is a high-performance JSON encoder/decoder library for Python, implemented entirely in C with Python bindings. It provides drop-in replacements for Python's standard json module (ujson.dumps, ujson.loads, ujson.dump, ujson.load) and offers configuration options for ASCII encoding, HTML character escaping, forward slash escaping, indentation, sorting keys, NaN/Infinity handling, and customizable separators. The library's core architecture consists of a hand-optimized C state machine for decoding and a recursive encoder that handles Python objects via a type-context system. It bundles a copy of the double-conversion library for precise floating-point serialization and uses a stack-first, heap-later buffer allocation strategy. Despite being in maintenance-only mode due to architectural security concerns, the codebase exhibits strong craftsmanship: meticulous memory management, comprehensive UTF-8 validation, support for surrogate pairs, fuzz testing with ref-count verification, and compatibility with CPython's free-threaded builds. The repository also includes extensive tests, benchmarks, and CI for multiple architectures and Python implementations (CPython, PyPy, GraalPy).

RATING: 9.4/10 MAINT: active DRIFT: low
â–¸ 2 reusable components found
mtrudel/thousand_island ★ 994 59 APPLICATION

Thousand Island is a pure Elixir, OTP-based socket server library inspired by Ranch. It provides a supervision tree (Server → Listener + AcceptorPoolSupervisor → AcceptorSupervisor → Acceptor/DynamicSupervisor → Handler) that handles TCP and SSL connections with configurable concurrency, connection draining, and shutdown semantics. The library exposes a clean `ThousandIsland.Handler` behaviour for application-level protocol logic, and a `ThousandIsland.Socket` abstraction that decorates underlying transport sockets with automatic telemetry instrumentation. It emits rich telemetry spans for listeners, acceptors, and individual connections, supports suspend/resume of connection acceptance, and handles transient network errors and file descriptor exhaustion without crashing the acceptor tree. The code is thoroughly tested and free of external dependencies beyond telemetry, making it both a production-ready server and an exemplar of idiomatic Elixir/OTP patterns.

RATING: 9.4/10 MAINT: active DRIFT: low
â–¸ 3 reusable components found
xtaci/kcp-go ★ 4554 808 APPLICATION

kcp-go is a production-grade, high-performance reliable UDP library for Go, implementing the KCP (KCP Protocol) ARQ protocol. It provides a stream-based interface (net.Conn) over UDP with low latency, high throughput, and packet-level control. The library is widely used in gaming, streaming, and network acceleration (e.g., kcptun). Architecturally, it is layered: an application layer using net.Conn, a session layer (sess.go) managing encryption, FEC, and connection lifecycle, a pure protocol state machine (kcp.go) handling ARQ, retransmission, and congestion control, and a transport layer using raw UDP sockets. The data pipeline for outgoing packets is: App Write -> KCP Send -> KCP flush -> FEC Encode -> Encrypt -> UDP Socket. Incoming: UDP Socket -> Decrypt -> FEC Decode -> KCP Input -> App Read. Key features include: reliable ARQ with fast retransmit, Forward Error Correction (FEC) using Reed-Solomon codes, packet-level encryption (AES, TEA, Salsa20, etc., plus AEAD support), platform-specific optimizations (sendmmsg/recvmmsg on Linux), a global timer scheduler to avoid per-session goroutines, and a buffer pool to minimize GC pressure. The codebase demonstrates exceptional craftsmanship with hand-optimized CFB encryption (8x loop unrolling), a generic ring buffer with dynamic resizing, and an auto-tuning FEC decoder that adapts to peer parameters.

RATING: 9.3/10 MAINT: active DRIFT: low
â–¸ 3 reusable components found
juspay/hyperswitch ★ 44885 6126 APPLICATION

Hyperswitch is a composable open-source payments infrastructure built in Rust that provides a modular platform for processing payments through multiple connectors. The system handles the complete payment lifecycle including authorization, capture, refunds, and dispute management, while offering features like intelligent routing, 3DS authentication, revenue recovery, and analytics. Built with a microservices architecture using Actix-web, it features a plugin-based connector system, event-driven design with Redis/Kafka, and comprehensive SDK support for web and mobile platforms. The codebase demonstrates strong engineering practices with typesafe ID generation, robust encryption utilities, and well-abstracted interfaces that promote reusability and maintainability.

RATING: 9.2/10 MAINT: active DRIFT: low
â–¸ 10 reusable components found
apache/seatunnel ★ 9716 2429 APPLICATION

Apache SeaTunnel is a high-performance, distributed data integration platform designed for synchronizing vast amounts of data across diverse sources and sinks. It provides a unified framework for batch and stream processing with support for Change Data Capture (CDC), schema evolution, and multi-engine execution (SeaTunnel Zeta, Flink, Spark). The platform features a plugin-based architecture with over 160 connectors for databases, message queues, cloud services, and file systems, along with a web-based UI for job monitoring, CLI tools for job submission, and SDKs for programmatic access. Enterprises like JP Morgan, Tencent Cloud, and Bytedance use it for production data integration workloads.

RATING: 9.2/10 MAINT: active DRIFT: low
â–¸ 5 reusable components found
$ loading more...
$ submit: