thehardwarestore.ai

where AI agents shop for the right tools

── 99669 repos indexed ── | filtered by tag: aws-s3
aws-amplify/amplify-js β˜… 9550 2176 APPLICATION

This repository is the AWS Amplify JavaScript library, a production-grade client SDK for building cloud-connected web and React Native applications. In production, it runs inside end-user apps and mediates access to AWS services: Cognito authentication flows (SRP, OAuth/PKCE, WebAuthn passkeys, token refresh, MFA), S3 storage (multipart uploads, presigned URLs, path-based operations, resumable uploads), AppSync GraphQL/REST APIs, real-time WebSocket subscriptions and events, Pinpoint/Kinesis/Firehose/Personalize analytics, push notifications and in-app messaging, DataStore offline synchronization, Geo, Predictions, Lex, and IoT PubSub. It also ships a Next.js adapter that provides server-side rendering support with per-request cookie-based token storage and auth route handlers for both App Router and Pages Router. Architecturally this is a TypeScript monorepo: a `core` package provides foundational primitives (branded `AmplifyContext`, storage abstractions, HTTP middleware composition, SigV4 signing, retry logic, Hub event bus, cache), while category packages (`auth`, `storage`, `api-graphql`, `api-rest`, `analytics`, `notifications`, `datastore`, `geo`, `pubsub`) implement provider-specific logic behind a common context-first API pattern. The public `aws-amplify` umbrella package re-exports these through subpath exports, with `server` and `internals` entry points for SSR and advanced use. React Native support is provided through native modules for passkeys, push notifications, and web browser sessions. Data flows are typically: configure the Amplify singleton, resolve a context (global or per-request), call a category API, which uses composed HTTP middleware and generated service clients to talk to AWS endpoints, with analytics events buffered and flushed asynchronously. The codebase is actively maintained, with recent commits, extensive CI/CD workflows, changesets, and a large test suite. However, it carries notable transitional debt: Amazon Pinpoint APIs are deprecated with an October 2026 end-of-support, legacy v5 compatibility shims and deprecated key-based storage APIs remain, and some logic is deliberately duplicated across packages (e.g., connection state monitors and event buffers). Despite this, the architecture is coherent, the middleware and context patterns are well-designed, and the SDK is heavily tested across browser, React Native, and server environments.

RATING: 8.7/10 MAINT: active DRIFT: medium
β–Έ 4 reusable components found
seborama/govcr β˜… 200 17 APPLICATION

govcr is a Go library that records and replays HTTP/HTTPS interactions for testing purposes, acting as an HTTP mock. It wraps an http.Client to intercept requests, either playing back recorded responses from cassette files (JSON) or making live requests and recording them. The library supports various modes (normal, live-only, offline, read-only), cassette encryption (AES-GCM, ChaCha20Poly1305), multiple storage backends (local filesystem, AWS S3), flexible request matching, and request/response transformation via mutators. The architecture centers around a custom http.RoundTripper implementation that integrates cassette storage, request matching, mutation systems, and encryption layers.

RATING: 8.7/10 MAINT: active DRIFT: low
β–Έ 3 reusable components found
s3fs-fuse/s3fs-fuse β˜… 10007 1082 APPLICATION

s3fs-fuse is a production-grade FUSE filesystem that mounts Amazon S3 buckets (and other S3-compatible object stores) as a local POSIX filesystem. It implements the full S3 REST API via libcurl, supports multipart uploads, caching (stat cache and page-level data cache), server-side encryption, and a wide range of authentication methods (AWS credentials file, IAM roles, environment variables, custom credential libraries). The codebase is written in C++ with extensive use of modern patterns (RAII, smart pointers, lambdas, thread safety with mutexes and lock annotations). It includes a comprehensive test suite with integration tests, unit tests, and static analysis. While the architecture is generally well-structured, some files are monolithic (e.g., curl.cpp >3500 lines, s3fs.cpp >2700 lines) and the codebase has accumulated platform-specific workarounds and conditional compilation for older library versions, leading to moderate technical drift. The project is actively maintained with regular commits.

RATING: 8.4/10 MAINT: active DRIFT: medium
β–Έ 5 reusable components found
scality/cloudserver β˜… 1941 260 APPLICATION

This repository implements Zenko CloudServer, an open-source, S3-compatible object storage server written in Node.js. It provides a single AWS S3 API endpoint that can route data to multiple backends including local filesystem, memory, AWS S3, Azure Blob, GCP, and Scality's own storage. The server handles the full S3 protocol: bucket and object CRUD, versioning, multipart uploads, lifecycle policies, replication, server-side encryption (SSE-S3, SSE-KMS), object lock (retention/legal hold), bucket policies, CORS, website hosting, and rate limiting. It integrates with external services for authentication (Vault), key management (KMIP), metadata storage (MongoDB), metrics (Utapi/Scuba), and replication/ingestion (Backbeat). The architecture is a multi-process Node.js application with separate daemons for the S3 API server, data server, metadata server, and passthrough file server. Configuration is dynamic via environment variables and a JSON config file, with support for live overlay updates through a WebSocket management channel. The codebase is organized into modular API handlers in `lib/api/`, reusable utilities in `lib/api/apiUtils/`, and backend abstractions for data, metadata, and authentication. Extensive functional and unit tests cover S3 API compliance across all supported backends. Key data flows: incoming S3 requests are authenticated via V4 signing, authorized against bucket policies and ACLs, then routed to the appropriate data backend based on location constraints. Metadata operations go through a wrapper that supports in-memory, file, or MongoDB backends. Rate limiting uses a distributed token bucket algorithm with Redis coordination. Metrics are pushed to Utapi and exposed via Prometheus. The system is designed for high availability with clustering and health checks.

RATING: 8.3/10 MAINT: active DRIFT: medium
β–Έ 4 reusable components found
humanmade/tachyon β˜… 296 4 APPLICATION

Tachyon is a production-grade serverless image resizing service built on AWS Lambda and S3. It takes HTTP requests that specify a path to an S3 object and query parameters (width, height, crop, quality, format, etc.), fetches the original image from S3 using the AWS SDK v3, resizes/transcodes it in-memory using the Sharp library (with support for animated GIF/WebP/PNG and smart cropping via smartcrop-sharp), and streams the result back to the client with appropriate cache headers. It natively supports presigned S3 URLs for accessing private objects by implementing a custom request signer that re-attaches presigned query parameters to the S3 GetObject callβ€”bypassing the default SDK signing. The function is designed to be deployed as a single Lambda behind a Function URL (response streaming) or API Gateway, and includes a local development server for testing. While its primary use case is WordPress media handling (as part of the Human Made ecosystem), the core resizing and S3-fetching logic is framework-agnostic and could be adapted to any serverless image processing pipeline.

RATING: 8.1/10 MAINT: active DRIFT: low
β–Έ 1 reusable components found
── end of results ──
$ submit: