Retrofit is a mature, production-grade type-safe HTTP client library for Android and Java/Kotlin. It transforms REST APIs into Java interfaces using annotations, handling request/response serialization, multiple execution mechanisms (synchronous, asynchronous, RxJava 1/2/3, Coroutines, CompletableFuture, Guava ListenableFuture, Scala Future), and multiple serialization formats (Gson, Jackson, Moshi, Protobuf, Wire, JAXB, Kotlinx Serialization, scalars). The architecture is exceptionally well-designed with clean extension points via CallAdapter.Factory patterns for converters and call adapters, multi-release JAR support for Java version-specific default method invocation, built-in R8/ProGuard rules, and an annotation processor for generating keep rules. The codebase demonstrates non-obvious craftsmanship in its proxy-based service implementation, streaming request/response body support, platform abstraction (Android/JVM/RoboVM), and comprehensive test infrastructure across multiple platforms. Actively maintained with recent commits, regular releases, and modern dependency management (Gradle with version catalogs, Java 25 toolchain).
This repository is the curl project, consisting of the libcurl library and the curl command-line tool. libcurl is a client-side URL transfer library supporting a wide range of protocols including HTTP, HTTPS, FTP, FTPS, SCP, SFTP, SMTP, POP3, IMAP, LDAP, MQTT, WebSocket, and many more. The curl tool provides a powerful command-line interface for making network requests with extensive options for authentication, SSL/TLS configuration, proxy support, output formatting, and scripting. The architecture is a classic C library with a public API (include/curl/) and a separate CLI tool (src/) that links against the library. Key entry points include curl_easy_perform() for synchronous transfers, curl_multi_perform() for asynchronous multiplexed transfers, and the curl command-line binary. Data flows involve URL parsing, DNS resolution (with support for c-ares, threaded, and DoH), connection establishment via a filter chain (TCP, TLS, HTTP/2, HTTP/3, SOCKS, etc.), protocol-specific handling, and response processing. External dependencies include OpenSSL, GnuTLS, wolfSSL, mbedTLS, Schannel, rustls for TLS; c-ares for async DNS; libssh2/libssh for SSH; nghttp2 for HTTP/2; ngtcp2 and quiche for HTTP/3; and various system libraries. The codebase is exceptionally well-structured, with a modular filter architecture, extensive test coverage (unit, integration, and HTTP test suites), and a strong emphasis on portability across Unix, Windows, macOS, and embedded platforms.
Alamofire is a mature, production-grade HTTP networking library for Apple platforms (iOS, macOS, tvOS, watchOS, visionOS). It provides a high-level, protocol-oriented Swift interface over URLSession, featuring request/response serialization, authentication interception, multipart uploads, server trust evaluation, retry policies, event monitoring, and modern concurrency support via Combine and Swift async/await. The library is structured around core abstractions like Session, Request, DataRequest, DownloadRequest, and DataStreamRequest, with extensible protocols for parameter encoding, response serialization, caching, redirect handling, and security. Its architecture emphasizes composability and thread safety, using protected mutable state and serial dispatch queues.
Crawlee is a comprehensive web scraping and crawling library for Node.js/TypeScript that provides a unified interface for both HTTP-based crawling (using got-scraping with Cheerio/JSDOM/Linkedom) and browser-based crawling (using Playwright/Puppeteer). It features a modular architecture with separate packages for core functionality, specific crawlers, storage abstractions, browser pooling, and utilities. The library handles request queuing, automatic concurrency scaling based on system resources, session management with cookie persistence and fingerprinting, proxy rotation, and robust error handling. It includes built-in mechanisms to avoid bot detection and provides storage abstractions for datasets (structured data), key-value stores (binary data), and request queues (URL frontier). Designed for reliability and scalability, Crawlee supports both local execution and deployment on the Apify platform, with extensive documentation, examples, and CLI tools for project scaffolding.
Fasthttp is a high-performance HTTP/1.1 server and client library for Go, designed as a drop-in replacement for the standard `net/http` package with significantly lower latency and memory allocations. It achieves this through extensive use of `sync.Pool` for object reuse, zero-allocation byte-to-string conversions (`b2s`/`s2b`), stackless goroutine wrappers for compression, and a custom worker pool that keeps CPU caches hot. The library handles both server and client roles, supporting TLS, keep-alive, pipelining, load balancing (via `LBClient`), transparent retries, and streaming request/response bodies. It also provides a rich set of sub-packages for proxy dialing (`fasthttpproxy`), `net/http` adapter (`fasthttpadaptor`), listener reuse (`reuseport`, `tcplisten`), in-memory testing utilities (`fasthttputil`), and prefork process management for multi-core deployments. The architecture is modular: core types (`Server`, `Client`, `HostClient`, `RequestCtx`, `Request`, `Response`, `Headers`, `URI`, `Cookie`, `Args`) are in the root package, while optional features live in sub-packages. The server uses an event-driven, non-blocking I/O model with a worker pool that reuses goroutines and allocates few objects per request. The client maintains connection pools with idle timeout and supports both FIFO and LIFO connection reuse to minimize latency. Extensive test coverage, including fuzz tests and allocation benchmarks, validates correctness and performance across edge cases and shared-nothing concurrency. Fasthttp is production-hardened, powering services like VertaMedia at over 200K requests per second per server with 1.5M concurrent keep-alive connections. It is not a generic web framework but a foundational layer that can be embedded into frameworks (including gin, echo, etc.) via adapters. The codebase demonstrates advanced Go patterns for high-performance I/O, making it a reference for engineers building latency-sensitive network services.
Requests is a widely-used Python HTTP library that provides a simple, elegant API for making HTTP/1.1 requests. It abstracts away the complexities of urllib3, offering features like session persistence, cookie handling, automatic content decoding, SSL/TLS verification, and various authentication mechanisms (Basic, Digest, OAuth via extensions). The library is designed as a set of loosely coupled modules: the public API (api.py) delegates to a Session object (sessions.py) which manages connection pooling and request defaults; the HTTPAdapter (adapters.py) bridges to urllib3; and models.py defines Request, PreparedRequest, and Response objects. The codebase is well-structured, extensively tested, and follows a feature-freeze policy, focusing on stability and compatibility rather than new features. It is not an application or data research project; it is a pure library distributed via PyPI.
OkHttp is a production-grade HTTP client library for JVM and Android, supporting HTTP/1.1, HTTP/2, WebSockets, Server-Sent Events, TLS/SSL, DNS over HTTPS, content compression (gzip, brotli, zstd), caching, cookies, and authentication. It is designed for efficiency with connection pooling, multiplexing, and async execution. The architecture is a multi-module Kotlin/Gradle project with a core library (okhttp) and optional extensions (brotli, zstd, sse, coroutines, logging, DNS over HTTPS, TLS utilities). It uses an interceptor chain pattern for request/response processing, with application interceptors and network interceptors. Platform abstraction handles JVM vs Android differences for TLS, DNS, and sockets. Key entry points include OkHttpClient, Request, Response, Call, Interceptor, EventListener, WebSocket, and EventSource. External dependencies include Okio (I/O library), Kotlin stdlib, and optional TLS providers (Conscrypt, BouncyCastle, OpenJSSE). The library is extensively tested with unit tests, integration tests, and Android device tests.
Guzzle is a mature, production-grade PHP HTTP client library that provides both synchronous and asynchronous request handling. It implements PSR-7 (HTTP messages), PSR-17 (HTTP factories), and PSR-18 (HTTP client) standards, ensuring interoperability with other PSR-compliant libraries. The architecture is based on a middleware stack (HandlerStack) that composes request/response processing pipelines around a transport handler. Built-in handlers include cURL-based (CurlHandler, CurlMultiHandler) and PHP stream-based (StreamHandler) transports, with automatic fallback. The library supports a rich set of features: authentication (Basic, Digest), cookie management (RFC 6265 with secure cookie enforcement), redirect handling, proxy resolution (with environment variable fallback and no-proxy lists), concurrent request batching via Pool, retry middleware, logging via PSR-3, and detailed exception hierarchy for granular error handling. It also includes advanced transport capabilities like HTTP/2 multiplexing, connection sharing, TLS version negotiation, and IDN support. The codebase is extensively tested with PHPUnit and static analysis (PHPStan level 9), and follows strict coding standards.
Axios is a promise-based HTTP client for both browser and Node.js environments. It provides a rich feature set including request/response interceptors, automatic JSON serialization, cancellation via AbortController or legacy CancelToken, progress tracking, CSRF protection, and support for multiple adapters (XHR, HTTP, Fetch). The library is designed with a modular architecture: core classes (Axios, AxiosError, AxiosHeaders, InterceptorManager) handle request lifecycle and configuration merging, while platform-specific adapters handle actual network I/O. A comprehensive set of helper utilities (composeSignals, progressEventReducer, sanitizeHeaderValue, etc.) implement reusable patterns for signal composition, throttled progress events, header injection prevention, and more. The codebase is extensively tested across runtimes (Node, browser, Bun, Deno) and includes security hardening against prototype pollution, SSRF, and CRLF injection. While primarily a library for other applications, its architecture demonstrates strong separation of concerns and many components are independently reusable.
Boost.Beast is a high-performance C++ networking library providing HTTP/1.1 and WebSocket protocol implementations built on Boost.Asio. It is a header-only (with optional separate compilation) library that offers a comprehensive set of vocabulary types, parsers, serializers, stream wrappers, and composed asynchronous operations for building networked applications. The library emphasizes symmetry, ease of use, flexibility, and performance, and includes extensive examples covering synchronous, asynchronous, coroutine (stackful and C++20), and awaitable patterns. It follows the Boost library design conventions and is part of the official Boost collection. The codebase demonstrates high craftsmanship with careful attention to allocators, error handling, executor propagation, and cancellation. While there is some duplication across examples and a few deprecated APIs, the core production headers are well-maintained and actively developed. The library also includes zlib compression for WebSocket permessage-deflate and experimental testing utilities.
Scrapy is a mature, production-grade web scraping and crawling framework for Python. It provides a complete pipeline for downloading web pages, extracting structured data (via XPath/CSS selectors), and exporting it in multiple formats (JSON, CSV, XML, etc.). The architecture is event-driven, built on Twisted with full asyncio integration, and consists of an execution engine, downloader, scheduler, spider middleware, downloader middleware, item pipelines, and extensions. Key entry points include the CLI (`scrapy crawl`, `scrapy shell`, `scrapy startproject`), the `CrawlerProcess`/`CrawlerRunner` classes for programmatic use, and the `Spider` base class for user-defined spiders. Data flows from HTTP requests through the downloader (with support for HTTP/1.1, HTTP/2, FTP, and experimental httpx), through spider callbacks, into item pipelines, and finally to feed exporters or custom storage backends. External dependencies include Twisted, lxml, parsel, w3lib, protego (robots.txt), queuelib, and optional integrations like boto3 (S3), google-cloud-storage, Pillow (image processing), and mitmproxy (testing). The framework is highly configurable via a priority-based settings system and supports plugins (addons, middlewares, pipelines, extensions).
Refit is a .NET library that automatically generates type-safe HTTP API clients from C# interfaces decorated with attributes like [Get], [Post], [Header], [Body], and [Query]. It operates via two parallel request-building paths: a Roslyn source generator that emits inline request construction at compile time (trim/AOT-safe), and a reflection-based fallback for unsupported shapes. The library integrates deeply with Microsoft.Extensions.DependencyInjection and IHttpClientFactory, providing extension methods like AddRefitClient<T> and AddKeyedRefitClient for managed HTTP client lifecycles. It supports multiple serializers (System.Text.Json, Newtonsoft.Json, XML), content compression (gzip, Brotli, Zstandard), streaming responses (IAsyncEnumerable, JSON Lines, SSE), multipart form data, and per-request timeouts and authorization via DelegatingHandler pipelines. The architecture is modular: the core Refit package provides attributes, serialization interfaces, and the runtime GeneratedRequestRunner; Refit.HttpClientFactory adds DI integration; Refit.Newtonsoft.Json and Refit.Xml provide alternative serializers; Refit.Reflection offers the runtime request builder; and Refit.Testing supplies StubHttp and Reply for unit testing without a live server. The source generator (InterfaceStubGeneratorV2) is an incremental generator that parses interfaces and emits partial classes into the consumer assembly, using value-equatable models (ImmutableEquatableArray) for caching. The reflection path caches parsed method metadata and builds requests via delegates, ensuring parity with generated code. Key entry points include RestService.For<T>() for creating clients, AddRefitClient<T>() for DI registration, and RefitSettings for central configuration. External dependencies are minimal: System.Text.Json (built-in), Microsoft.Extensions.Http, and optionally Newtonsoft.Json or System.Xml. The library is extensively tested with unit tests, integration tests, snapshot-based generator tests, and benchmarks measuring allocation and throughput. It targets .NET 8/9/10/11 and .NET Framework 4.6.2+, with polyfills for missing BCL types.
Hoppscotch is an open-source, multi-platform API development ecosystem that serves as a full-featured alternative to Postman. It supports REST, GraphQL, WebSocket, SSE, Socket.IO, and MQTT protocols, with advanced features like pre-request and test scripting (sandboxed), environment variables, team collaboration, mock servers, published documentation, AI assistant, and extensive import/export (Postman, Insomnia, OpenAPI, HAR, cURL). The monorepo is organized into packages: a Vue 3 frontend (hoppscotch-common), a NestJS/GraphQL/Prisma backend (hoppscotch-backend), a Tauri desktop app (hoppscotch-desktop), a Node.js CLI (hoppscotch-cli), a Tauri agent for interceptor (hoppscotch-agent), a shared kernel abstraction layer (hoppscotch-kernel), versioned data schemas (hoppscotch-data), a JavaScript sandbox engine (hoppscotch-js-sandbox), and self-hosted web/admin panels. The architecture emphasizes functional programming with fp-ts, reactive state management via RxJS DispatchingStores, dependency injection with dioc, and a kernel/relay pattern that abstracts HTTP execution across platforms. The codebase is actively maintained with extensive test coverage and demonstrates high craftsmanship in areas like versioned data migration, sandboxed script execution, and cross-platform kernel design.
Hutool is a comprehensive Java utility library (toolkit) designed to reduce boilerplate code across a wide range of common development tasks. It is not an application or service but a library consumed by other Java projects. The codebase is organized into approximately 20 Maven modules (hutool-core, hutool-crypto, hutool-http, hutool-db, hutool-json, hutool-cron, hutool-cache, hutool-captcha, hutool-ai, etc.), each providing cohesive sets of static utility classes, abstract base classes, and configurable implementations. Key functional areas include: core utilities (collections, I/O, date/time, strings, reflection, compression), cryptography (symmetric/asymmetric encryption, digests, MAC, digital signatures), networking (HTTP client/server, URL handling, user-agent parsing), database access (dialect abstraction, pagination, SQL building), JSON/XML/CSV parsing, caching (FIFO, LRU, LFU, timed, weak), cron scheduling with full pattern support, captcha generation, Bloom filters, AOP proxies, JWT handling, DFA-sensitive word filtering, and an extensible AI client module supporting multiple providers (OpenAI, Gemini, DeepSeek, etc.) via SPI. Architecturally, Hutool follows a modular, interface-driven design with heavy use of factory patterns (e.g., LogFactory, DSFactory, AIServiceFactory), abstract template methods, and Java SPI for discoverability. Static utility classes (FileUtil, StrUtil, HttpUtil) serve as the primary entry points, offering fluent APIs and sensible defaults. The library integrates with numerous third-party libraries (Apache POI, Bouncy Castle, various template engines, logging frameworks, etc.) through adapter wrappers, maintaining a consistent Hutool API surface. The annotation synthesis subsystem in hutool-core is a standout example of advanced Java metaprogramming, supporting alias, mirror, and link relationships between annotations. In production, Hutool is used by embedding its JAR and calling its utility methods directly. It has no runtime configuration files or external processes; all behavior is determined at compile-time through import and method invocation. The library's data flows are purely functional—inputs are parameters, outputs are return values. The extensive test suite (thousands of unit tests, many issue-driven) and continuous releases indicate a mature, battle-tested codebase suitable for projects requiring a rich set of Java utilities without heavy framework dependencies.
RestSharp is a mature .NET HTTP client library that wraps HttpClient into a fluent request/response API. It is not a standalone application; it ships as NuGet packages consumed by other projects. The core RestClient handles execution through an async pipeline: interceptors, authenticators, request content construction, cookie containers, redirect handling, and response deserialization. RestRequest models parameters (query, header, body, URL segments, cookies, files) and is built fluently through extension methods. Responses are RestResponse<T> with error aggregation and throw helpers, making failure handling explicit and consistent. The architecture is modular: a core library plus optional serializer packages for Newtonsoft.Json, System.Text.Json, XML, and CsvHelper, a DI integration package for Microsoft dependency injection, and a Roslyn source generator that produces immutable and clone variants of configuration types. Authentication is pluggable via IAuthenticator, with built-in Basic, JWT, OAuth1 signature generation, and OAuth2 client-credentials/refresh-token/token authenticators. Serialization is managed by a registry keyed by data format and content type, with automatic body sniffing between JSON and XML. The codebase multi-targets netstandard2.0, net471, net48, net8.0, net9.0, and net10.0, and includes extensive unit and WireMock-based integration tests, benchmarks, and versioned Docusaurus documentation. Code quality is strong: clean separation of concerns, extensive use of extension methods for ergonomics, custom source generation for option immutability, and a comprehensive test suite covering OAuth1 official vectors, redirect behavior, cookies, serializer edge cases, and interceptor ordering. Some legacy surface remains (obsolete hooks, polyfills for old TFMs), but the project tracks current .NET releases and is actively maintained. This is a well-crafted library that remains one of the standard HTTP client abstractions in the .NET ecosystem.
The POCO C++ Libraries (pocoproject/poco) is a mature, modular collection of reusable C++ class libraries for building network-centric, cross-platform applications. It does not contain a single application; rather, it provides a SDK with libraries for networking (HTTP, TCP, UDP, SSL/TLS), data access (SQLite, MySQL, PostgreSQL, ODBC via unified Data layer), XML/JSON parsing, cryptography (OpenSSL wrappers, JWT), logging (including a FastLogger based on Quill), threading, caching, configuration management, and more. The architecture is layered: Foundation provides core abstractions (streams, threading, events), and higher-level modules (Net, Data, XML, Crypto) depend on it. External dependencies include OpenSSL, MySQL/PostgreSQL client libraries, and ODBC drivers, while many third-party libraries (expat, zlib, quill, cpptrace, 7zip) are bundled in the repository. The codebase is actively maintained with CI, fuzzing, and extensive test suites, and uses modern C++17/20 idioms alongside traditional C++ patterns.
Insomnia is a comprehensive API client built on Electron that supports HTTP, WebSocket, Socket.IO, gRPC, and MCP protocols. It features a modular architecture with separate packages for the main application, data layer, CLI tool, analytics, and scripting environment. The application provides API design, debugging, testing, and collaboration capabilities through workspace/project organization, environment management, import/export functionality, cloud sync, Git integration, and a plugin system. Built with React and TypeScript, it uses NeDB for local data storage and implements sophisticated security measures for secret management and plugin sandboxing.
Mechanize is a mature Ruby library for automating web interactions. It acts as a programmable web browser, enabling users to fetch pages, follow links, submit forms, manage cookies, handle authentication (Basic, Digest, NTLM), and support content compression (gzip, deflate, brotli, zstd). The library wraps `net-http-persistent` for connection management and `nokogiri` for HTML/XML parsing. Key architectural patterns include a pluggable parser system that maps MIME types to response handlers (e.g., `Mechanize::Page` for HTML, `Mechanize::Image`, `Mechanize::Download`), an element matching mixin for filtering links and forms, a robust cookie jar, and an authentication store. Its test suite (over 150 test files) uses a WEBrick-based mock server and servlets to simulate realistic scenarios without network calls. The library is widely used for scraping, testing, and automation in Ruby ecosystems.
FsHttp is a .NET HTTP client library for F# (and C#) that provides a fluent, composable DSL for constructing and sending HTTP requests. It offers both a computation expression (CE) syntax for F# and extension methods for C#, supporting all standard HTTP methods, headers, cookies, multipart form data, file uploads, and various body content types (text, JSON, binary, streams, form-urlencoded). The library wraps System.Net.Http and provides rich response handling including streaming, JSON parsing (System.Text.Json by default, with optional FSharp.Data and Newtonsoft.Json integrations), XML parsing, file saving, and status code assertions. It features a configurable pipeline with transformers for headers, URLs, HttpClient, and HttpRequestMessage, as well as per-request and global configuration. The library is designed for both interactive use (F# Interactive / notebooks) and production applications, with built-in FSI printing and debug logging. The codebase is well-structured with clean domain models, a modular DSL implementation, and comprehensive test coverage using Suave for local test servers.
Bruno is a comprehensive API client and testing tool built with Electron, React, and Redux. It provides a full-featured interface for creating, sending, and analyzing HTTP/WebSocket/gRPC/GraphQL requests, similar to Postman but with an open-source core. The application features a modular architecture with separate packages for the GUI (bruno-app), Electron main process (bruno-electron), CLI (bruno-cli), request handling (bruno-requests), file storage (bruno-filestore), and shared utilities (bruno-common). Key capabilities include environment and variable management with secure secret handling, pre-request and test scripting using a custom BruJS runtime, collection organization and workspaces, import/export from formats like Postman, OpenAPI, and Insomnia, mock server functionality, and code generation from requests. The UI uses styled-components for theming with light/dark/system themes, and incorporates advanced features like AI-assisted request building and OpenAPI synchronization. The codebase demonstrates strong engineering practices with extensive unit and end-to-end testing, TypeScript throughout, and a clean separation of concerns between the main and renderer processes via IPC. Notable reusable components include a secure variable interpolation system, cross-platform detection utilities, persistent state hooks, and a worker-offloaded file format parser.