Apache SkyWalking is an open-source APM (Application Performance Monitoring) system designed for microservices, cloud-native, and container-based architectures. It provides distributed tracing, metrics aggregation, log analysis, and profiling capabilities (including eBPF, async-profiler, and JFR). The system features a modular, plugin-based architecture where receivers ingest telemetry data, analyzers process it, storage plugins persist it, and query services expose it via GraphQL, PromQL, LogQL, and TraceQL interfaces. Alarm mechanisms detect anomalies and trigger notifications through multiple channels. The codebase demonstrates strong engineering practices with clear separation of concerns, extensive use of interfaces and dependency injection, and reusable patterns like the module system, storage abstraction, and analysis listener framework.
Logflare is a production-grade, multi-tenant log management platform (now part of Supabase) built with Elixir/Phoenix. It ingests logs via HTTP, gRPC (OTLP), WebSockets, and platform-specific drains, processes them through a rule engine, and routes them to user-configured backends including BigQuery, ClickHouse, Postgres, S3, and many more. The architecture is a monolithic Elixir application with internal subsystems: an ETS-backed ingest queue for high troughput, Broadway pipelines for batched ingestion, a behaviour-driven adaptor system for pluggable storage backends, a custom query languagte (LQL) with a parser and dialect transformers, a distributed cache layer via Cachex and WAL busting, and Rust NIFs for performance-critial mapping and Arrow IPC. It includes a full web UI (Phoenix LiveView), a REST API (OpenAPI-documented), billing with Stripe, team management, and alerting. The codebase is largte (1700+ files) and mature (100+ database migrations), with extensive test coverage, benchmarks, and CI/CD pipelines. While predominantly an application, it also exhibits data engineerig aspects with its focus on high-volume log ingstion, schema evolution, and query optimization.
This is a full-stack AI chat platform (DIAL Chat) built as a monorepo with a NestJS backend-for-frontend (BFF) and a React single-page application. The backend proxies all requests to an external DIAL Core service, handling authentication (OIDC providers, cookie sessions, header tokens, CSRF), configuration aggregation (env, static defaults, feature flags), file management (upload, archive download, sharing, batch operations), conversation lifecycle (CRUD, streaming with SSE, naming, publishing/unpublishing, sharing by invitation), and skills/prompts/toolsets management with manifest import/export. The frontend provides a rich chat UI with conversation panel, attachment input with canvas for previewing PDFs, Office docs, images, and MCP app iframes, a catalog browser for models/agents/toolsets, scheduled tasks with recurrence forms, skill and prompt editors, usage limits dashboards, and overlay embedding for third-party host apps. Both apps share extensive typed libraries (22 private packages) covering the catalog, conversation hooks, shared UI components, and a generated OpenAPI client. The system follows a strict BFF pattern: the frontend never communicates directly with DIAL Core—all API calls go through the NestJS server, which adds session validation, resource ownership checks, and caching. Streaming chat completions use server-sent events (SSE) with a consistent init payload format. The overlay embedding protocol uses postMessage with a documented state machine, feature flags gated by backend configuration. Observable telemetry via OpenTelemetry instruments HTTP lifecycle, generation metrics, and runtime diagnostics with Prometheus endpoints. The codebase is thoroughly tested (Vitest for frontend, Supertest for NestJS integration, browser-level CSP tests) and includes CI/CD pipelines for OpenAPI regeneration, deployment, and e2e testing. Architecture is modular: domain-specific NestJS services are split into focused sub-services (e.g., ConversationsService delegates to ConversationListingService, ConversationPersistenceService, ConversationLifecycleService, ConversationStreamingService). React contexts are used for state management (no Redux), with custom hooks for entity operations. The monorepo leverages Nx for task orchestration, dependency graph enforcement, and bundle budget checks in libraries. External dependencies include DIAL Core (for AI model inference and file storage), various OIDC providers, and optional libraries like MCP UI client for sandboxed app rendering.
This is the OpenTelemetry Collector Contrib repository, a large monorepo of optional components extending the OpenTelemetry Collector. It provides receivers, processors, exporters, extensions, and connectors for collecting, processing, and exporting telemetry data (traces, metrics, logs, profiles). The codebase is written in Go and follows a consistent component factory pattern with metadata-driven code generation. It integrates with dozens of external systems (AWS, Azure, GCP, Kafka, Elasticsearch, Prometheus, Kubernetes, databases, etc.) and includes a domain-specific transformation language (OTTL) and a log pipeline framework (Stanza). The architecture is modular, with each component self-contained in its own package. The repository is actively maintained with frequent commits, extensive CI, and a well-structured build system.