Reasonix is a local AI coding agent engine written in Go, providing a terminal UI, desktop application (Electron + React), and HTTP server for interacting with large language models (OpenAI, Anthropic, DeepSeek, etc.) to automate software engineering tasks. The kernel manages sessions, context windows, planning, sub-agent delegation, tool execution (file operations, shell, browser, MCP servers), and a sophisticated safety sandbox. It persists conversation history with checkpoints for undo/rewind, tracks token usage, and maintains an evidence ledger for auditing tool effects. The architecture is a monolithic Go binary with multiple frontends: a CLI/TUI, a desktop host that communicates via SSE/JSON, and a REST API server. A plugin system using the Model Context Protocol (MCP) allows extension. Separate Cloudflare Workers handle account management, forum, and crash reporting. The codebase is well-structured with a clean layered architecture (base utilities, domain contracts, state persistence, runtime agent, assembly wiring, frontends), extensive test coverage, and internal linters enforcing quality. It is actively maintained with frequent commits and professional CI/CD pipelines.
This repository is a comprehensive, multi-package AI agent framework developed by LangChain, known as 'Deep Agents'. It provides a production-ready SDK ('deepagents') built on LangGraph for creating stateful, middleware-driven agents with capabilities such as filesystem manipulation, shell execution, memory, sub-agents, skills, human-in-the-loop, and summarization. The primary client is a high-quality CLI/TUI application ('deepagents-code') that offers an interactive coding assistant with a rich Textual terminal interface, plugin system, MCP OAuth integration, and sandboxed execution via multiple providers (Daytona, Modal, Runloop, Vercel). A deployment CLI ('deepagents-cli') manages agent lifecycle on LangSmith, and an experimental persistent runtime ('talon') supports cron jobs, voice, and channels like Telegram/WhatsApp. A comprehensive evaluation suite ('evals') includes benchmarks (FRAMES, Nexus, BFCL, tau2, MemoryAgentBench, Context-Bench, DRBench) with LLM-as-judge, trajectory scoring, and LangSmith reporting. The architecture emphasizes modularity: middleware stack, hooks system, backend protocols, and profile system. While primarily an application, the evals and dataset curation give it a hybrid character.
Dify is an open-source LLM application development platform that serves as a visual workflow builder, agent orchestration engine, RAG pipeline, and LLMOps backend-as-a-service. In production, it enables users to create, deploy, and monitor AI-powered applications including chatbots, text generation, autonomous agents, and complex multi-step workflows. The architecture is a monorepo consisting of a Python/Flask API backend with SQLAlchemy and Alembic migrations, a Next.js web console, a TypeScript CLI (difyctl), a Go-based agent runtime sandbox, and shared packages for contracts and UI components. Key entry points include the console web app for building and managing apps, the service API for integrating external systems, and the OpenAPI surface for third-party clients. Primary data flows involve user authentication, workflow execution (triggered by APIs, schedules, or webhooks), knowledge ingestion and retrieval (document extraction, chunking, embedding, vector search), and agent invocation (tool calls, LLM interactions). External dependencies include multiple vector databases (pgvector, Qdrant, Weaviate, etc.), LLM providers (OpenAI, Anthropic, etc.), object storage (S3, Azure Blob, etc.), Redis, Celery, and various observability backends (OpenTelemetry, Langfuse, etc.). The platform supports multi-tenancy, RBAC, billing, and enterprise features, and is deployed via Docker Compose, Kubernetes, or cloud-specific distributions.
Ollama is a local LLM serving platform written in Go. It provides a REST API (OpenAI-compatible), CLI, TUI chat, and desktop application for running large language models locally. The system supports multiple inference backends: llama.cpp (CPU/CUDA/ROCm/Vulkan) and MLX (Apple Silicon). It includes a model conversion pipeline from HuggingFace safetensors to GGUF format, GPU hardware discovery, and an agent framework with tool execution (bash, file operations, web search). The architecture is a monolith with subprocess management for inference backends. Key entry points include the CLI (main.go), HTTP server (server/routes.go), runner binary (cmd/runner/main.go), and desktop UI (app/ui/app/). The codebase is actively maintained with extensive test coverage and support for dozens of model architectures. While primarily an application, it has significant data/research components in model conversion, tokenization, and speculative decoding research.
Nanobot is a self-hosted, open-source personal AI assistant framework that operates as a full-stack application. The Python backend provides an agent loop with tool execution, session management, multi-provider LLM orchestration (OpenAI, Anthropic, etc.), and a plugin system for 18+ messaging channels (Telegram, Discord, Slack, WeChat, Feishu, etc.). It exposes a WebSocket-based gateway, an OpenAI-compatible API, and a CLI. Two frontends exist: a rich WebUI built with React/TypeScript/Vite/Tailwind and a terminal TUI built with Bun/OpenTUI. The architecture is event-driven via a message bus, with decoupled channel adapters, provider abstraction, and a config system supporting hot-reload. It includes security features like workspace sandboxing, credential redaction, and SSRF protection. The codebase is extensively tested (hundreds of unit/integration tests) and demonstrates strong engineering practices with clean abstractions, though its large dependency surface and multiple frontends introduce some maintenance surface area.
Qwen Code (formerly Gemini CLI) is an open-source, multi-platform AI coding assistant designed to operate in the terminal, web shell, desktop (Tauri), VS Code, JetBrains, and chat channels (DingTalk, WeChat, Slack, etc.). The architecture is a monorepo with ~30+ packages centered around a core library (`packages/core`) that provides agent runtime, tool orchestration, memory, MCP support, and telemetry. The primary entry points are the CLI (`packages/cli` with an Ink-based TUI), the web shell (`packages/web-shell`), and a daemon server (`packages/cli/src/serve/`) that exposes REST/SSE endpoints for session management, file editing, and sandboxed shell execution. The system supports multiple LLM providers (OpenAI, Anthropic, Gemini, DeepSeek, etc.) and features sub-agents, goal-oriented workflows, approval modes, browser automation (CUA driver in Rust), and a Java managed-agent server for enterprise deployments. Data flows are user-to-agent: user input enters via a client (CLI, web, IDE), is processed by the core agent loop, which invokes tools (shell, file system, LSP, MCP servers) and streams responses back. External dependencies include Node.js v22+, pnpm, and platform-specific native binaries (Rust CUA driver, Electron desktop). The codebase is actively maintained with daily commits, extensive integration tests, and CI/CD pipelines. While it is a software application, it includes telemetry modules and a few Python scripts for benchmark analysis, but no research-grade data pipelines or ML training code.
OGX (formerly Llama Stack) is a production-grade, open-source AI inference platform that provides a drop-in replacement for the OpenAI API. It is a multi-provider API gateway supporting chat completions, embeddings, the Responses API (agentic turns with tool use), vector stores, file processing, conversations, prompts, skills, and connectors. The system is built on a clean provider plugin architecture where inline (built-in) and remote providers (30+ including Anthropic, Bedrock, Gemini, Ollama, vLLM, NVIDIA) are registered via ProviderSpec and dynamically routed. The FastAPI server auto-discovers API protocols and generates routes with telemetry (OpenTelemetry), authentication, multi-tenancy, and ABAC access control. The repository includes a Next.js admin UI, a Python CLI, OpenAPI-generated client SDKs (Python, TypeScript), benchmarking tools (RAG eval, vertical scaling), and comprehensive integration tests with recording/replay. It is designed for self-hosted or cloud deployment with Kubernetes and Docker support.
Thunderbolt is a full-stack, cross-platform AI chat and agent client built by Mozilla Thunderbird. It ships as a React/Vite web app, a Tauri desktop shell (macOS/Windows/Linux), native iOS/Android apps, and a Bun-based CLI. The system provides chat with multiple LLM providers (OpenAI-compatible, Anthropic, custom Tinfoil enclave), a skills system for user-defined slash-command instructions, voice mode with STT/TTS, MCP tool integration, ACP (Agent Client Protocol) remote agent support, and a widget system for rich chat outputs (weather, maps, citations, document previews, link previews). The backend is an Elysia/Bun server handling OIDC/SAML/OTP auth, an inference usage ledger with signed receipts, a CORS-bypassing proxy with streaming, and PowerSync sync coordination. Data flows from local SQLite (wa-sqlite/bun-sqlite) through an E2E-encrypted PowerSync pipeline to PostgreSQL, with device registration, envelope key storage, and canary proof-of-possession for recovery. The CLI provides a separate agent harness with iroh P2P transport, device-grant auth, and a workspace jail for safe file operations. The repo also contains a substantial AI evaluation framework (scenario-based scoring with Wilson confidence intervals), a Pulumi/K8s/Docker deployment stack, and a marketing/docs site in Astro. While the dominant character is clearly an application, it has a notable data-engineering flavor in its inference usage tracking, eval harness, and telemetry pipelines.
OpenRath is a framework for building LLM-powered AI agent applications with a torch-like API design. It centers on the Session abstraction (analogous to a Tensor) that flows through Sandboxes (execution environments), Memories (persistent state), and Tools (callable operations), orchestrated by Agents and Workflows. The framework provides session lineage tracking, sandboxed tool execution, memory persistence, and LLM provider abstraction, enabling the creation of multi-agent workflows with durable state and traceable provenance. The architecture is modular and extensible, featuring pluggable backends for sandboxes (local, OpenSandbox) and memory systems (local, OpenViking), a registry pattern for dynamic backend loading, and lazy evaluation of sessions for performance. Key innovations include write-ahead logging for crash-resistant session persistence, resource-keyed parallelism for safe concurrent tool execution, and unified garbage collection across session, sandbox, and memory domains. The framework is designed for production use, with extensive testing, clear documentation, and active maintenance.
This is the official Gemini CLI by Google, a terminal-based AI assistant that brings Gemini models to the command line. It is a large TypeScript monorepo with packages for the CLI (interactive UI built on Ink/React), core agent logic (context management, tool execution, routing, policy enforcement), SDK for programmatic agent sessions, A2A server for agent-to-agent communication, and supporting tooling (devtools, test utilities, caretaker agent for automated issue triage). The CLI supports slash commands, extensions (hooks, MCP servers, themes), skills, sandboxed execution, multiple authentication methods (OAuth, API key, Vertex AI), and rich terminal features like themes, keybindings, and mouse support. It includes an extensive evaluation framework for behavioral testing of agent capabilities. The architecture is modular with clear separation between UI, core agent loop, and extensibility layers, though the monorepo size introduces some coupling and test fragility.
Microsoft Semantic Kernel is an AI orchestration SDK for building multi-agent systems, process workflows, and LLM-powered applications. It provides a unified abstraction layer over multiple AI providers (OpenAI, Azure, Google, Mistral, Ollama, HuggingFace, etc.) and supports function calling, plugin systems, prompt templates, memory/vector stores, and content safety filters. The framework is implemented in both Python and .NET with consistent architectural patterns. In production, the system acts as a library that developers embed into their applications. The central Kernel class manages service registration, plugin loading, and function execution. Agents (ChatCompletionAgent, AzureAIAgent, etc.) provide conversational interfaces with tool-calling capabilities. The process framework enables event-driven, multi-step workflows with state persistence. The filter system allows cross-cutting concerns like logging, moderation, and quality checks to be injected into function invocation and prompt rendering pipelines. Key entry points include the Kernel class, agent classes, ProcessBuilder for workflows, and various sample scripts. Data flows typically involve user input being processed by an agent or kernel, which invokes AI services via connectors, optionally calls plugins/functions, and returns responses. The framework relies on external AI services, vector databases, and optionally Dapr for distributed process execution. While primarily an application framework, Semantic Kernel includes data/research-oriented components such as vector store integrations, embedding generation services, and quality evaluation filters, making it a hybrid tool suitable for both production AI applications and experimental research.
Haystack is an open-source Python framework for building production-ready LLM applications. It provides a modular, component-based architecture where data processing steps (converters, embedders, retrievers, generators, evaluators, etc.) are connected into pipelines or agents. The framework includes over 100 built-in components, support for 50+ integrations (OpenAI, Anthropic, Azure, HuggingFace, etc.), async execution, streaming, serialization, evaluation, and observability. It is designed for RAG, semantic search, question answering, autonomous agents, and multimodal applications. The code is well-structured with consistent patterns (component decorator, lifecycle methods, serialization protocols), extensive test coverage, and security hardening (fuzzing, sandboxed Jinja2, deserialization allowlists).
Atomic Chat is a full-featured desktop application for running local large language models and connecting to cloud AI providers. Built with Tauri v2 (Rust backend) and a React/TypeScript frontend, it provides a unified chat interface, agent mode with tool execution, MCP server integration, model hub, and an OpenAI-compatible local API server. The application supports multiple inference backends (llama.cpp, MLX, Apple Foundation Models) and handles model downloads, hardware detection, and agent orchestration. It includes extensive testing, telemetry (PostHog/Sentry), and a plugin architecture for extensibility. The codebase demonstrates clean separation of concerns through a service hub pattern, consistent state management with versioned persistence, and robust resource handling for MCP lifecycle and grammar-safe tool calling. Some duplication exists between two llama.cpp provider plugins, but overall architecture is well-structured.
The Vercel AI SDK is a comprehensive TypeScript monorepo providing a unified, provider-agnostic interface for building AI-powered applications. It abstracts interactions with dozens of LLM providers (OpenAI, Anthropic, Google, Mistral, Cohere, xAI, etc.) behind a consistent API for text generation, streaming, structured output, image/video generation, speech, transcription, embeddings, and tool calling. The architecture is modular: a core `ai` package exposes high-level functions (`generateText`, `streamText`, `generateImage`, `embed`, `transcribe`, `ToolLoopAgent`, `HarnessAgent`) and a middleware system, while separate `@ai-sdk/provider` packages define versioned model interfaces (v2–v4) and `@ai-sdk/provider-utils` provides shared utilities for schema validation, error handling, and HTTP. Each provider lives in its own package (e.g., `@ai-sdk/openai`, `@ai-sdk/anthropic`) with model-specific options and error handlers. The SDK also includes a harness/agent framework (`@ai-sdk/harness`) for integrating external coding agents (Claude Code, Codex, Cursor, GitHub Copilot, etc.) with sandboxed execution and workflow orchestration, plus UI integrations for React, Vue, Svelte, and Angular. Key data flows involve constructing prompts, calling provider APIs via fetch, streaming responses as Server-Sent Events or ReadableStreams, and transforming messages between model and UI formats. External dependencies include provider API endpoints, Zod for schema validation, and OpenTelemetry for telemetry.
PaperQA2 is an agentic retrieval-augmented generation (RAG) system for scientific literature. It answers questions by searching, indexing, and analyzing PDFs, text documents, and clinical trials using a multi-step agent workflow. The system integrates with multiple scholarly metadata providers (Crossref, Semantic Scholar, OpenAlex, Unpaywall) for DOI resolution, citation counts, retraction detection, and journal quality scoring. It supports multiple LLM backends via LiteLLM, pluggable PDF readers (pypdf, PyMuPDF, Docling, Nemotron), and vector stores (Numpy, Qdrant). The architecture is a Python library with a CLI (`pqa`), featuring a hierarchical Pydantic settings system, an agent framework with tool selection and memory, and a plugin-based document parsing pipeline. While primarily an application, it is research-backed with published benchmarks (LitQA2, LFRQA) and includes config presets for different quality/performance trade-offs.
OxyGent is a production-grade Python multi-agent system (MAS) framework that unifies LLMs, agents, tools, and flows into a declarative component model. It provides a runtime container (MAS) that orchestrates agent loops (ReAct, Chat, Workflow, PlanAndSolve, Parallel, Reflexion), tool execution (via MCP protocol, FunctionHub decorators, HTTP tools, bank tools), and communication (SSE streaming, A2A protocol for cross-framework interop). The framework ships with a FastAPI web service offering chat, evaluation, prompt management, and SSE endpoints, as well as a built-in web UI. A reference application, OxyBank, demonstrates full-stack data annotation with document ingestion, vector search (Vearch), and annotation agents. The architecture is plugin-based: components reference each other by name, and the MAS container handles lifecycle, wiring, and persistence (Elasticsearch, Redis, Vearch, local fallbacks). OxyGent supports distributed deployments via SSEOxyGent and A2AClientAgent, and integrates with LangChain, LangGraph, AgentScope, and Google A2A SDK. The codebase is well-tested with unit, integration, and regression tests, and includes extensive bilingual documentation.
MiroThinker is a deep research agent framework designed for complex, multi-step tasks requiring external tool use. The system orchestrates LLM reasoning with a modular suite of MCP (Model Context Protocol) tools including web search, code execution, vision, audio, and reasoning capabilities. It features sophisticated context management through failure experience summarization and sliding window truncation to handle long conversations. The agent iteratively generates tool calls, executes them via MCP servers, and integrates results until producing a final answer. The repository includes benchmark evaluation scripts for GAIA, BrowseComp, HLE, and other research benchmarks, trace collection utilities for model improvement, and a Gradio demo for interactive use. Architecture centers on an orchestrator managing the agent loop, a pipeline for step execution, tool executors handling MCP server interactions, and LLM abstractions supporting Anthropic and OpenAI APIs with prompt caching.
Golem is a production-grade, self-evolving GeoAI agent purpose-built for geospatial (GIS) workflows. It bridges natural language with professional GIS tooling (GDAL, PostGIS) and operates as a standalone application with three access modes: a terminal TUI (Bubbletea), an embedded WebUI (Vue.js), and multi-channel IM bots (Telegram, Discord, Slack, Feishu, WhatsApp, QQ, DingTalk, MaixCam). The architecture is a modular monolith in Go, centered around an agent loop that processes messages, executes tools via a guarded registry, enforces policy (strict/relaxed/off), and supports human-in-the-loop approval. It includes a message bus for decoupling, a session manager for persistent conversation history, and a context builder that dynamically composes system prompts from workspace files with cache invalidation. The system also features a learned pipeline reuse mechanism, a spatial SQL codebook with verified PostGIS patterns, and a skill telemetry system for self-improvement. While primarily an application, it incorporates data-intensive components like the geo codebook and pipeline learning, giving it a hybrid character with a strong application dominance.
AstrBot is a production-grade, multi-platform LLM chatbot framework and development platform. It connects to 10+ instant messaging platforms (QQ, Telegram, Discord, Slack, WeChat, Lark, etc.) via adapter pattern, integrates with 20+ LLM providers (OpenAI, Anthropic, Gemini, DashScope, etc.), and provides a plugin system (Stars) with command/regex/filter decorators. The architecture is a modular monolith: a FastAPI backend serves a Vue 3 dashboard for management, while a pipeline of stages processes incoming messages through waking checks, rate limiting, content safety, LLM interaction, and response delivery. It includes a knowledge base with RAG (FAISS vector store, chunking, hybrid retrieval), agent runners (Dify, Coze, DeerFlow), sandboxed code execution (computer use), TTS/STT, cron jobs, and a CLI. The codebase is well-structured with extensive test coverage, but its broad scope introduces some duplication and deprecated modules.
This repository is Microsoft's Agent Governance Toolkit, a production-grade multi-language framework (Python, TypeScript, Rust, Go, .NET) for enforcing policy, identity, trust, audit, and sandboxing on autonomous AI agents. In production, it intercepts agent tool calls, messages, and delegations before they reach external services, evaluating them against declarative policies (OPA, Cedar, or custom backends) with deterministic outcomes (allow/deny/escalate/transform). The system provides a full governance plane including a Rust-based policy engine (Agent Control Specification), a service mesh (AgentMesh) with API gateway, trust engine, policy server, and audit collector, a hypervisor for execution rings and sandboxing (Docker, Hyperlight, Nono), compliance verification (OWASP, EU AI Act), SLO monitoring, and a plugin marketplace. Integrations exist for LangChain, CrewAI, AutoGen, OpenAI Agents, Semantic Kernel, MCP, and many other frameworks. The toolkit is deployed as CLI tools (`agt`, `agentmesh`, `agentos`), Docker containers with sidecar patterns, Kubernetes charts, and VS Code/Chrome extensions. The architecture is polyglot with a shared policy engine core written in Rust; the Python SDK is the richest, with the .NET and Go SDKs covering governance middleware and lifecycle management. The codebase is heavily tested with 992 conformance tests across 10 formal specs, fuzzing targets, and CI gates enforcing deterministic policy outcomes, fail-closed behavior, and no-stub registration.