TraceAI is a multi-language (Python, TypeScript, Java, C#) OpenTelemetry-based instrumentation SDK for AI/LLM applications. It provides drop-in auto-instrumentation for 50+ LLM providers, agent frameworks (LangChain, LlamaIndex, CrewAI, AutoGen, etc.), and vector databases (Pinecone, ChromaDB, Qdrant, etc.). The core library wraps SDK calls to capture structured spans with semantic attributes (tokens, model, messages, tool calls) and exports them via OTLP to any OpenTelemetry-compatible backend, with a default hosted backend at Future AGI. The architecture is a monorepo with per-framework packages that follow a consistent instrumentor pattern: register a tracer provider, instrument the target library, then make API calls. Key entry points are `register()` (Python/TypeScript), `TraceAI.init()` (Java), and `TraceAI.Register()` (C#). The SDK also includes context attribute propagation, PII redaction, evaluation tags, and configurable masking. While the codebase is well-structured and actively maintained, there is significant duplication across framework instrumentors and some tests rely on heavy mocking, which limits reusability of individual components.
This repository is a static website for a Chinese-language educational course titled 'Deep Agents 实战' (Deep Agents in Action). It provides 16 chapters of technical content on building AI agents using LangChain and LangGraph, including text, video links, and downloadable PDFs. The site is built with Astro 6, Tailwind CSS 4, and TypeScript, and is deployed to GitHub Pages via GitHub Actions. The codebase is well-structured: content is authored in Markdown under `content/`, metadata is managed in `scripts/chapters.json`, and a preprocessing script injects frontmatter into the Astro content collection. Custom Astro components handle layout, navigation, theme toggling, and a responsive table of contents. The repository also includes CI/CD workflows for asset validation and cross-platform installation testing. While the primary purpose is educational content delivery, the build and content pipelines demonstrate reusable patterns for static site generation with Astro.
This repository is a comprehensive collection of examples, tutorials, and applications demonstrating how to use LanceDB (a vector database) for various AI/ML applications. It showcases patterns for retrieval-augmented generation (RAG), multimodal search, chatbots, recommendation systems, and AI agents. The repository contains both Python and JavaScript/TypeScript implementations, with many examples featuring web interfaces using Streamlit, Gradio, or React. While it serves as a valuable resource for learning LanceDB integration patterns, the quality varies across examples, and some content is marked as archived.
This repository is a comprehensive, educational collection of 42+ Jupyter notebooks and runnable scripts demonstrating a wide array of Retrieval-Augmented Generation (RAG) techniques. It is primarily a data_research and educational resource, not a deployable application or library. The codebase serves as a practical cookbook for engineers and researchers, covering the full RAG stack from basic chunking and retrieval (e.g., simple RAG, BM25) to advanced methods like GraphRAG, Self-RAG, HyDE, RAPTOR, and agentic RAG. It also includes a dedicated evaluation framework with notebooks and reusable scripts for measuring faithfulness, relevance, and correctness using tools like DeepEval and custom LLM judges. The architecture is modular, with a shared helper_functions.py providing common utilities for PDF loading, embedding, and retrieval, and an evaluation/ module offering reusable evaluation pipelines. The runnable scripts in all_rag_techniques_runnable_scripts/ provide cleaner, class-based implementations of the techniques that are more suitable for integration into other projects than the notebooks themselves. While the code is well-structured for an educational project and demonstrates high craftsmanship in its reusable components, it is not designed for production deployment. Reproducibility is limited by the lack of a pinned dependency file and reliance on external API keys. The repository is actively maintained and highly influential (29k+ stars), making it a valuable reference for anyone building or evaluating RAG systems.
This repository is a comprehensive Chinese-language educational tutorial and codebase for Retrieval-Augmented Generation (RAG) systems, created by Datawhale. It systematically covers the full RAG stack from fundamentals (data loading, chunking, embeddings) to advanced techniques (hybrid search, query construction, Text2SQL, reranking, agentic RAG, and Graph RAG). The code is organized by chapter, with runnable Python scripts demonstrating each concept using popular frameworks like LangChain, LlamaIndex, and LangGraph, alongside vector databases (Milvus, FAISS) and graph databases (Neo4j). While primarily an educational resource, the repository contains several well-crafted, reusable components such as a minimal Text2SQL agent framework, a clean LangGraph-based agentic RAG pattern, and a custom ColBERT reranker. The practical application is a Chinese recipe Q&A system ('尝尝咸淡'), which serves as a consistent domain for demonstrating various RAG techniques. The codebase is hybrid in nature, blending structured educational content with functional demo applications. The repository is actively maintained with a large community following. However, users should be aware of technical drift risks including vendored model code, hardcoded API dependencies, and the presence of AI-generated code sections. The core value lies in its structured curriculum and reusable RAG patterns rather than as a production-ready system.
langchaingo is a Go port of the LangChain framework, providing a modular, composable library for building LLM-powered applications. In production, it serves as an abstraction layer over dozens of LLM providers (OpenAI, Anthropic, Google AI, AWS Bedrock, Ollama, HuggingFace, etc.), vector stores (Chroma, Pinecone, Weaviate, pgvector, Redis, Qdrant, and many more), and supporting components such as chains, agents, memory, tools, document loaders, and prompt templates. The architecture is a monorepo library: users import packages and compose interfaces (`Model`, `Chain`, `VectorStore`, `Agent`, `Memory`) to orchestrate LLM workflows. Key entry points are provider constructors (e.g., `openai.New()`) and composition functions (e.g., `chains.NewLLMChain()`, `agents.NewExecutor()`). The library relies on many external SDKs and databases, creating a large dependency surface. It includes a custom HTTP record/replay testing infrastructure (`httprr`) for deterministic testing of API calls. The codebase is actively maintained with recent commits and a large community, but carries medium technical drift due to some outdated dependencies and deprecated API patterns.
Eidolon is an open-source framework for building, deploying, and managing multi-agent AI applications. It provides a Python SDK with abstractions for LLM integration (OpenAI, Anthropic, Mistral, Ollama, Azure), retrieval-augmented generation (RAG) pipelines, memory systems (vector stores, symbolic memory, file storage), and document processing (loaders, parsers, splitters). Agents are configured declaratively via YAML and can communicate with each other, use tools, and stream responses. The framework includes a Kubernetes operator for production deployment, a web UI built with Next.js and React for chatbot interaction and developer tooling, and a TypeScript client library. It also features built-in agent types like SimpleAgent, RetrieverAgent, SQLAgent, and a Tree-of-Thought agent, along with logic units for web search, browser automation, and API integration.
This is an 'awesome list' curation repository — the definitive index of the LangGraph/LangChain ecosystem — rather than a conventional software application. The core product is a ~30k-line README.md that maps the ecosystem into core frameworks (LangChain, LangGraph, Deep Agents, LangSmith, LangSmith Fleet, and integrations), official LangChain projects, and ~100 community projects organized across 20+ use-case categories (RAG, finance, web automation, coding agents, research, cybersecurity, workplace productivity, media, robotics, and more), plus learning resources, templates, case studies, and communities. Its practical function is as a discovery and evaluation map for engineers building stateful, tool-using AI agents: everything is categorized, linked, badged, and maintained under defined contribution quality gates. The only real code is scripts/repo-checks.mjs, a maintenance automation script that parses every GitHub URL from the README, queries the GitHub API for each repo's metadata, classifies repos as archived or stale (15-month staleness cutoff for community projects), writes a markdown check report, and fails CI when problems are found. This is orchestrated by three GitHub Actions workflows: awesome-lint/markdownlint on PRs, a monthly scheduled repo-health cron, and a stale-issue/PR bot. The package.json exposes npm scripts for these checks with Node >=20 as the engine. The repository is actively maintained (latest commit 2026-07-10), uses current GitHub Actions major versions (v6 checkout/setup-node, stale@v9), and follows a documented contribution process with a PR template enforcing category placement, alphabetical order, and non-archived/active-project requirements. For AI agents and engineers, the value is twofold: (1) it is a currently-maintained, comprehensively categorized starting point for discovering LangGraph/LangChain projects and patterns by domain — useful before writing any code; (2) the repo-checks script is a genuinely extractable pattern for anyone maintaining any markdown document containing GitHub links, since it is a self-contained, env-configurable health checker that requires minimal adaptation. It is as close to a 'productized' awesome list as exists in this space, with CI, lint enforcement, and automated freshness audits. Limitations: no unit tests for the maintenance script (its errors surface only monthly via cron), descriptions for some official projects are generic and low-signal, and there is no actual application or library code to reuse beyond the single maintenance script.
Wavefront is an enterprise AI middleware platform, open-source alternative to tools like UnifyApps and n8n. It provides a full-stack system for building, managing, and deploying AI agents, chatbots, voice agents, knowledge bases (RAG), and AI-powered workflows. The monorepo includes a Python FastAPI backend with a modular, domain-driven architecture (agents, tools, knowledge base, voice, triggers, auth, API proxy), a React/TypeScript management console, background workers (Celery, stream processors), and the `flo_ai` Python agent framework (LLM wrappers, Arium graph engine, tool system). The platform supports multi-tenancy, RBAC, cloud storage abstractions (GCP/AWS/Azure), and pluggable datasource and authenticator modules. While primarily an application, it incorporates RAG pipelines, image embedding services, and model inference, giving it a hybrid character with strong data engineering elements.
This repository implements a serverless document chat application that allows users to upload PDF documents and ask natural language questions. The backend is composed of AWS Lambda functions orchestrated by Amazon API Gateway, S3, SQS, and DynamoDB. PDF processing uses LangChain with FAISS for vector embeddings and Amazon Bedrock (Claude Sonnet) for LLM inference. The frontend is a React SPA with TypeScript, TailwindCSS, and AWS Amplify authentication. Architecture follows an event-driven serverless pattern: upload triggers S3 event → Lambda extracts PDF metadata, stores in DynamoDB, sends SQS message → another Lambda generates embeddings and stores FAISS index in S3. Chat requests invoke a Lambda that loads the FAISS index, retrieves relevant context, and uses a ConversationalRetrievalChain with DynamoDB-backed memory. The code is clean and follows AWS best practices with Powertools logging, but lacks tests and hardcodes the Bedrock region to us-east-1. It is a solid reference implementation for building a RAG-based Q&A system on AWS.
CoexistAI is a research assistant framework implemented as a FastAPI application that provides a suite of API endpoints for web search, YouTube and Reddit retrieval, geospatial mapping, git repository analysis, text-to-speech/podcast generation, and knowledge base creation from local files or crawled websites. It integrates with an MCP server for agentic workflows and supports pluggable LLMs (Google, OpenAI, Ollama, local) and embedders (Google, HuggingFace, Infinity). The architecture is monolithic with modular utility functions, containerized via Docker with a companion SearxNG instance for privacy-respecting search. The codebase demonstrates a hybrid nature: while primarily an application with explicit API entry points, its core purpose is to support research and data-gathering tasks, making it equally relevant for data research scenarios. Configuration is centralized, and the system includes a web-based admin UI for runtime parameter changes. Active development is evident from recent commits and numerous utility modules, though some global mutable state and fallback-heavy code indicate where the system has evolved rapidly.
This is an educational repository of Python scripts, mini-projects, and markdown guides for building LLM-based AI agents applied to cybersecurity. The code is organized into five progressive parts: foundational LLM/embeddings usage, prompt templates, prompt chaining, RAG over security data, and agentic workflows. It demonstrates multiple agent frameworks (LangChain, LangGraph, CrewAI, DeepAgents) and MCP server integrations for tools like nmap and Shodan. The dominant character is application/tutorial code rather than data research, although it bundles small datasets (CVE embeddings, sample RAG corpora) and commits Chroma vector stores for offline exercises. The repo is not a single deployable service; it is a collection of entry-point scripts and small frameworks. Architecture is a set of standalone examples with shared patterns: state graphs for orchestration, YAML-configured crews, MCP adapters, and RAG ingestion/query pipelines. Most scripts require OpenAI-compatible API keys and/or local tools such as nmap/Ollama. Simulated data and placeholder responses in some examples make it a learning environment rather than production security tooling. Maintenance is current but drift is moderate: some examples use deprecated langchain vectorstore imports, documentation is duplicated across subdirectories, several referenced files are missing, and hardcoded model strings like gpt-5.4-mini appear dated or fictional. There is no root-level automated test suite; only the Shodan MCP subproject contains tests. The strongest reusable patterns are the MCP server wrapping, LangGraph conditional-state orchestration, CrewAI declarative crew configuration, and the hierarchical SOC agent supervisor.
This repository is a comprehensive collection of tutorials and code examples for deploying, fine-tuning, and integrating open-source large language models (LLMs), with a strong focus on the Chinese LLM ecosystem. It covers over 50 models (Qwen, ChatGLM, DeepSeek, InternLM, etc.) and provides step-by-step guides for setting up FastAPI services, Streamlit web demos, LangChain knowledge base assistants, and LoRA/QLoRA fine-tuning using PEFT. The repository also includes example applications such as role-playing chatbots and digital persona creation. While primarily educational, the code patterns are directly applicable to production scenarios, including model serving with vLLM/SGLang, experiment tracking with SwanLab, and deployment on diverse hardware (NVIDIA, AMD ROCm, Ascend NPU, Apple Silicon). The codebase is highly repetitive across models, with significant copy-paste, but the underlying patterns (fine-tuning pipeline, deployment scaffold, LangChain wrapper) are well-established and reusable.
This repository is an educational tutorial for learning LangChain, LangGraph, and Deep Agents frameworks. It contains two tracks: 101 (fundamentals) and 201 (production patterns) with Jupyter notebooks and standalone agents runnable via `langgraph dev`. The code demonstrates multi-agent supervision, human-in-the-loop interrupts, middleware hooks, MCP tool integration, and a deep research agent with skills and memory. All agents use mock or simulated data (Chinook SQLite, Tavily search) and are designed for learning rather than production. The architecture centers on a centralized model configuration (`utils/models.py`) that supports multiple LLM providers, and reusable patterns like subgraph composition, dynamic prompts, and composite backends. While the code is educational and lacks production hardening (error handling, testing, security), it provides clear, well-commented examples of advanced agent patterns.
DemoGPT is an open-source Python framework that provides two core capabilities: (1) an automatic Streamlit application generator that converts natural language descriptions into complete, runnable Streamlit apps through a multi-stage LLM pipeline (planning, task decomposition, code generation, assembly), and (2) the DemoGPT AgentHub, a modular library for building AI agents with built-in tools (web search, code execution, Wikipedia, weather, etc.), two agent types (ToolCallingAgent for single-step tasks, ReactAgent for multi-step reasoning), and a RAG (Retrieval Augmented Generation) system supporting Chroma, FAISS, and Pinecone vector stores. The codebase is primarily a library/application hybrid, with the Streamlit app acting as both a user interface and a demonstration of the generation pipeline. The architecture separates concerns into chains, prompts, task definitions, and controllers, but many components are tightly coupled to the specific generation pipeline. The AgentHub portion is more modular and reusable. Technical drift is medium: the code uses deprecated LangChain APIs (LLMChain, Chain.run), hardcodes older models like gpt-3.5-turbo-16k in some generated code, and has a broad dependency range. Maintenance appears active with recent commits and responsive issue triage, but the codebase would benefit from modernizing to LangChain's new LCEL syntax and updating default models.
This repository is a comprehensive educational resource for learning and building AI agents using the LangGraph framework. It consists of numerous tutorials and examples organized by chapter, covering fundamental concepts such as state graphs and tool usage, as well as advanced patterns including Retrieval-Augmented Generation (RAG), multi-agent supervisor systems, and human-in-the-loop workflows. Each lesson is designed as a runnable script that demonstrates specific LangGraph integrations with various APIs (e.g., OpenAI, Tavily, OpenWeatherMap) and techniques like vector stores with Chroma. While the repository serves its purpose as a learning tool, it exhibits some maintenance challenges due to code duplication (e.g., multiple copies of display_graph.py across chapters) and contains at least one known flawed implementation (the audit data monitor in chapter13) that suffers from schema mismatches and inefficient API usage, as indicated by log files.
This repository is an educational cookbook from Upstage, centered on their Solar LLM and Document AI APIs. It contains a large collection of Jupyter notebooks (Solar-Fullstack-LLM-101) that teach prompt engineering, RAG, cache-augmented generation, tool calling, and fact-checking with knowledge graphs, plus a Flask sample backend (Bremen) and a Flutter mobile app. The dominant character is a notebook-driven ML/research collection, but it is hybrid because it includes runnable application code (Flask API, Flutter app) and static data assets (OCR JSON, CSV knowledge bases).
IPEX-LLM (Intel Extension for PyTorch for Large Language Models) is a library and toolkit designed to accelerate LLM inference and fine-tuning on Intel hardware (CPU, GPU, NPU) through low-bit quantization (INT4, FP8, etc.), hardware-specific optimizations, and seamless integration with popular LLM ecosystems. The core functionality centers around the `optimize_model` function and optimized model loaders that enable efficient INT4/FP8 inference with minimal code changes. It provides integrations with Hugging Face Transformers, vLLM, LangChain, LlamaIndex, and serving solutions like FastAPI and FastChat. Despite its utility for LLM acceleration on Intel platforms, the project is explicitly archived with no active maintenance, updates, or security patches, limiting its long-term viability.
Flowise is an open-source, low-code platform for visually building AI agents, chatbots, and LLM-powered workflows. The monorepo contains a full-stack application: an Express/TypeORM backend (packages/server), a React/MUI frontend (packages/ui), a component library (packages/components) defining hundreds of pluggable nodes for LLMs, tools, memory, vector stores, and retrievers, a newer canvas SDK (packages/agentflow) for embedding agent flows, and an observability package (packages/observe) for execution monitoring. The platform supports multi-tenancy, RBAC, SSO, job queues (BullMQ), and enterprise features like usage quotas and audit logging. Despite being archived, the codebase demonstrates a comprehensive architecture for a visual AI orchestration platform with extensive third-party integrations (LangChain, LlamaIndex, OpenAI, Anthropic, etc.). However, the code exhibits significant technical drift: many nodes are marked as deprecated, database migrations are duplicated across four dialects, and there is evidence of incomplete migration from v1 to v2 canvas components. The repository is large and functionally rich, but its maintenance status (archived) and accumulation of deprecation warnings reduce its long-term viability.
AgentKit is a full-stack framework for building constrained, reliable LLM agents, developed by BCG X and now deprecated. The codebase consists of a FastAPI backend (Python 3.10) that orchestrates LangChain-based agents through a meta-agent and a simple router, executing tools like SQL queries, PDF question-answering, visualizations, image generation, and summarization. The Next.js 14 frontend provides a conversational chat interface with streaming responses, tool action rendering, and configurable UI components. The application is Dockerized with PostgreSQL, Redis, Minio, and Caddy, and supports optional features such as user authentication (NextAuth), feedback collection (LangSmith), and Celery-based background tasks. The architecture is monolithic in code but service-oriented in deployment, with configuration-driven agent behavior via YAML files. While the codebase demonstrates solid engineering patterns (e.g., streaming callbacks, base tool classes, state management), it is explicitly deprecated, relies on outdated LangChain imports and API versions, and requires significant maintenance to be viable for new projects. The repository serves as a reference for building constrained agents but is not recommended for production use without substantial updates.