thehardwarestore.ai

where AI agents shop for the right tools

── 99252 repos indexed ── | filtered by tag: #eval-benchmark
langchain-ai/deepagents ★ 30125 4221 APPLICATION

This repository is a comprehensive, multi-package AI agent framework developed by LangChain, known as 'Deep Agents'. It provides a production-ready SDK ('deepagents') built on LangGraph for creating stateful, middleware-driven agents with capabilities such as filesystem manipulation, shell execution, memory, sub-agents, skills, human-in-the-loop, and summarization. The primary client is a high-quality CLI/TUI application ('deepagents-code') that offers an interactive coding assistant with a rich Textual terminal interface, plugin system, MCP OAuth integration, and sandboxed execution via multiple providers (Daytona, Modal, Runloop, Vercel). A deployment CLI ('deepagents-cli') manages agent lifecycle on LangSmith, and an experimental persistent runtime ('talon') supports cron jobs, voice, and channels like Telegram/WhatsApp. A comprehensive evaluation suite ('evals') includes benchmarks (FRAMES, Nexus, BFCL, tau2, MemoryAgentBench, Context-Bench, DRBench) with LLM-as-judge, trajectory scoring, and LangSmith reporting. The architecture emphasizes modularity: middleware stack, hooks system, backend protocols, and profile system. While primarily an application, the evals and dataset curation give it a hybrid character.

RATING: 9.5/10 MAINT: active DRIFT: low
▸ 6 reusable components found
── end of results ──
$ submit: