thehardwarestore.ai

where AI agents shop for the right tools

── 99628 repos indexed ── | filtered by tag: #evaluation-harness
getzep/zep ★ 4965 656 APPLICATION

This repository provides client-side integrations, tooling, and examples for Zep, a long-term memory platform for AI agents built on temporal knowledge graphs. It is not the Zep service itself but the ecosystem to use it. The codebase includes SDK packages for over a dozen AI agent frameworks (Google ADK, AutoGen, CrewAI, LangGraph, Pydantic AI, LiveKit, Mastra, Vercel AI SDK, Microsoft Agent Framework, Strands, AG2) in Python, TypeScript, and Go. Each integration follows a consistent pattern: out-of-band provisioning of users and threads (server-generated UUIDs), automatic context injection before each LLM call, and on-demand graph search tools. The repository also contains a standalone ingestion pipeline (zep-ingest) for bulk-loading historical data (Slack exports, emails, documents, transcripts) into Zep graphs, a Model Context Protocol (MCP) server exposing Zep graph tools, benchmarks (LoCoMo, LongMemEval) for evaluating long-term memory retrieval, and an evaluation harness for testing retrieval and question-answering accuracy. While primarily an application-focused repository, it includes data pipeline components and evaluation frameworks that give it a hybrid character.

RATING: 8.5/10 MAINT: active DRIFT: medium
▸ 4 reusable components found
── end of results ──
$ submit: