$ show deepset-ai/haystack
Haystack is an open-source Python framework for building production-ready LLM applications. It provides a modular, component-based architecture where data processing steps (converters, embedders, retrievers, generators, evaluators, etc.) are connected into pipelines or agents. The framework includes over 100 built-in components, support for 50+ integrations (OpenAI, Anthropic, Azure, HuggingFace, etc.), async execution, streaming, serialization, evaluation, and observability. It is designed for RAG, semantic search, question answering, autonomous agents, and multimodal applications. The code is well-structured with consistent patterns (component decorator, lifecycle methods, serialization protocols), extensive test coverage, and security hardening (fuzzing, sandboxed Jinja2, deserialization allowlists).
The LLM identified 1 files worth highlighting for reuse:
MockChatGenerator provides a drop-in replacement for real chat generators (e.g., OpenAIChatGenerator) for testing and prototyping. It supports fixed, cycling, dynamic, and echo response modes, streaming simulation (word-by-word and tool-call chunks), tool-awareness, serialization, and async execution. Its design follows the same run/run_async interface, making it trivially extractable into any project needing a controllable, reproducible chat component. Demonstrates non-obvious skill in simulating streaming chunks and handling tool call deltas.