DSPy is a Python framework for programming language models (LMs) rather than prompting them. It provides a declarative API for defining LM programs using typed signatures, predictors (e.g., Predict, ChainOfThought, ReAct, RLM), and adapters (Chat, JSON, XML) that format and parse LM interactions. The framework includes a rich optimization suite (teleprompters) that can bootstrap demonstrations, optimize instructions (MIPROv2, COPRO), fine-tune models, and perform code-level optimization (GEPA) for Flex modules. It supports multiple LM backends (LiteLLM, native lm15) with caching, streaming, error handling, and cost tracking. The architecture is modular: clients manage LM connections, engines abstract execution backends, adapters handle message formatting/parsing, predictors implement reasoning patterns, signatures define I/O contracts, and utilities provide caching, callbacks, parallelism, and other cross-cutting concerns. The codebase demonstrates high cohesion and separation of concerns, with extensive test coverage and documentation. However, it is a large project with some experimental features, deprecation warnings, and a vendored lm15 library that adds maintenance overhead. Overall, it is a production-ready research framework widely used in the NLP community for building and optimizing LM programs.
Prompt Optimizer is a multi-platform AI prompt optimization tool that helps users craft better prompts for large language models (LLMs) and image generation models. The system supports web (Vue 3 + Naive UI), desktop (Electron), Chrome extension, MCP server, and Docker deployment via a pnpm monorepo. Core workflows include system/user prompt optimization, evaluation with structured compare (pair-judge, synthesis), image generation (text2image, image2image, multi-image), variable extraction/value generation, a template system with 40+ built-in bilingual (zh/en) templates, and smart favorites with resource-aware asset management. The architecture cleanly separates framework-agnostic core services (LLM adapters, evaluation, storage, template processing) from UI composables and Electron proxies, using adapter, registry, and factory patterns extensively. A notable strength is the comprehensive test infrastructure spanning unit (Vitest), integration (real LLM API helpers gated by environment flags), and E2E (Playwright with VCR record/replay). Weaknesses include significant template duplication (bilingual files maintained separately), IPC fragility between Electron main/renderer, provider adapter maintenance overhead (16+ text adapters, 6+ image adapters), and some dead/deprecated code paths carrying legacy migration layers.
Promptomatix is a framework for automating and optimizing large language model (LLM) prompts through iterative refinement. It provides both CLI and API interfaces for users to input task descriptions, generate synthetic data, optimize prompts using DSPy or meta-prompt backends, and evaluate results with custom metrics. The system features modular architecture separating language model management, configuration, session tracking, feedback handling, and metrics evaluation. Key workflows include prompt optimization with feedback incorporation, batch processing capabilities, and extensibility for custom metrics and optimization backends. The framework targets researchers and developers seeking to reduce manual prompt engineering effort while improving LLM output consistency and quality.