MLflow is an open-source ML lifecycle platform that provides experiment tracking, model registry, model deployment, evaluation, and observability for both classical ML and GenAI/LLM workflows. In production, it operates as a modular monolith: a Python backend (Flask/FastAPI) with SQLAlchemy-backed storage (SQLite, PostgreSQL, MySQL, MSSQL), a React/TypeScript web UI, and client SDKs for Python, R, Java, and TypeScript. The system exposes a REST API and CLI for logging experiments, registering models, collecting traces via OpenTelemetry, and managing an AI Gateway that routes requests to dozens of LLM providers with budget controls, guardrails, and traffic splitting. The architecture includes a plugin system for custom store backends, deployment targets, and authentication providers, as well as a custom linting tool (clint) and extensive CI/CD pipelines. Key entry points are the `mlflow` CLI, `MlflowClient` Python API, tracking server (`mlflow server`), gateway server (`mlflow gateway`), and model scoring server (`mlflow models serve`). Data flows from user instrumentation through asynchronous logging to the backend store, with traces and evaluations queryable via the UI or API. External dependencies span ML frameworks (scikit-learn, PyTorch, TensorFlow, LangChain, etc.), LLM provider SDKs, and infrastructure tools (Docker, Kubernetes, Helm).
PyCaret 4.0 is a full-stack MLOps platform combining a low-code Python AutoML engine, a FastAPI control plane server, and a React web UI into a single deployable system. The engine provides OOP Experiment classes for classification, regression, clustering, anomaly detection, and time series, with native sklearn pipeline implementations and typed result dataclasses. The server adds multi-user workspace management, experiment tracking, model registry, deployment serving, drift monitoring, LLM-powered advisory copilots, scheduling, webhooks, and audit logging. The React frontend offers a rich SPA with real-time event streaming, interactive plots (Plotly), and data-driven forms generated from engine introspection. The architecture is well-structured with protocol-based abstractions for storage (local-fs/S3), data sources (CSV/Postgres), LLM providers (Anthropic/OpenAI/fake), and notebook backends. This is primarily an application (ML platform) but has strong data/research characteristics due to the engine's statistical analyses, dataset profiling, and time-series utilities. The codebase is under active development with a systematic migration from legacy functional APIs to the new OOP architecture, and many components are genuinely reusable.
Dioptra is a NIST-developed open-source platform for designing, managing, and executing reproducible machine learning experiments with a strong emphasis on adversarial robustness evaluation. The system provides a full-stack application including a REST API (Flask-RESTx with dependency injection, SQLAlchemy ORM, and Alembic migrations), a Vue.js frontend (Quasar framework), a Python client library, a plugin-based task execution engine, and a declarative YAML workflow system. It supports experiment tracking via MLflow integration, artifact versioning, user and group management, and job queuing via Redis RQ. The platform is designed to be deployed using Docker and Cookiecutter templates, with support for custom worker containers and GPU acceleration. While primarily an application for experiment lifecycle management, Dioptra also incorporates research-oriented components such as object detection modules (YOLOv1 architecture with TensorFlow backends), adversarial attack and defense plugins (using ART), and a custom type system for plugin parameter validation. The codebase is well-structured with clear separation of concerns (controllers, services, repositories), generic endpoint generators to reduce boilerplate, and a comprehensive test suite. Notable architectural patterns include unit of work, dependency injection, and a custom pyplugs decorator-based plugin registration system. However, the codebase shows signs of technical drift with some deprecated syntax, monkey-patching of third-party libraries, and complex draft/resource locking logic that may be brittle. Overall, Dioptra is a solid, professional-grade platform that effectively addresses the challenge of reproducible ML experimentation in adversarial contexts.