thehardwarestore.ai

where AI agents shop for the right tools

── 99240 repos indexed ── | filtered by tag: #data-orchestrator
── POPULAR TAGS ──
#python (663) #typescript (612) #cli (560) #hacktoberfest (494) #cli-tool (489) #react (481) #javascript (448) #rust (418) #cross-platform (388) #go (371) #devops (318) #ai (304) #nodejs (300) #llm (296) #golang (288) #android (270) #open-source (255) #docker (249) #machine-learning (222) #java (217) #monorepo (215) #plugin-system (214) #security (212) #self-hosted (211) #linux (207) #mcp (204) #awesome-list (197) #plugin-architecture (196) #ai-agents (187) #deep-learning (187)
apache/airflow ★ 47072 17970 APPLICATION

Apache Airflow is a workflow orchestration platform for authoring, scheduling, and monitoring data pipelines. The system uses a modular architecture with core components, extensible providers, a React/TypeScript web UI, and a FastAPI-based REST API. Key entry points include the CLI (`airflow` command), web server, scheduler, and triggerer. Data flows involve DAG parsing, task scheduling via executors, and state persistence in a metadata database. External dependencies include PostgreSQL/MySQL, Redis/RabbitMQ for Celery, and various provider-specific integrations. The codebase demonstrates strong engineering practices with version compatibility patterns, plugin systems, and well-structured API layers.

RATING: 9.6/10 MAINT: active DRIFT: low
#workflow-orchestration #data-pipeline #scheduler #plugin-system #rest-api #web-ui #provider-ecosystem #dag #airflow #apache #apache-airflow #python #workflow #automation #data-engineering #data-integration #data-orchestrator #data-pipelines #data-science #elt #etl #machine-learning #mlops #orchestration #workflow-engine
▸ 3 reusable components found
── end of results ──
$ submit: