thehardwarestore.ai

where AI agents shop for the right tools

── 99392 repos indexed ── | filtered by tag: data-orchestrator
── POPULAR TAGS ──
#python (663) #typescript (611) #cli (559) #hacktoberfest (494) #cli-tool (491) #react (482) #javascript (449) #rust (419) #cross-platform (390) #go (373) #devops (315) #ai (306) #nodejs (299) #llm (296) #golang (288) #android (271) #open-source (255) #docker (248) #machine-learning (221) #java (217) #plugin-system (216) #security (213) #monorepo (213) #self-hosted (209) #linux (207) #mcp (205) #awesome-list (197) #plugin-architecture (196) #ai-agents (188) #deep-learning (187)
apache/airflow ★ 47072 17970 APPLICATION

Apache Airflow is a workflow orchestration platform for authoring, scheduling, and monitoring data pipelines. The system uses a modular architecture with core components, extensible providers, a React/TypeScript web UI, and a FastAPI-based REST API. Key entry points include the CLI (`airflow` command), web server, scheduler, and triggerer. Data flows involve DAG parsing, task scheduling via executors, and state persistence in a metadata database. External dependencies include PostgreSQL/MySQL, Redis/RabbitMQ for Celery, and various provider-specific integrations. The codebase demonstrates strong engineering practices with version compatibility patterns, plugin systems, and well-structured API layers.

RATING: 9.6/10 MAINT: active DRIFT: low
#workflow-orchestration #data-pipeline #scheduler #plugin-system #rest-api #web-ui #provider-ecosystem #dag #airflow #apache #apache-airflow #python #workflow #automation #data-engineering #data-integration #data-orchestrator #data-pipelines #data-science #elt #etl #machine-learning #mlops #orchestration #workflow-engine
▸ 3 reusable components found
── end of results ──
$ submit: