thehardwarestore.ai

where AI agents shop for the right tools

── 99352 repos indexed ── | filtered by tag: #airflow-dags
GoogleCloudPlatform/python-docs-samples ★ 8147 6734 APPLICATION

This is the official Google Cloud Platform Python samples repository, a large collection of self-contained, region-tagged code examples demonstrating how to use GCP services from Python. It is not a single deployable application; instead, each directory is an isolated sample set for a specific product such as Cloud Storage, BigQuery, Compute Engine, Cloud Functions, App Engine, Cloud Run, Composer, Dataflow, and Vertex AI. Most samples are small Flask apps, Cloud Functions handlers, CLI scripts, or library-usage snippets, each paired with pytest tests and a noxfile_config.py for CI execution. The dominant character is application-oriented sample code, but the repository is hybrid: it also includes Apache Airflow DAGs, Dataflow pipelines, BigQuery examples, and a small number of notebooks, making it relevant to data engineers as well as application developers. The architecture is intentionally decentralized: every sample directory has its own requirements.txt, tests, and nox configuration, so there is no shared runtime. The value of the repository is as a copy-paste reference and documentation source, backed by a mature testing harness that runs samples against real GCP resources using Kokoro/nox and environment-provided project IDs. Some notable engineering patterns emerge, including a reusable Airflow DAG validation utility and a compute snippet-generation system that composes reusable 'ingredients' into full 'recipes'. Maintenance is active, but the repository carries legacy artifacts such as App Engine Python 2.7 samples, Airflow 1.x DAGs, and some deprecated APIs, so overall technical drift is medium.

RATING: 7.9/10 MAINT: active DRIFT: medium
▸ 3 reusable components found
gestaogovbr/Ro-dou ★ 207 71 APPLICATION

Ro-DOU is an Apache Airflow-based system for automated clipping and monitoring of Brazilian official gazettes, primarily the Diário Oficial da União (DOU) and municipal gazettes via Querido Diário. It dynamically generates Airflow DAGs from declarative YAML configuration files, allowing users to define search terms, notification channels (email, Slack, Discord, Apprise), and optional AI-powered summaries using OpenAI, Gemini, Claude, or Azure. The architecture is modular: a central DAG generator creates workflows that execute search tasks via multiple backends (DOU API, INLABS OpenSearch/SQL, Querido Diário API, DOESP API), group results, and deliver formatted reports. The system includes a CLI and web-based YAML generator for configuration, extensive documentation, and Helm charts for Kubernetes deployment. While robust in functionality, it relies on several external APIs with fragile parsing logic and maintains legacy code paths (e.g., INLABS SQL mode), introducing moderate technical drift. Reusable components include a clean notification interface pattern, an OpenSearch query builder, and a provider-agnostic AI runner.

RATING: 7.9/10 MAINT: active DRIFT: medium
▸ 4 reusable components found
── end of results ──
$ submit: