Apache Airflow / Intermediate: runtime work, control flow and resource budgets

Apache Airflow β€” Intermediate: runtime work, control flow and resource budgets

Design bounded mapping, joins, waiting, asset updates and admission policies.

6 lessons Β· No account required

What you will learn

  • Preserve business meaning through branching and data-aware triggers.
  • Test named invariants and diagnose resource limits.

  1. Dynamic task mapping and task groups

    Expand bounded runtime work deliberately and keep grouping, identity and aggregation semantics clear.

    Start learning

  2. Branching, trigger rules and joins

    Make conditional paths and join behavior match the meaning of successful, skipped and failed work.

    Start learning

  3. Sensors, deferral and timeouts

    Wait for explicit external conditions without confusing waiting capacity with business completion.

    Start learning

  4. Assets, events and data-aware scheduling

    Schedule from declared data updates while preserving separate evidence for availability, freshness and interval coverage.

    Start learning

  5. Pools, concurrency and backpressure

    Bound task admission by the resource being protected and distinguish scheduler eligibility from worker capacity.

    Start learning

  6. Testing DAG contracts and safe local logic

    Choose tests that establish specific business and graph properties without overstating what an offline check proves.

    Start learning
Back to course