Advanced Topics

This section assumes you have an AWS account with privileges to launch the relevant resources.

In this section we will cover some advanced topics that you should know about how Airflow functions and present some advanced patterns for constructing config-driven DAGs without Python code. We will also cover how you can use AWS CodeArtifact for Python dependencies with Amazon MWAA.

Topics

Topic Relevant audience
Private PyPi repository Engineers
Admin UI and DAG Control Administrators, Operations
DAG Factories Engineers

There are a few key topics that are better covered by the existing Airflow documentation. Here we provide a list to some key resources:

Topic Relevant Documentation
Admin UI Tour https://airflow.apache.org/docs/apache-airflow/stable/ui.html
Monitoring https://docs.aws.amazon.com/mwaa/latest/userguide/monitoring.html
Scheduler Basics https://airflow.apache.org/docs/apache-airflow/stable/scheduler.html
DAG Runs https://airflow.apache.org/docs/apache-airflow/stable/dag-run.html#
Trigger Rules https://airflow.apache.org/docs/apache-airflow/stable/concepts.html#trigger-rules

With these core topics covered, you’ll be ready to consider Airflow in production and be enable to integrate into your existing workflows without any code.