Amazon Managed Workflows for Apache Airflow

Some high-level features

  1. Deploy at scale.

  2. no operational burden.

  3. no need to manage underlying architecture.

  4. Run in own isloated cloud environment.

  5. Secure cloud environment.

  6. Environments monitoring through cloudwatch integration.

  7. Connct to AWS, cloud & on-prem resources.

  8. vast number of plugins available.

How it works?

  1. Orchestrate your workflows using Directed Acyclic Graphs (DAGs) written in Python.

  2. Create an environment with your Airflow cluster, including your scheduler, workers, and web server.

  3. Upload DAGs, Plugins & requirements file to s3.