Amazon Managed Workflows for Apache Airflow (MWAA)
Amazon MWAA is a managed service for Apache Airflow that lets you use your current, familiar Apache Airflow platform to orchestrate your workflows. You gain improved scalability, availability, and security without the operational burden of managing underlying infrastructure.
Amazon Managed Workflows for Apache Airflow Documentation
Amazon Managed Workflows for Apache Airflow (Amazon MWAA) is a managed service for Apache Airflow that you can use to build and manage your workflows in the cloud. User Guide Describes how to build and manage an Apache Airflow …
Amazon MWAA frequently asked questions
For more information about migrating your self-managed Apache Airflow deployments, or migrating an existing Amazon MWAA environment, including instructions for backing up your metadata database, see the Amazon MWAA Migration Guide.
Introducing Amazon Managed Workflows for Apache Airflow …
2020年11月24日 · For these reasons, I am happy to announce the availability of Amazon Managed Workflows for Apache Airflow (MWAA), a fully managed service that makes it easy to run open-source versions of Apache Airflow on AWS, and to build workflows to execute your extract-transform-load (ETL) jobs and data pipelines.
Amazon Managed Workflows for Apache Airflow (MWAA) FAQs
Amazon MWAA workflows retrieve input from sources like S3 using Athena queries, perform transformations on EMR clusters, and can use the resulting data to train machine learning (ML) models on SageMaker. Workflows in Amazon MWAA are authored as Directed Acyclic Graphs (DAGs) using Python.
Get started with Amazon Managed Workflows for Apache Airflow
Amazon Managed Workflows for Apache Airflow uses the Amazon VPC, DAG code and supporting files in your Amazon S3 storage bucket to create an environment. This chapter describes the prerequisites and AWS resources needed to get started with Amazon MWAA.
Configuring Amazon MWAA worker automatic scaling
This topic describes how you can configure automatic scaling by specifying the maximum number of Apache Airflow workers that run on your environment using the Amazon MWAA console.
Amazon Managed Workflows for Apache Airflow (MWAA) features
Amazon Managed Workflows for Apache Airflow (MWAA) is a managed orchestration service for Apache Airflow that makes it easier to set up, operate, and scale data pipelines in the cloud.
Create an Amazon MWAA environment
Open the Amazon MWAA console. Use the AWS Region selector to select your region. Choose Create environment. On the Specify details page, under Environment details: Type a unique name for your environment in Name. Choose the Apache Airflow version in Airflow version.
Using the Apache Airflow REST API - docs.aws.amazon.com
This Amazon MWAA documentation page describes how to authenticate with an access toke, then call the Apache Airflow REST API using a Python script.
- 某些结果已被删除