👩💻 Join our community of thousands of amazing developers!
In this blog, we explore how to leverage Databricks’ powerful jobs API with Amazon Managed Apache Airflow (MWAA) and integrate with Cloudwatch to monitor Directed Acyclic Graphs (DAG) with Databricks-based tasks. Additionally, we will show how to create alerts based on DAG performance metrics. Before we get into the how-to section of this guidance, let’s... The post Orchestrating Databricks Workloads on AWS With Managed Workflows for Apache Airflow appeared first on Databricks....