You need to create a workflow where Task B runs only if Task A is successful, and Task C should always run regardless of Task A or B's status. How would you define this dependency using Airflow?
SQLhard
3
A data pipeline processes files for different clients stored in separate directories. Explain how you would use dynamic DAG creation to handle client-specific workflows in Airflow.
Spark/Big Datahard
4
A task intermittently fails due to external API limitations. How would you configure Airflow retries and alerts to manage this situation efficiently?
Spark/Big Dataeasy
5
Define Airflow and explain it as a workflow orchestration tool.
Spark/Big Dataeasy
6
Defining Tasks in DAG
Spark/Big Dataeasy
7
Deploying DAGs
Spark/Big Dataeasy
8
Describe how to pass data between tasks in Airflow using XComs.
Spark/Big Dataeasy
+20 More Questions with Expert Answers
Get the complete 1,800+ question library with detailed, expert-level answers covering SQL, Spark, System Design, Python, Cloud, and Behavioral topics.