Design a cost-aware resource strategy for a Databricks workload with spiky and batch jobs. Explain Dynamic Resource Allocation, when to disable it, and how min/max executors and spot instances affect cost and SLAs.
Spark/Big Datahard
2
Explain how Adaptive Query Execution changes the economics of Spark tuning. What problems does it solve at runtime, and when might you still need manual intervention (e.g., salting, broadcast hints)?
Spark/Big Datamedium
3
What challenges do you face when managing multiple notebooks in Git?
Behavioraleasy
4
What are the differences between Azure Key Vault-backed and Databricks-backed Secret Scopes?
Cloud/Toolseasy
5
What is Secret Scope, and how is it used in Databricks?
Cloud/Toolseasy
6
How do you handle expired secrets in a production environment?
General/Othereasy
7
How does resource allocation adjust when a job experiences a sudden load increase?
General/Othereasy
8
What are the best practices for logging and monitoring bad data?
System Design/Architecturemedium
+20 More Questions with Expert Answers
Get the complete 1,800+ question library with detailed, expert-level answers covering SQL, Spark, System Design, Python, Cloud, and Behavioral topics.