#sql

You need to design a Kafka topic for a logging service. How would you decide the number of partitions and the key for partitioning to balance throughput and ordering requirements?

Adaptive Query Execution (AQE): Discuss how AQE optimizes query execution in Spark dynamically based on runtime stats.

Apache Spark Fundamentals - discuss

Apache Spark Fundamentals - failures, job optimization, resource utilization

Calculating Databricks costs - explain DBU

Challenges with Spark Jobs and Resolutions

Conceptualize and design a real-time streaming data pipeline end-to-end.

Databricks - platform, use cases