Real questions from top companies · hard
You need to design a Kafka topic for a logging service. How would you decide the number of partitions and the key for partitioning to balance throughput and ordering requirements?
Alternatives to the Medallion Architecture
Apache Spark Architecture - RDD, DAG, cluster manager, driver node, worker node
Calculating Databricks costs - explain DBU
Can Presto work with Near Real-Time Data (Streaming Data Source)?
Conceptualize and design a real-time streaming data pipeline end-to-end.
Design an ETL pipeline using Kafka and Spark Streaming
Difference between Presto vs. Spark underlying architecture
Explain Azure Databricks architecture and its integration with other Azure services.
Explain Delta Live Tables and their features, such as declarative pipeline definition and automatic data validation.
Explain Delta Table features – Z-ordering and Time Travel.
Explain Delta Time Travel and the purpose of the vacuum command.
Explain Hive, its purpose, and its default metadata storage.
Explain MapReduce Architecture.
Explain PySpark's Catalyst Optimizer.
Explain SCD1 and SCD2 in Databricks PySpark with examples.
Explain Spark Architecture – Driver, Executors, and Tasks.
Explain Spark transformations (lazy evaluation, wide vs narrow).
Explain Spark's execution process – Job/Stage/Task creation.
Explain Spark's narrow vs. wide transformations and when to use each
Type or paste your answer to any of these questions and our AI Coach scores it, highlights gaps, and rewrites it at FAANG quality. Free to try.