Real questions from top companies in Spark/Big Data · easy
Data locality in Hadoop - explain
Databricks Cluster Management - standalone vs YARN mode
Databricks Job Cluster and SQL Endpoint - discuss Photon
Databricks notebooks vs. Fabric notebooks - differences
Databricks vs. PySpark?
Define Airflow and explain it as a workflow orchestration tool.
Defining Tasks in DAG
Delta vs Parquet - explain
Deploying DAGs
Describe a custom EMR cluster configuration for Spark-based ETL with minimal cost.
Describe building custom JARs for Spark jobs
Describe how to pass data between tasks in Airflow using XComs.
Describe the cluster configuration used in your project, including memory allocation, number of nodes, and executor/driver settings.
Describe the role of a workflow orchestrator like Airflow in a data pipeline.
Describe your approach to managing offsets in Kafka.
Discuss Delta Logs file format and its significance.
Discuss the process of moving files in Databricks File System (DBFS).
Executor vs Driver in Spark
Explain Bronze/Silver/Gold Layers.
Explain your approach to monitoring and logging Spark jobs in AWS. What tools would you use to identify performance bottlenecks?
Type or paste your answer to any of these questions and our AI Coach scores it, highlights gaps, and rewrites it at FAANG quality. Free to try.