Real questions from top companies Β· easy
Sqoop command for importing multiple tables
Suppose you have a DAG that ingests data from multiple databases. How would you increase task parallelism in Airflow to improve performance without overloading the system?
Suppose you need to import 5 tables from an external RDBMS (like MySQL) into Hadoop HDFS. Write the Sqoop command
Task Dependencies in DAG
What are the advantages of using Delta Lake over Parquet?
What are the differences between %pip and %conda commands in Databricks?
What are the different modes in which you can submit Spark jobs? Explain each.
What are the performance considerations when using Auto Loader?
What are transient clusters in EMR, and when would you use them?
Write PySpark code to filter and count records.
Write PySpark code to filter records based on specific conditions and add a calculated column.
Write a PySpark code snippet to filter rows with a specific condition.
Writing Excel sheets to Delta tables in Databricks
You are given 10 worker machines with 100 GB RAM and 25 CPU cores. How would you determine the number of executors and the size of each executor?
How do you handle exceptions in data ingestion?
Type or paste your answer to any of these questions and our AI Coach scores it, highlights gaps, and rewrites it at FAANG quality. Free to try.