Real questions from top companies in Spark/Big Data · easy
How do you compare the time investment and value of a task?
How do you handle bad data in Databricks?
How do you handle failures in Airflow tasks, and what retry strategies can you use?
How do you handle schema evolution in Spark, especially when reading data from sources like Parquet or Avro?
How do you prioritize your tasks in a multi-project environment?
Sqoop Incremental Import?
Sqoop command for importing multiple tables
Suppose you have a DAG that ingests data from multiple databases. How would you increase task parallelism in Airflow to improve performance without overloading the system?
Suppose you need to import 5 tables from an external RDBMS (like MySQL) into Hadoop HDFS. Write the Sqoop command
Task Dependencies in DAG
What are Hadoop commands for Get and Merge?
What are the advantages of using Dataproc over a traditional Hadoop setup?
What are the advantages of using Delta Lake over Parquet?
What are the differences between %pip and %conda commands in Databricks?
What are the different delivery semantics in Kafka (at least-once, at-most-once, exactly-once)?
What are the different modes in which you can submit Spark jobs? Explain each.
What are the performance considerations when using Auto Loader?
What are the steps to connect to Salesforce?
What are the steps to debug a failed workflow in Databricks?
What are the steps to execute a Python file with PySpark code on an EC2 environment?
Type or paste your answer to any of these questions and our AI Coach scores it, highlights gaps, and rewrites it at FAANG quality. Free to try.