Real questions from top companies
What are transient clusters in EMR, and when would you use them?
What causes Out of Memory (OOM) issues in Databricks, and how do you resolve them?
What is Predicate Pushdown and AQE with Example
What is Shuffle and How to Handle It in Spark
What role would Kafka or similar event-driven platforms play in your architecture?
Write PySpark code to extract data from a CSV and create a table.
Write PySpark code to filter and count records.
Write PySpark code to filter records based on specific conditions and add a calculated column.
Write PySpark code to save a DataFrame in Parquet format to an S3 bucket.
Write a PySpark code snippet to filter rows with a specific condition.
Write a PySpark job that calculates the number of unique users who logged in per day, but exclude any logins from inactive users listed in a separate file.
Write a PySpark script to check for missing values and duplicate rows in a DataFrame. How would you ensure data quality before saving it to a storage system?
Write a PySpark script to filter out invalid records from a dataset and calculate the average for a specific column, ensuring the schema is strictly defined at runtime.
Write a PySpark script to process data stored in Delta format and transform it into Parquet.
Write a PySpark script to read a CSV file, filter rows where the age column is less than 18, and write the result to a new CSV file.
Write a Spark job to count word occurrences from an S3 dataset.
Write a complete PySpark program from import statements to the stop statement, covering transformations and actions.
Write a transformation in PySpark to join and clean multiple raw input sources
Write code to read data from Delta Lake in S3 and perform upsert based on primary key
Write maintainable, efficient Pandas or PySpark code.
Type or paste your answer to any of these questions and our AI Coach scores it, highlights gaps, and rewrites it at FAANG quality. Free to try.