Reviewed by Aditya Kumar · Last reviewed 2026-03-24
Strategies: (1) Right-size DPUs; auto-scaling. (2) Partition read/write; predicates. (3) Parallelism—parallelCopies, repartition. (4) Parquet/ORC; compact small files. (5) Pushdown at source. (6) Job bookmarks for incremental. (7) Salting for skew. Trade-off: Over-parallelism...
Strategies: (1) Right-size DPUs; auto-scaling. (2) Partition read/write; predicates. (3) Parallelism—parallelCopies, repartition. (4) Parquet/ORC; compact small files. (5) Pushdown at source. (6) Job bookmarks for incremental. (7) Salting for skew. Trade-off: Over-parallelism can throttle source. Best practice: Profile with Spark UI; Glue optimizations; cache lookups.
Red Flag: No partitioning on large tables. Pro-Move: 'We partition + predicate; salt skewed key; compact weekly—job time 2h → 25 min.'
According to DataEngPrep.tech, this is one of the most frequently asked Cloud/Tools interview questions, reported at 1 company. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.