Reviewed by Aditya Kumar · Last reviewed 2026-03-24
**Techniques**: (1) Partitioning—by filter columns; coalesce/repartition; (2) Predicate pushdown; partition pruning; (3) Broadcast small tables; (4) Cache reused DataFrames; (5) Right-size executors; parallelism; (6) Avoid UDFs; native functions; (7) Parquet, columnar;...
Techniques: (1) Partitioning—by filter columns; coalesce/repartition; (2) Predicate pushdown; partition pruning; (3) Broadcast small tables; (4) Cache reused DataFrames; (5) Right-size executors; parallelism; (6) Avoid UDFs; native functions; (7) Parquet, columnar; compaction. Measure before/after; address biggest bottleneck; salting for skew.
Pro-Move: 'Bottleneck was shuffle. Broadcast 2 small dims; partition by date. Job from 45 min to 12 min. Documented in ADR.'
According to DataEngPrep.tech, this is one of the most frequently asked General/Other interview questions, reported at 1 company. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.