DataEngPrep.tech

JavaScript is required to use this application. Please enable JavaScript in your browser settings or disable any extensions that may be blocking scripts.

Loading...

DataEngPrep.tech

Questions Practice AI Coach Dashboard Packs Blog

Home/Questions/Tag: partition

#partition

Questions tagged partition · hard

All easy (0)medium (280+)hard (510+)

Tell me about yourself and your experience.

Behavioralhardjoinpartition0.7 min read

AltimetrikChryselysFossil GroupGlobant+5

What architecture are you following in your current project, and why?

System Design/Architecturehardairflowetljoin3.5 min read

CognizantHCLNagarroThoughtworks+1

Briefly introduce yourself and walk us through your journey as a Data Engineer so far.

Behavioralhardetljoinpartition0.5 min read

AccentureEPAMYash Technologies

Joins and window functions - INNER, LEFT, RIGHT, FULL OUTER, ROW_NUMBER(), RANK(), DENSE_RANK()

SQLhardjoinpartitionwindow0.7 min read

FordKPMGNihilent

Can you explain the architecture of Apache Spark and its components?

Spark/Big Datahardjoinoptimizationpartition3.2 min read

CoforgeFreechargeNihilent

Describe the difference between Spark RDDs, DataFrames, and Datasets.

Spark/Big Datahardoptimizationpartitionspark0.5 min read

AccentureFragma Data Systems

What is the small-file problem in Spark, and how do you solve it?

Spark/Big Datahardpartitionspark0.5 min read

Daniel WellingtonIncedoSwiggy

How do you optimize Spark jobs for better performance? Mention at least 5 techniques.

Spark/Big Datahardjoinoptimizationpartition0.5 min read

Fragma Data SystemsPresidioSwiggy

What is Snowflake's architecture, and why is it unique?

Cloud/Toolshardbigqueryjoinoptimization3 min read

EYIncedoTech Mahindra

Briefly explain the architecture of Kafka.

System Design/Architecturehardjoinoptimizationpartition3 min read

Delivery HeroGrover

Describe the data pipeline architecture you've worked with.

System Design/Architecturehardjoinoptimizationpartition3 min read

Fragma Data SystemsGrover

Have you worked on Data Warehousing projects?

General/Otherhardbigqueryetloptimization0.7 min read

AareteDunnhumby

Retrieve the most recent sale_timestamp for each product (Latest Transaction).

General/Otherhardbigquerypartitionsnowflake0.6 min read

What is the difference between OLTP and OLAP?

General/Otherhardbigqueryetljoin0.7 min read

AareteDunnhumbyFragma Data Systems

Difference Between Internal and External Tables in BigQuery

SQLhardbigqueryoptimizationpartition0.6 min read

EYIncedoTech Mahindra

How do you optimize a long-running SQL query?

SQLhardjoinoptimizationpartition0.6 min read

AareteDunnhumbyIncedo

17

Design a cost-aware resource strategy for a Databricks workload with spiky and batch jobs. Explain Dynamic Resource Allocation, when to disable it, and how min/max executors and spot instances affect cost and SLAs.

Spark/Big Datahard

18

Design an anti-skew strategy for a join on a high-cardinality key with a long-tail distribution (e.g., a few keys hold 80% of rows). Cover salting, split-skew, AQE, and cost/operational trade-offs.

Spark/Big Datahard

19

Prioritize Spark optimizations by impact and effort. Discuss partitioning strategy, caching policy, join selection, shuffle reduction, and when each becomes a scalability or cost bottleneck.

Spark/Big Datahard

20

Walk through the three AQE features in Spark 3.x (coalesce, join switch, skew join)—how they operate at shuffle boundaries, which configs enable them, and what happens when AQE cannot help.

Spark/Big Datahard

+4 More Questions with Expert Answers

Unlock all 1,800+ expert answers, AI mock interviews, resume analyzer, SQL playground, and personalized progress tracking.

Unlock Full Access Try AI Coach Free

1 2 3...26 Next

Other Tags

#join #python #spark #optimization #sql #window #airflow #etl #bigquery #snowflake #lakehouse