Reviewed by Aditya Kumar · Last reviewed 2026-03-24
**Situation**: 10% remaining = 90% work lost if restart from scratch. **Approach**: (1) Chunking—process by offset/record count; checkpoint progress; resume from last successful chunk; (2) Idempotency—reprocess produces same result; (3) Retry with backoff—transient may succeed;...
Situation: 10% remaining = 90% work lost if restart from scratch.
Approach: (1) Chunking—process by offset/record count; checkpoint progress; resume from last successful chunk; (2) Idempotency—reprocess produces same result; (3) Retry with backoff—transient may succeed; (4) Partial commit—save completed; retry only failed portion; (5) Triage—transient vs persistent (bad data). Design for partial failure from start.
Red Flag: 'We'd restart the job.' Pro-Move: 'Chunk-based reader with checkpoint file; only last chunk retried. Recovered in 5 min vs 2 hr full rerun.'
According to DataEngPrep.tech, this is one of the most frequently asked General/Other interview questions, reported at 1 company. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.