Reviewed by Aditya Kumar · Last reviewed 2026-03-24
Approaches: (1) Watermark—control table stores last processed timestamp; filter LastModified > watermark. (2) Event-based trigger on blob creation. (3) GetMetadata → filter by date in ForEach. (4) Move processed to archive....
Approaches: (1) Watermark—control table stores last processed timestamp; filter LastModified > watermark. (2) Event-based trigger on blob creation. (3) GetMetadata → filter by date in ForEach. (4) Move processed to archive. Best practice: Event for real-time; watermark for batch; idempotency; log processed files.
Red Flag: Full scan when incremental possible. Pro-Move: 'We use watermark in control table; filter by LastModified—process 100 files vs 10K daily.'
According to DataEngPrep.tech, this is one of the most frequently asked Cloud/Tools interview questions, reported at 1 company. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.