Reviewed by Aditya Kumar · Last reviewed 2026-03-24
Architectural comparison: Glue = serverless Spark, Catalog, complex ETL. Lambda = event-driven, 15-min max, lightweight. Data Pipeline = templated, EC2/EMR-managed. When to use: Glue for data lake ETL; Lambda for triggers, small tasks; Data Pipeline for simple, cost-sensitive...
Architectural comparison: Glue = serverless Spark, Catalog, complex ETL. Lambda = event-driven, 15-min max, lightweight. Data Pipeline = templated, EC2/EMR-managed. When to use: Glue for data lake ETL; Lambda for triggers, small tasks; Data Pipeline for simple, cost-sensitive batch. Scalability: Glue via DPU; Lambda concurrency; Data Pipeline via instances. Cost: Lambda cheapest for small; Glue for Spark; Data Pipeline for simple batch. Best practice: Glue for ETL; Lambda for events; Data Pipeline only if legacy.
Red Flag: Using Lambda for multi-GB ETL. Pro-Move: 'Lambda triggers on S3; Glue runs ETL; we evaluated Data Pipeline—Glue won for Catalog and maintainability.'
According to DataEngPrep.tech, this is one of the most frequently asked Cloud/Tools interview questions, reported at 2 companies. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.