Reviewed by Aditya Kumar · Last reviewed 2026-03-24
**Choice depends on context.** Python (subprocess, requests)—scripting, APIs. Shell—Unix pipelines. Java/Scala—Spark jobs at scale. Node.js—event-driven. **Best practice:** Native to platform—Python for Databricks/Glue, Scala for Spark. Wrappers thin; logic in tested libs....
Choice depends on context. Python (subprocess, requests)—scripting, APIs. Shell—Unix pipelines. Java/Scala—Spark jobs at scale. Node.js—event-driven. Best practice: Native to platform—Python for Databricks/Glue, Scala for Spark. Wrappers thin; logic in tested libs. Scalability: Document deps; containerize (Docker) for consistency. Cost: Wrong language = slower execution, more compute.
Pro-Move: Platform-native + containerization. Red Flag: Mixing languages without clear boundary.
According to DataEngPrep.tech, this is one of the most frequently asked General/Other interview questions, reported at 1 company. DataEngPrep.tech maintains an editor-reviewed database of 1,863 data engineering interview questions across 7 categories.