Question 1

Differentiate between global and local variables in ADF.

Accepted Answer

Architectural logic: Global parameters = factory-level; accessible to all pipelines. Local (pipeline) parameters = per-pipeline; passed at runtime or from triggers. Use global for env, base URL; local for LoadDate, table list. Reference: @pipeline().globalParameters.Environment, @pipeline().parameters.LoadDate. Why: Centralize cross-pipeline config; pipeline-specific for runtime....

Question 2

Explain how you debug failed pipelines in ADF.

Accepted Answer

Debug flow: (1) Monitor → Pipeline runs → filter Failed. (2) Activity details → Error tab. (3) Output → View Data for counts/samples. (4) Diagnostic settings → Log Analytics; Kusto queries. (5) SHIR: Windows Event Log, IR logs. Example: Connection timeout → verify SHIR reachability, firewall....

Question 3

Explain the use of Web Activity in ADF.

Accepted Answer

Architectural use: Web Activity = HTTP/HTTPS call to REST endpoint. Use cases: APIs, Logic Apps, webhooks. Example: Pipeline failure → Web Activity POST to Logic App → Teams. Config: Method, URL, headers, body....

Question 4

How are Logic Apps used in ADF projects?

Accepted Answer

Architectural use: Logic Apps = workflows for approvals, notifications, HTTP. Integration: ADF Web Activity triggers Logic App; Logic App can call ADF REST API. Use case: Pipeline failure → Web Activity → Logic App → Teams/Slack. Approval → Logic App → trigger ADF....

Question 5

How can you increase parallelism in ADF pipelines?

Accepted Answer

Strategies: (1) ForEach batchCount >1 (max 20). (2) Copy Data parallelCopies (up to 256 cloud). (3) Multiple pipelines concurrently. (4) Data Flow partition tuning. (5) SHIR multiple nodes. Trade-off: Source/sink limits; throttling....

Question 6

How do Logic Apps enhance notification workflows for monitoring pipelines?

Accepted Answer

Architectural flow: ADF Alert or Web Activity (on failure) → HTTP trigger Logic App → email/Teams/Slack/PagerDuty. Logic App parses run info, formats message. Why: No native ADF PagerDuty/Slack; Logic App has connectors....

Question 7

How do you delete files older than 30 days using ADF?

Accepted Answer

Options: (1) GetMetadata → ForEach → If Condition LastModified < addDays(utcnow(), -30) → Delete. (2) Azure Blob lifecycle policy—no ADF. When: Lifecycle for simple retention; ADF for complex or multi-system....

Question 8

How do you handle API rate limits in ADF?

Accepted Answer

Strategies: (1) Retry with backoff on activity. (2) Reduce parallelCopies or ForEach batchCount. (3) Wait activity between batches. (4) Stage and process in chunks with delays. (5) Azure Function/Databricks with rate limiting....

Question 9

How do you merge data from different sources in ADF while maintaining data quality?

Accepted Answer

Architectural approach: Data Flow or Lookup + Join. Quality: (1) Validation—filter nulls, invalid ranges. (2) Deduplication—Surrogate Key, Window. (3) Conform types. (4) Error handling—reject table for bad rows. Flow: Multiple sources → Join → Filter invalid → Dedupe → Sink....

Question 10

How do you use Azure Databricks notebooks within ADF pipelines?

Accepted Answer

Architectural flow: Databricks activity (Notebook or JAR) in pipeline. Linked service to Databricks (host, token/Azure AD). Specify notebook path, cluster (existing or job), parameters. Example: Copy → Databricks Notebook (transform) → Copy to Synapse....

Virtusa Cloud & Tools Interview Questions

Companies asking these questions

All 14 Questions

More Interview Prep Guides

Get All Answers in PDF Format

Virtusa Cloud & Tools Interview Questions

Companies asking these questions

All 14 Questions

More Interview Prep Guides

Get All Answers in PDF Format