Azure Data Factory Lead

MalaceHR

Toronto, ON
Permanent
Full-time

20 days ago

$75+/hourWe are seeking an experienced Azure Data Factory Lead with migration experience to oversee end‑to‑end data integration, orchestration, and cloud-based ETL workflows using Azure services. This onsite role requires hands-on expertise in Azure Data Factory, Azure Data Bricks, Data Lake, and modern data engineering practices. The ideal candidate will lead solution design for Informatica workflow to ADF, guide development teams, and collaborate closely with business stakeholders to deliver scalable and secure data pipelines.Key Responsibilities
1. Solution Design & Architecture

Lead the design and architecture of enterprise-grade ETL/ELT pipelines using Azure Data Factory (ADF).
Define and implement data ingestion patterns from on-prem, SaaS, and cloud sources.
Architect data solutions leveraging Azure Data Lake Storage (ADLS), Azure Synapse Analytics, SQL Database, Databricks, etc.
Ensure security, scalability, and performance best practices across data workflows.
Understand Informatica workflows and design migration of workflows into Azure Data Factory

2. Development & Implementation

Build and optimize complex data pipelines, data flows, and orchestrations in ADF.
Develop reusable templates, frameworks, and automation scripts.
Implement CI/CD for ADF using Git repos and Azure DevOps pipelines.
Perform systematic testing—unit, functional, integration—of data pipelines.

3. Leadership & Stakeholder Management

Lead and mentor a team of data engineers and developers.
Work directly with business SMEs, product owners, and project managers.
Translate business requirements into technical solutions.
Provide daily technical guidance and ensure project delivery quality.

4. Operations & Governance

Oversee pipeline performance, monitoring, alerting, and troubleshooting.
Establish governance standards for data quality, lineage, and metadata management.
Ensure compliance with enterprise and regulatory standards (PII, GDPR, etc.).

Required Skills & Experience
Technical Skills

10+ years of experience in Data Engineering, with 6+ years specifically in Azure.
Strong expertise in:

Azure Data Factory (pipelines, data flows, triggers, integration runtimes)
Azure Data Lake Storage (ADLS Gen2)
Azure Synapse Analytics (SQL pools, notebooks)
Azure SQL / SQL Server / T-SQL
Azure DevOps (Repos, Pipelines, CI/CD)
Data modeling & data warehousing principles (Star schema, SCDs)
Experience integrating with APIs, REST endpoints, Flat files, Databases, SAP, or ERP sources.
Good understanding on Informatica workflow
Good understanding of Databricks / PySpark is a plus.

Soft Skills

Strong communication and stakeholder-management skills.
Ability to lead teams and coordinate across onsite–offshore models.
Problem-solving mindset and ownership-driven.

Preferred Qualifications

Microsoft Azure certifications (DP-203, DP-900, etc.)
Experience with agile methodologies.

MalaceHR

Apply Now