
Data Engineer
- Toronto, ON
- Permanent
- Full-time
- Design, develop, and manage data pipelines that facilitate the detailed extraction, transformation, and loading of data from diverse sources.
- Automate infrastructure provisioning and deployment using tools such as Terraform.
- Collaborate with Architecture, security, and risk teams to implement the latest guidelines and Azure standard methodologies.
- Collaborate with business collaborators to suggest data solutions that align with business goals and improve decision-making processes
- Demonstrate a solid understanding of data privacy and compliance regulations and best-practices
- Bachelor’s degree or equivalent experience in computer/IT or data-related fields is required, with a Master’s degree being a plus.
- 6+ years of previous data engineering experience with Azure-related data technologies.
- Solid understanding of Azure infrastructure, including subscriptions, resource groups, resources, access control with RBAC (role-based access control), integrations with Azure AD, and Azure security principles (user group, service principal, managed identity), network concepts (VNet, Subnet, NSG rules, private endpoints), password/credential/key management, and data protection.
- Strong hands-on knowledge of Azure Databricks, ADF, ADLS, Synapse Serverless/dedicated/spark pools, Python, PySpark, and T-SQL, along with experience crafting and developing scripts for ETL processes and automation in Azure Data Factory and Azure Databricks.
- High proficiency in GIT/Jenkins/dev ops processes to maintain and resolve issues with data pipelines in production.
- Knowledge of implementing Azure technologies and networking via Terraform, along with the ability to fix issues with Azure infrastructure in production.
- Experience with data modelling, data mart, data lakehouse architecture, SCD, data mesh, and delta lake overall.
- We’ll empower you to learn and grow the career you want.
- We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
- As part of our distributed team, we’ll support you in crafting the future you want to see!