CAN_Analyst
Varite View all jobs
- Toronto, ON
- Permanent
- Full-time
Senior Data Engineer (Databricks-Focused)We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks.
This role will lead the design of data architecture, develop high-performance pipelines, and own end-to-end data workflows while mentoring junior engineers.Key Responsibilities
Design and implement Lakehouse architectures using Delta Lake.
Build and optimize batch and streaming pipelines using Apache Spark (PySpark/Scala).
Own end-to-end data flows: ingestion → transformation → modeling → serving.
Implement data quality, monitoring, and CI/CD best practices.
Optimize cluster performance and cost efficiency within Databricks.
Provide technical leadership, conduct code reviews, and mentor junior engineers.Required Experience
8+ years in data engineering, with strong hands-on experience in Databricks.
Advanced SQL and data modeling expertise.
Deep experience with Spark performance tuning and large-scale data processing.
Strong understanding of cloud platforms (AWS, Azure, or GCP).
Proven ability to design and deliver production-grade data platforms.Required Skills: Digital Databricks E3Experience: 6-8 years
Skills: Category Name Required Importance Experience
SkillCategoryTest1_MN Databricks Yes 1