Senior Data Engineer
Vancity View all jobs
- Vancouver, BC
- $113,100-139,650 per year
- Permanent
- Full-time
- Designing, developing, and maintaining robust, scalable data pipelines (batch and streaming)
- Leading, implementing and optimizing ETL/ELT processes using modern data engineering frameworks.
- Designing and implementing data model using different modelling standards
- Optimizing and troubleshooting data performance, reliability, and cost across storage and computing layers.
- Creating and managing knowledgebase, access controls, deployment pipeline architecture and infrastructure related to Data Platform.
- Acting as tech advisor and collaborating on analytics, platform, security, and infrastructure teams both technical and non-technical audiences
- Documenting architecture, pipelines, and operational procedures
- Operating as a senior individual contributor with no formal people management responsibilities
- Ensuring data quality, validation, and observability across pipelines
- Bachelor’s degree in computer science or related technical discipline
- 5+ years of industry experience in Data Engineering or related field handling data processing and transformation of disparate datasets
- Experience with big data and analytics programming languages such as Python, R, Spark in Databricks
- Experience with batch and real-time processing frameworks (EventHub, Apache Spark, Apache Kafka, etc.)
- Willingness to work in a highly flexible environment with multiple competing priorities
- Proven ability to innovate and adapt to the latest development in area of expertise
- Ability to adapt and grasp new skills and content
- Experience – designing and implementing data integrations in Azure data stack such as Azure Data Lake, Azure Data Factory, Azure Databricks, EventHub
- Exposure - to DevSecOps practices to incorporate security first principles
- Good understanding - of data storage, data mapping and modelling, real-time data handling
- Living Wage Employer: We’re the largest private-sector Living Wage Employer in Canada and consistently ranked among Canada’s Top Employers.
- Customizable Benefits: Permanent employees receive flexible benefit packages that can be tailored annually to meet evolving needs.
- Generous Vacation: New employees start with 3-4 weeks of vacation per year, with additional days earned over time.
- Extra Stat Holidays: In addition to BC’s 11 statutory holidays, we offer 2 extra days, plus care days for personal or family illness.
- Immediate Health Coverage: Health and dental benefits begin on your hire date, with three levels of coverage to choose from.
- Defined Benefit Pension: Our retirement plan provides a guaranteed income for life, recognizing that retirement looks different for everyone.