AWS Data Engineer

Cleo Consulting View all jobs

  • Toronto, ON
  • Permanent
  • Full-time
  • 1 day ago
  • Apply easily
Assignment: RQ10941 - Software Developer - SeniorJob Title: AWS Data EngineerRequisition (SS): RQ10941Start Date: 2026-05-11Client: Health Services ClusterEnd Date: 2027-03-31Office Location: 5700 Yonge St., TorontoOrganization: Health Services ClusterMinistry: Ministry of Public and Business Service Delivery and Procurement# Business Days: 220.00Assignment Type: This position is listed as Onsite; the resource is expected to work 7.25 hours per calendar day between the standard working hours of 8:00-5:00 PM (excluding lunch breaks) every Monday to Friday inclusive at the identified OPS office location.MUST HAVES:
  • Data engineering (pandas, pyspark)
  • Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
  • Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
  • Extract/Transform/Load data using tools such as Informatica IDMC
DescriptionResponsibilities
  • Design, develop, test, implement, and troubleshoot:
  • data pipelines using Python and AWS services (Glue, StepFunctions, Lambda)
  • complex data transformation procedures
  • data models for the efficient storing of data in relational databases as well as in unstructured data repositories
  • re-useable classes and modules as to enhance the maintainability and ability to deliver solutions quickly.
  • Review existing code base and assist other more junior team members ensuring a consistent level of quality.
  • Assess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
  • Extension/Amendment Attestation:
  • Extensions are permitted only to the extent of unused contract days and/or remaining contract funds. No additional funds will be added beyond the maximum contract value, including any extension options set out in the original SOW.
Experience and Skill Set RequirementsGeneral Development Experience (Python) - 40 points
  • Data engineering (pandas, pyspark)
  • Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
  • Data processing automation
  • Linux experience
AWS Cloud Experience - 25 points
  • Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
  • Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)
Data Warehouse - 25 points
  • Data modeling (relational & dimensional), advanced SQL
  • Extract/Transform/Load data using tools such as Informatica IDMC
  • Data reporting/visualization
Software Development Life Cycle - 5 points
  • Full SDLC from requirements gathering, design, implementation, testing to deployment and production support
  • Familiar with project management (agile/scrum and waterfall)
  • Change and Incident management
General - 5 points
  • Communication, presentation and negotiation skills
  • Consulting, problem-solving and decision-making skills
  • Public sector experience

Cleo Consulting