Lead Data Engineer

Atlantis

  • Toronto, ON
  • Permanent
  • Full-time
  • 2 days ago
  • Apply easily
Role name Lead Data EngineerLocation Toronto, ON - HybridDuration Long Term contractExpereince Level 8+yrsRole Description:
  • Develop and maintain backend systems using Python, PySpark ensuring high performance, scalability, and reliability.
  • Participate in the design and implementation of data engineering and ETL pipelines using PySpark.
  • Collaborate with DevOps and Operations teams to ensure smooth deployment and operation of applications.
  • Expert in DevOps practices and tools for CICD pipelines.
  • Experience with cloud platforms, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)Experience with PySpark for Data Engineering ETL pipelines
  • Familiarity with containerization using Docker and orchestration using Kubernetes
Desirable Skills:8+ years of strong design, development experience using c#, .net core, Web API, angular/react, asp.net, mvc3+ years of strong development experience using sqlserver/oracle/sybase, complex procedures and SSIS/SSRSWorking experience in financial domainExperience working with devops, source code management tools like git, svn, jira, ucd, jenkins.Experience working with Agile/Scrum/RAD development methodologyNice to have container based technologies like docker, kubernetes, openshift ,cloud platform and familiar with big-data and cloud based technologiesRegards,Email: , Phone#: 6788247770

Atlantis