Senior Data Engineer

Halifax, NS
Permanent
Full-time

2 months ago

Join Kainos and Shape the FutureAt Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting-edge Workday solutions, or pushing the boundaries of technology, we do it together.We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.Kainos is recognised as one of the leading AI and data businesses, with a decade-long track record of delivering impactful, production-grade Data and AI solutions for clients across government, healthcare, defence, and commercial sectors. Kainos is at the forefront of AI innovation, trusted by Microsoft, AWS, and others to deliver advanced AI and data solutions at citizen scale.Our 150-strong AI and Data Practice brings together deep expertise in data, machine learning, generative AI, and agentic AI. We are pioneers in responsible AI, and we partner with leading organisations to ensure AI is deployed ethically, securely and with measurable business value. Our teams are at the cutting edge of data and AI research, and delivery, it is truly an exciting team to join Kainos as we further grow our capability.MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS:As a Senior Data Engineer at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.Your responsibilities will include working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution. Working with Architects and Lead Engineers to ensure the software supports non-functional needs. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality. Working with operations teams to ensure operational readiness. Advising customers and managers on the estimated effort and technical implications of user stories and user journeys. Coaching and mentoring team membersIt is a fast-paced environment, so it is important for you to make sound, reasoned decisions. You will do this whilst learning about new technologies and approaches, with talented colleagues that will help you to develop and grow. You will support your colleagues and more junior colleagues, providing direction support as you solve challenging problems together.MINIMUM (ESSENTIAL) REQUIREMENTS:

Strong software development experience in one of Java, Scala, or Python

Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment

Proficient in SQL and SQL extensions for analytical queries

Solid understanding of ETL/ELT data processing pipelines and design patterns

Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats

Able to write quality, testable code and has experience of automated testing

Experience with Continuous Integration and Continuous Deployment techniques

DESIRABLE:

Experience of data pipeline development

Experience of Docker and Kubernetes

Experience of performance tuning

Experience of data visualisation and complex data transformations

Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

Expertise in continuous improvement and sharing input on data best practice

WHO YOU ARE:Our vision is to enable outstanding people to create digital solutions that have a positive impact on people’s lives. Our values aren't abstract; they are the behaviours we expect from each other every day and underpin everything that we do. We expect everyone to display our values by being determined in how obstacles are overcome; honest when dealing with others; respectful of how you treat others; creative to find solutions to complex problems and cooperative by sharing information, knowledge and experience. These values, applied collectively, help to produce an outstanding Kainos person, team and culture.ABOUT USAt Kainos we use technology to solve real problems for our customers, overcome big challenges for businesses, and make people’s lives easier. We build strong relationships with our customers and go beyond to change the way they work today and the impact they have tomorrow.Our two specialist practices, Digital Services and Workday, work globally for clients across healthcare, commercial and the public sector to make the world a little bit better, day byday.For more information, see kainos.com.Embracing our differencesAt Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field.Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

Kainos

Apply Now