Site Reliability Engineer - Data Platform

Kraken

  • Canada
  • Permanent
  • Full-time
  • 5 days ago
Building the Future of CryptoOur Krakenites are a world-class team with crypto conviction, united by our desire to discover and unlock the potential of crypto and blockchain technology.What makes us different?Kraken is a mission-focused company rooted in crypto values. As a Krakenite, you'll join us on our mission to accelerate the global adoption of crypto, so that everyone can achieve financial freedom and inclusion. For over a decade, Kraken's focus on our mission and crypto ethos has attracted many of the most talented crypto experts in the world.Before you apply, please read the page to learn more about our internal culture, values, and mission. We also expect candidates to familiarize themselves with the Kraken app. Learn how to create a Kraken account .As a fully remote company, we have Krakenites in 70+ countries who speak over 50 languages. Krakenites are industry pioneers who develop premium crypto products for experienced traders, institutions, and newcomers to the space. Kraken is committed to , , and through our products like , , , and .Become a Krakenite and build the future of crypto!Proof of workThe teamJoin our Data Infrastructure team and play a pivotal role in upholding the reliability, scalability, and efficiency of our robust Data platform. As a Senior Site Reliability Engineer (SRE) specialized in Data Infrastructure, you will collaborate closely with diverse cross-functional teams to conceive, execute, and oversee the foundational data infrastructure that empowers our array of applications and services.As a key member of our Data Infrastructure team, you will:Design the data governance mechanisms that ensure our lakehouse is easy to interact with, secure and in compliance with all applicable regulations.Implement the infrastructure we use to ingest our data, store it, catalog it with the right metadata and capture its lineage.Provide a state-of-the-art suite of BI tools for multiple teams within the company.Guarantee the availability, high performance, scalability and cost efficiency of our data platform.Your proficiency in cloud technologies, infrastructure as code, automation, monitoring, logging, user and machine AuthNZ, and certificate management will be instrumental in upholding the exceptional operational standards we set for our services.The opportunityImplement data infrastructure solutions (self service) that support the needs of 10+ business units and over 100 engineering and data analystsUtilize Infrastructure as Code (IaC) principles to design, provision, and manage both on-premises and cloud (AWS) infrastructure components using tools such as TerraformDevelop and maintain automation scripts using bash/shell scripting and to automate operational tasks and deploymentsEnhance and manage CI/CD pipelines to facilitate consistent software deployments across the data infrastructureImplement robust data monitoring and alerting solutions to proactively detect anomalies and performance issuesManage and implement role-based access control (RBAC) and permissions for a multitude of user groups and machine workflows across different environmentsManage and maintain real-time streaming data architecture using technologies like Kafka and Debezium Change Data Capture (CDC)Ensure the timely and accurate processing of streaming data, enabling data analysts and engineers to gain insights from up-to-date informationUtilize Kubernetes to manage containerized applications within the data infrastructure, ensuring efficient deployment, scaling, and orchestrationImplement effective incident response procedures and participate in on-call rotationsCollaborate with data analysts, engineers, and cross-functional teams to understand requirements and implement appropriate solutionsDocument architecture, processes, and best practices to enable knowledge sharing and support continuous improvementSupport AI/ML teams with their infra requestsSkills you should HODLProven experience (5+ years) working as a Site Reliability Engineer, Infrastructure Engineer, Data Infrastructure Engineer, or similar roles, with a focus on data infrastructure and securityExperience with maintaining real-time data processing technologies, such as Kafka and Flink clusters and Debezium instancesWorking experience in managing hybrid multi-tenant cloud systems particularly on AWSInfrastructure as Code tools such as Terraform, Terragrunt and AtlantisExperience with containerization and orchestration tools, particularly Kubernetes, Nomad, and DockerSolid understanding of bash/shell scripting and proficiency in at least one programming language (preferably Python or JVM languages)Experience maintaining data-related technologies: Apache Airflow, Apache Spark, DBs, BI toolingExperience solving data access management issues at large scale data-lakeFamiliarity with CI/CD deployment pipelines and related toolsStrong problem-solving skills and the ability to troubleshoot complex systemsExperience with data-related technologies (databases, data lakes, airflow, spark) is a plusThis job is accepting ongoing applications and there is no application deadline.Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution.We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.Kraken is powered by people from around the world and we celebrate all Krakenites for their diverse talents, backgrounds, contributions and unique perspectives. We hire strictly based on merit, meaning we seek out the candidates with the right abilities, knowledge, and skills considered the most suitable for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgable about crypto!As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind. Whether that's based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status or any other protected characteristic as outlined by federal, state or local laws.Stay in the know

Kraken