Principal Engineer, Data Systems
Index Exchange
- Montreal, QC
- Permanent
- Full-time
- Leadership Across Domains:
- Provide strategic leadership across multiple domains, collaborating with cross-functional teams such as product, operations, infrastructure, and platform engineeing to achieve business objectives.
- Foster a culture of innovation, continuous improvement, and collaboration within the data systems team.
- Advocate for strategic directions that reduce our complexity and tech stack footprint.
- Demonstrate deep expertise in our core data streaming components, including Kafka, Spark, Hadoop, Presto/Trino, Flink and Redis in a low latency environment.
- Architect relational data structures for performance, scale, and continuity.
- Drive technical excellence by staying abreast of industry trends, evaluating emerging technologies, and making recommendations for adoption.
- Lead initiatives with other cross-functional Principal engineering staff that are supporters and consumers of your data systems.
- Ensure robust operational processes are in place to guarantee stability and scalability of database environments.
- Develop and implement best practices for database administration, monitoring, and maintenance using opensource observability and instrumentation tools.
- Develop and enhance testing and production release procedures with a automation-first core principle to end-to-end delivery.
- Collaborate effectively with cross-functional teams, including developers, system administrators, and data scientists, to optimize database performance and functionality.
- Communicate complex technical concepts to non-technical stakeholders, fostering understanding and alignment across the organization.
- Participate in quarterly planning events to present your roadmaps and ensure strong alignment with the objectives and the broader technology teams.
- Lead efforts in problem identification, troubleshooting, and resolution to minimize downtime and enhance our Exchange reliability.
- Lead restrospective/rca engagements for data systems to ensure we are on a continuous improvement path.
- Deep understanding of streaming data components, including Kafka, Spark, Hadoop, Presto/Trino, Flink and Redis.
- Possess strong working knowledge of Ansible, Terraform, Kubernetes, Grafana, Prometheus, ELK
- Exposure and understanding of on-premise datacenter operations
- Exposure to other key database technologies is a plus (e.g. MySQL, MariaDB, Galera, PostgreSQL, Vertica, Aerospike).
- 3-5 years of proven experience as a Principal Engineer or similar role.
- In depth expertise with streaming data components Kafka, Spark, Flink
- Hadoop, Presto/Trino, Redis
- Demonstrated leadership, mentoring, and collaboration skills balancing strategic and tactical needs.
- Excellent problem-solving and troubleshooting abilities, diagnosing at depth for a globally distributed infrastructure with low-latency requirements.
- Effective communication skills, both technical and non-technical audiences
- Comprehensive health, dental, and vision plans at no cost to you
- Time off and flexible work schedules
- Retirement plan with a 5% company match
- Stock options and equity packages
- Generous parental leave
- Monthly wellness stipend plus fitness discounts and quarterly wellness group activities
- Community engagement opportunities and donation-matching program
- Annual virtual company retreats and regular community-led team events
- One day off per year to volunteer
- A workplace that supports a diverse, equitable, and inclusive environment -