Software Engineering Manager - (inference/Token/Gen AI)

Nutanix View all jobs

  • Vancouver, BC
  • $249,600 per year
  • Permanent
  • Full-time
  • 15 days ago
Hungry, Humble, Honest, with Heart.The OpportunityAre you a visionary leader with a passion for leveraging cutting-edge AI technologies and a track record of building scalable systems in complex environments? If so, joining our team as the Technical Manager- AI Factory at Nutanix means you'll be at the forefront of AI innovation, collaborating with talented engineers to shape the future of enterprise AI solutions while making a significant impact in a dynamic, hybrid work environment.About the TeamYou will report to the Senior Engineering Leader, who adopts a collaborative leadership style that encourages team involvement in decision-making and values open discussions. We are seeking a deeply Technical Engineering Manager who truly understands the "inference game"-someone who can navigate the complexities of KV cache management, throughput optimization, and GPU orchestration while leading a nimble, fast-moving AI systems team. The leadership emphasizes the importance of strong communication and rapid problem-solving, aiming to build a high-velocity environment where technical excellence and professional development go hand-in-hand.This role requires occasional travel for strategic planning and key team-building initiatives. Outside of these trips, the new hire will focus on their responsibilities within the local team while collaborating effectively with US counterparts through virtual meetings and communication tools. This position is perfect for a technical leader who thrives in the high-stakes, rapidly evolving landscape of generative AI and distributed systems.Your Role
  • Lead the design and implementation of scalable AI Factory solutions across diverse enterprise environments.
  • Collaborate with cross-functional engineering and product teams to define and enhance the product roadmap.
  • Create and maintain reference architectures and operational models to ensure continuous delivery and operational excellence.
  • Drive hands-on development of production-grade platforms utilizing Kubernetes for container orchestration.
  • Establish high-performance inference pipelines and AI Gateways, ensuring optimal performance and scalability.
  • Translate market trends into actionable engineering objectives, prioritizing real-world enterprise applications.
  • Mentor and guide engineering teams, fostering a culture of innovation, collaboration, and knowledge sharing.
  • Set strategic goals for the first year, focusing on building foundational AI capabilities and driving customer satisfaction.
What You Will Bring
  • Proven experience in building and scaling production-grade platforms on Kubernetes (EKS, AKS, On-Prem).
  • Direct experience in developing high-performance inference pipelines and AI Gateways.
  • Strong understanding of Distributed Systems Architecture, including multi-cluster and hybrid-cloud management.
  • Expertise in creating solutions tailored for AI practitioners with a focus on UX and security.
  • Strategic mindset with the ability to navigate market shifts and translate them into actionable engineering roadmaps.
  • Advanced knowledge of GPU resource optimization and automated fine-tuning techniques.
  • MS or PhD in Computer Science, focusing on Distributed Systems or Machine Learning, preferred.
  • Exceptional communication skills and experience interacting with C-level executives and cross-functional teams.
Work ArrangementHybrid: This role operates in a hybrid capacity, blending the benefits of remote work with the advantages of in-person collaboration. In locations where our workplace policy applies (i.e. San Jose, Durham, Mexico City, Bangalore, Pune, Hoofddorp, Belgrade, Barcelona, Singapore, Sydney and Tokyo), employees are expected to work onsite a minimum of 3 days per week to foster collaboration, team alignment, and access to in-office resources. Workplace type may vary based on location and team requirements. Please speak with your recruiter for details. Additional team-specific guidance and norms will be provided by your manager.The pay range for this position at commencement of employment is expected to be between USD $166,400 and USD $249,600 per year.However, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements, including a sign-on bonus, restricted stock units, and discretionary awards in addition to a full range of medical, financial, and/or other benefits (including 401(k) eligibility and various paid time off benefits, such as vacation, sick time, and parental leave), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.If hired, employee will be in an "at-will position" and the Company reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors. Our application deadline is 40 days from the date of posting. In good faith, the posting may be removed prior to this date if the position is filled or extended in good faith.--Nutanix is an equal opportunity employer.Nutanix is an Equal Employment Opportunity and (in the U.S.) an Affirmative Action employer. Qualified applicants are considered for employment opportunities without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, protected veteran status, disability status or any other category protected by applicable law. We hire and promote individuals solely on the basis of qualifications for the job to be filled. We strive to foster an inclusive working environment that enables all our Nutants to be themselves and to do great work in a safe and welcoming environment, free of unlawful discrimination, intimidation or harassment. As part of this commitment, we will ensure that persons with disabilities are provided reasonable accommodations. If you need a reasonable accommodation, please let us know by contacting .

Nutanix