ROCm AI System Software Architect

Advanced Micro Devices

  • Markham, ON
  • Permanent
  • Full-time
  • 13 days ago
Job Description:WHAT YOU DO AT AMD CHANGES EVERYTHINGWe care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming and embedded. Underpinning our mission is the AMD culture. We push the limits of innovation to solve the world’s most important challenges. We strive for execution excellence while being direct, humble, collaborative, and inclusive of diverse perspectives.AMD together we advance_THE PERSONYou are an expert on efficient system software design and optimization. You have strong technical and analytical skills in C/C++ and Python, with experience in AI development across Windows and Linux environments. You’re familiar with GPU programming and compilers. As a capable problem-solver and a technical leader, you excel at defining goals, scoping projects, and driving development efforts. With excellent communication skills and a passion for AI technologies, you are motivated to deliver feature-rich, efficient solutions to customers.THE ROLEWe are seeking an expert-level Machine Learning System Software Engineer to join the AMD GPU Technology and Engineering Software Team. You will develop cutting-edge AI software technologies, optimize the AI software stack, and deliver innovative solutions with powerful engineer-oriented debugging/profiling tools across AMD Radeon and Ryzen product families. Collaboration with cross-functional teams will be essential to ensure peak performance of AI solutions.KEY RESPONSIBILITIES
  • Develop and deliver advanced AI software solutions for AMD customers and users.
  • Enable and optimize the AI software stack for frameworks like PyTorch, vLLM, and GGML/llama.cpp, as well as emerging open-source AI software.
  • Implement state-of-the-art AI models and enhance their performance.
  • Lead the full AI software development lifecycle, including scoping, implementation, integration, verification, and customer enablement.
  • Drive and deliver powerful debugging and profiling tools with consistent user experience across Radeon GPUs on both Linux and Windows
PREFERRED EXPERIENCE
  • Expertise in system software design and optimization, with experience on cross-platform development and programming languages C/C++ and Python.
  • Proven problem-solving skills and effective communication abilities.
  • Experience with AI frameworks, inference stacks, and GPU-accelerated development, including GEMM, CONV, Flash Attention, fused MoE, and non-linear operators.
  • Compiler and low-level GPU programming is a plus.
  • Solid understanding of AI/ML concepts, with knowledge of the performance impact of compute, memory, and communication configurations.
  • Open-source software development experience is a plus.
ACADEMIC CREDENTIALS
  • Bachelor’s, Master’s, or PhD in Computer Science, Electrical Engineering, or a related field.
#LI-IA1#LI-HybridBenefits offered are described: .AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

Advanced Micro Devices