Senior Azure GenAI / LLM Engineer

Astra North Infoteck Inc.

  • Toronto, ON
  • Permanent
  • Full-time
  • 16 days ago
Role: Senior Azure GenAI / LLM Engineer (Azure stack)
Experience: 5 - 8 years
Location: TorontoPrimary Skills: Python, LLM Models, Restful services,CI-CD, Azure stackKey Responsibilities1. Generative AI & LLM Application Development
  • Build and deploy LLM powered applications using:
o Azure AI Foundry (projects, prompt flows, evaluations, deployments)o Azure OpenAI (chat, embeddings, assistants/agents)
  • Implement use cases such as:
o Conversational AI and copilotso Knowledge assistants and Q&A systemso Intelligent document understanding and summarization
  • Integrate AI capabilities into enterprise applications via APIs and microservices [learn.microsoft.com], [ca.linkedin.com]
2. LangChain & LangGraph Implementation
  • Develop LLM orchestration logic using:
o LangChain chains, tools, retrievers, and memoryo LangGraph for graph based, stateful workflows
  • Implement:
o Multi step reasoning workflowso Tool calling and function executiono Supervisor/worker and multi agent patterns
  • Manage conversational state, context windows, and memory persistence [learn.microsoft.com], [dice.com]
3. RAG & NLP Engineering
  • Build Retrieval Augmented Generation (RAG) pipelines using:
o Azure AI Search (vector and hybrid search)o Embeddings from Azure OpenAI / Foundry model catalog
  • Engineer NLP pipelines for:
o Text extraction, classification, summarizationo Entity recognition and semantic search
  • Curate, chunk, embed, and validate enterprise knowledge sources for accuracy and freshness [learn.microsoft.com], [dice.com]
4. Python Based AI Engineering
  • Develop production grade Python services and libraries for AI workloads
  • Implement:
o API layers and orchestration serviceso Async execution, streaming, and batching
  • Optimize:
o Latency, cost, and token usageo Prompt structure and context management
  • Follow engineering best practices for testing, versioning, and modularity [dice.com]
5. Safety, Reliability & Governance
  • Implement guardrails and safety controls:
o Content filtering and moderationo Prompt validation and response checks
  • Build evaluation and feedback loops:
o Accuracy, relevance, and hallucination detectiono Regression testing for prompts and workflows
  • Ensure compliance with enterprise security and data handling standards [learn.microsoft.com], [dice.com]
6. Cloud & DevOps Integration
  • Deploy AI workloads using:
o Azure App Service, Azure Functions, or AKS
  • Integrate with:
o Azure Entra ID (authentication and authorization)o CI/CD pipelines and observability tools
  • Support monitoring, logging, and traceability of AI workflows in production [learn.microsoft.com]
Required Skills & ExperienceCore Skills
  • 5–8+ years of software engineering experience
  • Strong hands on Python development experience
  • Practical experience building applications using:
o Azure AI Foundryo Azure OpenAI Serviceo LangChain and LangGraph
  • Solid understanding of LLMs, RAG, and NLP concepts [dice.com]
Azure & AI Stack
  • Azure services:
o Azure AI Foundryo Azure AI Searcho Azure OpenAI
  • Experience with:
o Vector databases and embeddingso REST APIs and microservices
  • Familiarity with DevOps and cloud native deployment models
Soft Skills
  • Ability to translate solution designs into working code
  • Strong problem solving and debugging skills
  • Effective collaboration with architects and cross functional teams
  • Clear documentation and communication skills
Nice to Have
  • BFSI or regulated industry experience
  • Exposure to:
o MLOps / LLMOpso Evaluation frameworks and observability tooling
  • Experience with Responsible AI and governance frameworks
  • Azure AI or cloud certifications

Astra North Infoteck Inc.