CAN_Developer
Varite View all jobs
- Brampton, ON
- Permanent
- Full-time
Hands on with Unity Catalog governance and lineage.
Azure services ADLS Gen2| ADF Pipelines| Key Vault| Event HubService Bus| Azure DevOps.
Experience delivering RAGagentic patterns (embeddings pipelines| chunking| indexing| evaluation).
Solid SQL and data modeling understanding of medallion and ACID. Proven experience implementing MCP (Model Context Protocol) for agenttool integrations
Building MCP serversadapters to expose toolsresources (SQL| REST| files| etc.).
Defining tool schemas| inputoutput contracts| and safetyguardrails.
Securing MCP integrations with Azure ADEntra| Key Vault| secret scopes| and network controls.
Connecting MCP to Unity Catalog governed assets| Vector Search| and Model Serving.Essential Skills:
AIGenAI Engineering- MCP Build GenAIready datasets| embeddings pipelines| and vector indexes for RAG.
Use Databricks Genie to accelerate code creation| optimization| documentation| and refactoring.
Implement Model Context Protocol (MCP) patterns to connect AI agents to enterprise data and tools Design| build| and operate MCP serversadapters that expose tools (e.g.| SQL| REST| file systems| APIs) to agents.
Implement tool schemas| resource providers| and prompttool safety policies for MCP.
Integrate MCP with Azure Databricks workloads (Delta tables| Unity Catalog| Vector Search| Model Serving).
Secure MCP endpoints with Key Vault| secret scopes| network rules| and role based access aligned to Unity Catalog.
Operationalize RAGagentic workloads using Vector Search| Model Serving| Feature Store| MLflow.Azure Cloud Integration -Integrate Azure Databricks with ADLS Gen2| ADF Pipelines| Key Vault| Event HubService Azure Functions.
Implement telemetry and observability via Azure Monitor| Log Analytics| and Databricks metrics.Data Governance -Architecture Implement Unity Catalog for governance| lineage| and access controls across workspaces. Apply Medallion Architecture (BronzeSilverGold) and enforce data quality with Delta Live Tables and expectations.
Manage PIIPHI controls| data masking| and secure sharing (e.g.| Delta Sharing as applicable).DevOps Automation- Build CICD pipelines via Azure DevOps or GitHub Actions use Databricks Repos for version control. Orchestrate jobs with Databricks Workflows andor ADF implement promotion paths across environments.Skills: Digital : Microsoft Azure~Digital : Azure Machine Learning (ML)Experience Required: 10 & AboveSkills: Category Name Required Importance Experience
SkillCategoryTest1_MN Digital : Azure Machine Learning (ML) Yes 1 7+ years