Generative Ai Engineer Gulbarga

AI Platform Engineer

Location: India Remote

Pay : INR 45
- INR 50 LPA

Experience
- 10–14+ years overall, operating at Lead / Principal level

Employment Type
- Full time

We are seeking a Lead Azure GenAIOps / LLMOps Engineer to design, build, and operate a secure, observable, governed Azure GenAI platform that can be reused by multiple product and business teams.

This role is not focused on model training or fine-tuning. Instead, it owns LLM operationalization, governance, observability, safety, cost control, and platform reliability across enterprise environments.

You will work at the intersection of AI Platform Engineering, LLMOps, Cloud Architecture, and DevSecOps, partnering closely with application teams, security teams, and cloud platform teams.

Key Responsibilities

Azure GenAI Platform Ownership

• Architect and operate a shared, multi-tenant Azure GenAI platform using:

Azure OpenAI

Azure AI Foundry (must-have)


• Define reference architectures for RAG, agents, and LLM-powered apps.

• Decide and document usage patterns across:

AKS, App Service, and Azure ML (Candidate should have robust experience with at least one; platform design should support multiple runtimes.)

LLM Runtime, Agent & Tool Governance

• Implement AI Gateway / Azure API Management for:

Model routing and abstraction

Throttling and quota enforcement

Authentication and authorization


• Govern agent runtimes, including:

Tool access control

Permissions and identity boundaries

Authentication, audit logging, and traceability


• Define MCP server / tool governance standards:

Function calling approvals

Tool versioning

Change control and auditability

CI/CD, Workplace Promotion & Configuration Management

• Build reusable pipeline templates for GenAI workloads.

• Define setting promotion models across:

DEV → NON-PROD → PROD


• Enforce:

Git-based prompt, agent, and config versioning

Approval workflows

Rollback and hotfix strategies


• Manage golden datase Apply on Kit Job: kitjob.in/job/4n54mx