Director - AI Engineer
Company: KPMG India
Location: Bangalore, Karnataka, India
Work arrangement: On-site
Employment type: Full-time
Experience: 10+ years
Education: bachelor degree
Posted: 2026-10-22
Responsibilities
Provide strategic and operational leadership for AI engineering teams to deliver enterprise-grade GenAI and agentic solutions. Define the AI engineering roadmap while ensuring scalable, secure, and governed architectures across the organization.
Requirements
Requires 15+ years of experience in software, data, and AI engineering with at least 5 years in senior leadership roles. Candidates must possess deep expertise in LLMs, MLOps, cloud-native platforms, and AI governance frameworks.
Skills
- Artificial Intelligence
- Machine Learning
- GenAI
- LLMs
- Python
- Cloud Computing
- MLOps
- LLMOps
- RAG Architectures
- Vector Databases
- Data Engineering
- Software Engineering
- Leadership
- Stakeholder Management
- AI Governance
- Prompt Engineering
About this role
Job Requirements
Mandatory Skills
* 15+ years of experience across software engineering, data engineering, and
AI/ML engineering, with 5+ years in senior technology leadership roles
* Strong engineering foundation with hands‑on experience as an individual
contributor before transitioning into leadership
* Proven experience building and scaling enterprise AI platforms, including
GenAI, ML, and intelligent automation solutions
* Expertise in LLMs, GenAI architectures, agent-based systems, and AI workflow
orchestration
* Hands-on understanding of prompt engineering, RAG architectures, vector
databases, embeddings, and context management
* Experience implementing AI solutions on cloud-native platforms (GCP, AWS,
Azure), including managed AI services
* Strong proficiency in Python, APIs, and modern engineering stacks; working
knowledge of Java/Scala/Go preferred
* Deep understanding of MLOps / LLMOps, CI/CD for AI, model lifecycle
management, and observability
* Experience with Responsible AI, AI governance, security, privacy, and
compliance, especially in regulated environments
* Proven ability to lead large, distributed, multi-disciplinary teams and drive
organizational change
* Strong stakeholder management skills and ability to engage with senior
leadership and client executives
Primary Roles and Responsibilities
* Provide strategic and operational leadership for AI Engineering teams
delivering enterprise AI, GenAI, and agentic solutions
* Define and execute the AI engineering vision, roadmap, and operating model
aligned with business strategy
* Oversee the design and delivery of:
* GenAI platforms and reusable AI capabilities
* AI-powered developer productivity and coding assistant solutions
* Agentic and workflow-driven automation systems
* Ensure scalable, secure, and governed AI architectures, including RAG,
orchestration layers, and enterprise context management
* Partner closely with Data Engineering, Cloud Engineering, Product, Security,
Legal, and Risk teams
* Drive adoption of MLOps / LLMOps best practices, including CI/CD, evaluation,
monitoring, and cost governance
* Establish AI governance frameworks covering responsible AI, model risk,
explainability, auditability, and regulatory compliance
* Promote a platform and product mindset, enabling reuse, standardization, and
accelerated delivery
* Lead AI modernization initiatives, including migration from experimental AI
to production-grade enterprise deployments
* Build and scale high‑performing teams through hiring, mentoring, and
leadership development
* Define clear OKRs, KPIs, and success metrics for AI engineering initiatives
* Represent the AI Engineering function in enterprise forums, client
engagements, and innovation councils
* Drive collaboration, transparency, and a culture of continuous learning and
innovation
Preferred Skills
* Experience with enterprise GenAI platforms (Gemini, OpenAI, Azure OpenAI,
Vertex AI, Bedrock, etc.)
* Exposure to AI coding assistants, developer copilots, and software
modernization using AI
* Knowledge of data mesh or federated AI/data architectures
* Experience working with regulated industries (Healthcare, Life Sciences,
BFSI)
* Strong understanding of AI cost management, token optimization, and usage
governance
* Demonstrated ability to influence at executive and board levels
About KPMG India
Business Consulting and Services · 10,001+ employees · headquartered in Gurugram, Haryana