Sr Engineer - AI Agentic API Management

Company: HP

Location: Bengaluru, Karnātaka, India

Type: Full-time

Posted: 2026-07-20

About this role

Sr Engineer - AI Agentic API Management

Description -

We are seeking an experienced engineering leader to design, build, and operate API Management layers for enterprise AI services. The role focuses on enabling secure, governed, and scalable access to managed AI services (LLMs, AI APIs, and agentic systems) through a centralized API gateway, aligned with Zero Trust principles and multi-cloud architecture.

This position plays a critical role in establishing API-first AI consumption patterns, ensuring policy enforcement, cost governance, observability, and secure integration across enterprise applications and agentic workloads.

Key Responsibilities

1. AI API Gateway Architecture & Design

  • Design and implement API Management (APIM) layers to expose AI services (LLMs, search, NLP, vision) securely
  • Establish northbound and southbound API patterns for external consumers and internal services
  • Build gateway-based abstraction layers to decouple consumers from underlying AI providers and models

2. Zero Trust Security & Identity Enforcement

  • Implement Zero Trust connectivity models for AI service exposure (identity-first, no implicit trust)
  • Enforce authentication, authorization, and token validation (JWT, OAuth, managed identity)
  • Integrate secure network controls such as private endpoints, NSGs, and TLS-based communication

3. Governance, Policy & Compliance

  • Define and enforce API policies for:

- Rate limiting, throttling, quota enforcement
- Data access control and PII protection
- Tool/API invocation governance for agentic systems
- Ensure compliance with enterprise security, audit, and regulatory standards

4. AI Service Integration & Abstraction

  • Enable unified access to multi-cloud AI services (Azure AI, AWS Bedrock, etc.)
  • Provide standardized API contracts and SDK patterns for application teams
  • Support agent-to-service communication via gateway-controlled interfaces

5. Cost Management & Optimization

  • Implement token-based and usa...

Create Your Job Alert

Other Sr Jobs

Other Jobs in Bengaluru