AI Ops Engineer

Are you passionate about building robust, scalable infrastructure for cutting-edge Generative AI? We’re looking for an AIOps Engineer to join our AI Foundation team in Bangalore to own and scale our AI/LLM production platform!

Location: Bangalore

Mode: Work from office

Responsibilities

• LLM Gateway & Orchestration: Own multi-model serving layers and orchestration across providers like AWS Bedrock.
• AI CI/CD: Build pipelines for seamless versioning, automated rollouts, and rollbacks of models, prompts, and AI microservices.
• Observability & Performance: Drive end-to-end tracing, logging, and alerting (OpenTelemetry, Grafana, Prometheus) while optimizing transaction costs and latency.
• Compliance & Security: Ensure secure handling of PHI/PII data in a production AI ecosystem.

Requirements

• Experience: 2+ years overall in DevOps/MLOps/Software Engineering, with 1–2 years hands-on with production LLM/AI systems.
• Tech Stack: Python, AWS (Bedrock, IAM, Compute), Docker/Kubernetes, GitHub Actions / GitLab CI.