Gen AI Ops Senior Engineer

Own the production operations layer for Iris's Gen AI deployments — deployment pipelines, prompt versioning, evaluation harnesses, cost monitoring, and observability for LLM applications running in client environments.

• Build CI/CD pipelines for LLM application deployment and rollback
• Operate evaluation harnesses (offline + online) for prompt and model changes
• Instrument observability: latency, token usage, cost, hallucination signal
• Manage prompt versioning, A/B testing, and rollback workflows
• Containerize and orchestrate LLM workloads using Docker and Kubernetes
• Establish LLMOps standards across client engagements

• 5-8 years of engineering experience, with at least 2 in MLOps or LLMOps
• Strong Python and shell scripting
• Production experience with AWS Bedrock, Azure OpenAI, or comparable LLM platforms
• Hands-on Docker and Kubernetes for AI workloads
• Experience with cost monitoring and rate-limiting for LLM API consumption
• CI/CD expertise (GitHub Actions, Jenkins, GitLab CI)

Iris Software is a global IT services and digital engineering firm, founded in 1991 and headquartered in Edison, NJ. With approximately 3,700 associates across the United States, India (Noida, Gurugram, Chennai), and Canada, Iris partners with 25+ Fortune 500 clients across banking, capital markets, payments, and enterprise technology.

Iris has been certified as a Great Place to Work and named a “Leadership Factory of India” by the Great Manager Institute three consecutive years. The company operates documented programs for employee development including iWIN (women’s leadership), 180-degree feedback, skip-level meetings, townhalls, and quarterly pulse surveys. Iris is privately held, debt-free, and cash-flow positive since inception.