Lead the AI Quality engineering team while building evaluation infrastructure, observability tooling, datasets, annotation workflows, and diagnostic systems for production AI agents. Design CI/CD evaluation pipelines, run experiments across prompts and models, diagnose agent failures, improve latency and cost, and partner with AI Core engineering. This is a hands-on player-coach role requiring production software experience and expertise in evaluating complex, tool-using LLM systems.