Back to jobs

Senior Technical Program Manager, Customer Engagement, Applied AI
Posted Today
Job Description
- Be a thought leader within Google and industry on the subject matter domain of the respective organization.
- Establish a reliable and visible cadence for portfolio reviews, decision-making, prioritization, and resource management, whereby improvements are measurable and the impact can be felt organization wide.
- Lead the implementation of evaluation pipelines and testing frameworks, ensuring every Large Language Model (LLM) prompt or reasoning update is validated against benchmark datasets to prevent regressions in agent accuracy, persona alignment, and brand voice.
- Utilize specialized dashboards to monitor agent health, tracking Key Performance Indicators (KPIs) such as accuracy, hallucination rates, and latency to ensure the agent is production ready and provides a fluid, human-like experience.