Back to jobs
Job Description
- Design, validate, and scale the quantitative metrics framework for conversational personalization quality, interactive memory, and proactive user nudges.
- Develop statistical methodologies to evaluate the trade-offs between proactive AI features and user friction.
- Partner directly with Engineering to build, validate, and optimize model-based evaluation frameworks (Auto-raters) within the personalization pipeline. Drive data-driven improvements across the entire quality flywheel, seamlessly connecting data acquisition, measurement via auto-raters, dashboard monitoring, and automated prompt optimization.
- Partner closely with core UXR, Product Management, and Engineering leads to translate qualitative user insights into scalable, quantitative experimentation and product roadmaps.