Back to jobs
Job Description
- Collaborate with Product Management, Engineering and Product Marketing teams to launch new products, scale operations, surface critical data signals to increase user engagement and improve developer Return on Investment (ROI).
- Own product data streams, partnering with subject matter experts to implement evaluations to production and collect data from rater teams at scale.
- Track data quality and operational Key Performance Indicators (KPIs) and perform analysis to drive continuous improvement and troubleshoot issues.
- Work closely with global vendor raters, vendor managers and vendor trainers to identify gaps or issues in data collection, and design and implement solutions to address them.
- Stay up to date on the latest data labeling methods, including human rater labeling and machine learning, and make recommendations for LLM-first solutions to scale output.