Back to jobs
Job Description
- Collaborate closely with the engineering team to support infrastructure development, meticulously track priorities, issues, deeply understand evaluation and experimentation results; coordinate alignment and, assessment with model teams.
- Collaborate with data scientists to design and integrate model evals, execute evals, and conduct loss analysis to inform model quality.
- Manage Gemini autorater platform and Gemini eval area compute capacity planning. Provide proactive status updates to stakeholders, and effectively triage autorater issues back to the modeling team.
- Drive strategic goals and tactical delivery. Lead with high agency. Proactively identify workflow gaps and implement scalable improvements to optimize efficiency and output quality.