Evaluation Reliability SRE

Siri’s quality signal drives every model and product decision before a release ships. But a signal is only as trustworthy as the infrastructure behind it. The Evaluation Reliability Engineering (ERE) team exists to make that infrastructure bulletproof. Within ERE, Core SRE owns the production backbone: resource management, session orchestration, on-call response, and the observability systems that surface failures before they corrupt evaluation signal. We sit at the intersection of distributed systems, ML evaluation infrastructure, and operational excellence.