Back to jobs
EY

CT Engineering - Product Testing - Test Lead

Bengaluru, KAPosted Today

Job Description

  • Lead the test activities to ensure product quality, setting project timelines and supervising the activities of other testers.
  • Drive the identification of the test scope and test environment set-up, prepare test plans, identify relevant metrics and keep track of required effort.
  • Manage the execution of tests, review reports and interpret recommendations for product or design changes.
  • Define and implement comprehensive test strategies, standards, and risk-based coverage.
  • Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
  • Evaluate and adopt cutting-edge automation tools and technologies, including AI-assisted test generation and validation
  • Drive automation coverage goals, balancing risk-based testing with efficiency improvements to reduce manual effort.
  • Architect and maintain reusable automation frameworks for both traditional and AI-driven applications, integrated with CI/CD pipelines.
  • Define and implement automation strategies across functional and AI testing domains, ensuring scalability and maintainability.
  • Design, develop, and maintain standard and ad-hoc reports tailored to business needs. Implement automated reporting processes to reduce manual effort and improve timeliness.
  • Drive defect triage, prioritization, and release readiness decisions.
  • Develop relationships with other engineering groups to evaluate, recommend and implement testing procedures for products, systems, components or modifications.
  • Implement AI testing strategies including DeepEval for model evaluation, ensuring robustness and reliability of outputs.
  • Design and execute test plans for RAG (Retrieval-Augmented Generation) frameworks, validating retrieval and generation accuracy.
  • Develop agentic validation workflows for multi-agent systems, focusing on reasoning accuracy and orchestration.
  • Conduct bias, fairness, and ethical compliance testing for AI models.
  • Build reusable automation frameworks for AI testing integrated with CI/CD pipelines.
  • Lead and mentor a cross-functional testing team, fostering collaboration across AI, data engineering, and product development groups.
  • Define strategic testing roadmaps for AI-driven products and manage stakeholder communication on quality metrics and risks.
  • See Your Match Score

    Sign up and Renata will show you how this job matches your skills and experience.

    10001+ employees
    London, GB
    Website
    CT Engineering - Product Testing - Test Lead at EY | Renata