Test Automation Engineer @MarshTech

Company:

Mercer

Description:

We are currently seeking a highly skilled and motivated Test Automation Engineer to join our Innovation Team. In this role, you will play a key role in developing, implementing, and supporting innovative automation test strategies to ensure the delivery of high-quality software that leverages cutting-edge AI and generative technologies. The ideal candidate is a self-starter, delivery-focused, and possesses a broad set of technical skills, with the ability to minimize the impact of bugs through root-cause analysis of complex business processes and prevent reoccurrence, all while working at the forefront of emerging AI and generative tech advancements. This position will be based in Cluj-Napoca, Romania.

We will count on you to:

• Ensure that business requirements for both Functional and Non Functional areas are gathered accurately, understood, and have clear understanding of the Business Acceptance criteria
• Form a Test Strategy that includes Shift left Test automation as the key principle
• Ensure test coverage for all critical Functional and Non Functional business scenarios
• Hands-on; Creating automated Test suites for Integration, Regression including API, Data validation both back end and front end and edge scenarios
• Testing AI/Gen AI business applications, including validating non-deterministic outputs and model-driven behaviors
• Design and implement evaluation approaches for LLM-based systems, including prompt testing, output quality assessment, and benchmarking
• Demonstrate usage of Gen AI in tooling & AI driven insights reporting. Creating/Reusing AI utilities/components for Testing
• Identify non automated test cases to be performed manually
• Define and execute testing strategies for non-deterministic systems and components
• Work closely with a Lead Software Engineer to define code review, Unit test and acceptance test strategy
• Follow good agile practices that are foundational to product delivery
• Troubleshoot and resolve Test scripting issues
• Log and track defects and provide regular updates to the squad on code and product quality, perform periodic defect trend analysis
• Work closely with Software Engineers and User Acceptance team to resolve bug and quality issues
 

What you need to have:

• Strong understanding of Test Engineering and Quality Assurance best practices, tools and policies
• Experience testing AI/Gen AI business applications, including working with non-deterministic systems
• Experience with evaluation methodologies for Large Language Models (LLMs), including prompt testing, output quality assessment, and benchmarking
• The ability to communicate effectively to both technical and non-technical colleagues in a cross-functional environment
• Proven track record of successfully delivering Quality software solutions
• Experience or knowledge of working with Agile at Scale, Lean and Continuous Delivery approaches such as Continuous Integration, Test-Driven Development and Infrastructure as Code
• Knowledge of API testing
• Familiar with Automation Framework Design and Implementation
• Understanding of CI/CD and DevOps practices
• Good communication skills
• Strong Self-starter and active squad contributor
• Experience of testing software across a variety of languages, technologies, and platforms

Technical skills required:

• Proficient in the following Test automation languages and frameworks: TypeScript, Playwright
• Strong experience working with API test automation
• Knowledge of Cypress automation testing
• Experience with Mongo
• Good understanding of working with a source control system such as Github
 

Why join our team:

• We help you be your best through professional development opportunities, interesting work, and supportive leaders;
• We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have an impact for colleagues, clients, and communities;
• Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being;
• A yearly budget and the opportunity to build your flexible benefits package (up to 20% of your annual salary);
• 30+ days off (25 legal days off, 1 extra day off on your birthday, public holiday replacement days, extra buy/sell from your benefits budget);
• Performance Bonus scheme;
• Matching charity contributions, charity days off, and the Pay it Forward charity challenge;
• Core benefits - Pension, Life and Medical Insurance, Meal Vouchers, Travel Insurance;

Marsh (NYSE: MRSH) is a global leader in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries. With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective. For more information, visit corporate.marsh.com, or follow us on LinkedIn and X.

Marsh is committed to creating a diverse, inclusive and flexible work environment. We aim to attract and retain the best people and embrace diversity of age, background, disability, ethnic origin, family duties, gender orientation or expression, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, or any other characteristic protected by applicable law.

Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office. All Marsh colleagues are expected to be in their local office or working onsite with clients at least three days per week. Office-based teams will identify at least one “anchor day” per week on which their full team will be together in person.