Test Automation Specialist - #2169946

ROLE PURPOSE Lead automation-first quality engineering across digital services, APIs and AI-enabled products. The role will build scalable test frameworks, embed continuous testing in delivery pipelines and establish robust quality approaches for Generative AI and agent-based solutions.

Key responsibilities

• Design, develop and maintain reusable UI automation frameworks using Playwright, Cypress or Selenium.
• Build API and service-level automation using RestAssured or equivalent frameworks, supported by Postman or Bruno for exploratory and regression testing.
• Define risk-based test strategies covering functional, integration, regression, end-to-end and production-readiness testing.
• Embed automated tests, quality gates and reporting into CI/CD pipelines to enable reliable and frequent releases.
• Work within cross-functional feature teams to shift quality left, influence solution design and improve testability from the outset.
• Create maintainable test data, service mocks and validation approaches for APIs, microservices and distributed integrations.
• Design testing approaches for AI and Generative AI applications, including prompt/response validation, grounding, safety, consistency and non-deterministic outputs.
• Validate AI Agents and agent workflows, including tool calling, orchestration, memory, failure handling and multi-step task completion.
• Use quality metrics, defects, logs and observability signals to identify risks, improve coverage and support incident investigation.
• Mentor engineers, review automation code and contribute standards, reusable accelerators and Quality Engineering communities of practice.

Mandatory skills and experience

Required experience

UI automation

Strong hands-on automation using Playwright, Cypress or Selenium, including framework design, maintainability and parallel execution.

API automation

RestAssured or an equivalent code-based API framework; practical use of Postman or Bruno for REST API validation.

Programming

Strong Java, JavaScript, TypeScript or Python skills and the ability to write clean, reusable automation code.

Quality engineering

Functional, integration, regression and end-to-end testing, with risk-based planning and shift-left practices.

CI/CD

Experience integrating automated tests, quality gates and results into Jenkins, Harness, GitHub Actions or equivalent pipelines.

AI testing

Hands-on experience testing AI or Generative AI applications, including evaluation of variable outputs and response quality.

AI Agents

Experience or strong knowledge of testing agent workflows, tool invocation, orchestration, memory and error handling.

Collaboration

Ability to work with Product, Engineering, DevOps and Architecture teams and communicate quality risks clearly.

Other Experience

• BDD with Cucumber and Gherkin, plus contract testing and service virtualisation.
• RAG or LLM application testing, including retrieval relevance, hallucination, grounding and guardrail evaluation.
• Performance testing with k6 or JMeter and accessibility or security testing awareness.
• Docker, Kubernetes, GCP, Dynatrace and modern observability practices.
• Experience delivering customer-facing software in financial services or another regulated environment.