Test automation engineer Work, Jobs in Aldridge, Wmd (with Salaries)

Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Resillion —Birmingham
- Remote
- Azure
- Master's degree
- AI
Quick apply
AWS IaaS Sys Admin
Accenture —Birmingham
- Full-time
- Azure
- DevOps
- Windows
Senior EmbeddedSoftware Engineer
TechBiz Global GmbH —Birmingham
- Full-time
- Engineering
- Master's degree
- C++
Quick apply
Senior Technology Specialist
Armac Martin —Birmingham
- £45,000 - £50,000 a year
- Full-time
- SQL
- APIs
- In-person
- Free parking
- Paid training
Quick apply
13d
Automation Tester
Inspired Thinking Group (ITG) —Birmingham
- Remote
- Azure
- Java
- JavaScript
- Employee assistance programme
- Employee discount
Quick apply
Senior Engineer (Postgres)
Coventry Building Society —Coventry
- £47,600 - £60,000 a year
- Overtime
- Oracle
- SQL
- Software development
Senior DevOps Engineer
Agriculture & Horticulture Development Board (AHDB) —Coventry
- £42,000 - £52,000 a year
- Full-time
- Hybrid work
- Azure
- DevOps
- Presentation skills
- Annual leave
- Employee assistance programme
10d
Software Engineer
Low Carbon Contracts Company —Birmingham
- £70,000 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Engineering
- Annual leave
- Work from home
Quick apply
Quality Assurance Engineer
Nonacus —Birmingham
- £28,000 - £35,000 a year
- Full-time
- Hybrid work
- Computer Science
- Engineering
- SQL
Quick apply
5d

Related jobs to explore

Based on your search for test automation engineer

Cloud Engineer
Converge Technology Solutions —Stafford
Act as a trusted advisor to customers, providing practical guidance on governance, security, compliance, adoption, configuration, licensing and operational best…
£50,000 - £55,000 a year
6d
Automation Engineer
Elevate Technology Group —Rugby
Experience driving process improvement and efficiency initiatives. A growing public sector organisation is delivering a major digital transformation programme…
£45,000 - £50,000 a year

I want to receive the latest job alerts for test automation engineer in aldridge, wmd

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

test automation engineer jobs near aldridge, wmd

Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)

Resillion -
Birmingham

Quick apply

Job details

Fixed term contract

Qualifications

Azure
Law
Kubernetes
Test automation
Git
Master's degree
Docker
GitHub
AI
Jenkins
Python

Full job description

Company Description

At Resillion, our culture is built on a mindset of “if you see something, say something” — taking responsibility and speaking up. We expect everyone to adapt and embrace change as the company grows. We recognise the value of every employee and invest in developing their skills so that, as an organisation, we continue to lead our industry.

Above all, it’s a culture driven by passion for what we do and commitment to the bigger picture of the company.

If you want to be part of our journey, this role may be the right fit for you

Job Description

Senior Automation Tester (Python) – Agentic AI & LLM Systems

Location: Glasgow (Hybrid preferred but not essential)
Start Date: Immediate
Right to Work: Must have full UK working rights (no sponsorship available due to start dates)
Additional Requirement: Must have 3 years of UK address history due to immediate onboarding
Programme: AI / Agentic AI

Seniority: Senior Automation Engineer

Overview

We are seeking a Senior Automation Engineer / SDET with strong Python skills and hands‑on experience testing AI systems, including LLM‑driven applications and agentic AI workflows. You will design and build a scalable automation frameworks, implement modern AI testing strategies, and ensure the quality and reliability of next‑generation conversational and agent‑based AI products.

This role is ideal for someone who is passionate about automation engineering and has a solid understanding of how AI/LLM systems behave in real‑world scenarios.

Key Responsibilities

Develop and maintain a Python‑based automation framework for validating AI agents (chatbots, voicebots, agentic workflows).
Design and execute automated tests for:
- LLM responses
- Conversational flows
- Retrieval‑augmented generation (RAG)
- End‑to‑end agentic scenarios
Apply modern AI testing strategies and evaluation methods (e.g., DeepEval, RAGAS — beneficial but not essential).
Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, Azure Repos).
Build and manage batch and scheduled executions using Docker, Kubernetes, cron jobs, or similar tooling.
Manage code repositories using Git, including branching strategies, version control, and collaborative workflows.
Collaborate closely with engineering, AI/ML, and product teams to ensure high‑quality delivery of AI‑powered features.

Required Skills & Experience

Strong Python development skills, particularly for automation (PyTest preferred).
Solid background in test automation and framework design.
Experience testing or validating AI/LLM‑based systems (agentic workflows, conversational AI, RAG pipelines, etc.).
Understanding of AI evaluation concepts — familiarity with tools like DeepEval or RAGAS is a bonus, not a requirement.
Experience implementing CI/CD pipelines and automated batch executions.
Strong understanding of source code management, Git workflows, and collaborative engineering practices.
Ability to design structured, scalable, and maintainable automation solutions.

Preferred Qualities

Quick learner with a proactive, ownership‑driven mindset.
Strong problem‑solving skills and ability to work in fast‑moving AI environments.
Comfortable collaborating with cross‑functional teams (AI/ML, engineering, product).
Passion for AI technologies and modern testing methodologies.

Quick apply

Refine Your Search

test automation engineer jobs in aldridge, wmd

Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)

AWS IaaS Sys Admin

Senior EmbeddedSoftware Engineer

Senior Technology Specialist

Automation Tester

Senior Engineer (Postgres)

Senior DevOps Engineer

Software Engineer

Quality Assurance Engineer

Related jobs to explore

I want to receive the latest job alerts for test automation engineer in aldridge, wmd

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected