release engineer Work, Jobs in ilkley, wyk (with Salaries)

AI Tester
SmartSearch —Ilkley
- Full-time
- Hybrid work
- Master's degree
- SQL
- Analysis skills
- Employee assistance programme
Quick apply
PowerBI Developer
SmartSearch —Ilkley
- Full-time
- Hybrid work
- Data analysis skills
- Employee assistance programme
Quick apply
Release & Environments Engineer
Pharmacy2U —Leeds
- Full-time
- Hybrid work
- Azure
- Communication skills
- Python
- Annual leave
- Employee assistance programme
Quick apply
Highways Project Engineer
North Yorkshire Council —Boroughbridge
- £31,537 - £42,839 a year
- Full-time
- Hybrid work
- Engineering
- Communication skills
- Employee discount
8d
Cloud Architect
SmartSearch —Ilkley
- Full-time
- Hybrid work
- Azure
- DevOps
- SQL
- Employee assistance programme
Quick apply
Senior Software Engineer
Skipton Building Society —Skipton
- Full-time
- Hybrid work
- Azure
- Mentoring
- APIs
- Annual leave
18h
Lead Platform Engineer-UK
Certinia UK Limited —Harrogate
- Remote
- Java
- AWS
- Computer networking
Quick apply
Senior Quality Engineer (Bulk Inspection)
Assystem —Bradford
- Hybrid work
- Engineering
- No degree
- Welding
- Annual leave
- Work from home
Principal Engineer - Member Experience Platform
Skipton Building Society —Skipton
- Full-time
- Hybrid work
- Driving
- APIs
- Leadership
- Annual leave
Sr Platform Engineer-UK
Certinia UK Limited —Harrogate
- Remote
- Azure
- Java
- AWS
Quick apply
Principal Engineer - Customer Engagement Platform
Skipton Building Society —Skipton
- Full-time
- Hybrid work
- APIs
- Annual leave
Virtual School Associate Applications Engineer
Leeds City Council —Leeds
- £32,061 - £33,699 a year
- Temporary
- Oracle
- SQL
- IT
- Annual leave
7d
Apprentice Pump Engineer
GAP Group —Cleckheaton
- £16,224 - £17,860 a year
- Full-time
- Communication skills
Principal Engineer - Core Banking Platform
Skipton Building Society —Skipton
- Full-time
- Hybrid work
- No experience needed
- APIs
- Leadership
- Annual leave
DevSecOps Capability Manager
Skipton Building Society —Skipton
- Full-time
- Azure
- DevOps
- Leadership
- Annual leave
Principal Engineer - Digital Experience Platform
Skipton Building Society —Skipton
- Full-time
- Hybrid work
- Java
- Mentoring
- APIs
- Annual leave
Microwave Filter Design Engineer
Filtronic —Yeadon
- Full-time
- Schematics
- Laboratory experience
- Bachelor's degree
- Annual leave
Quick apply
QA Test Engineer
Pharmacy2U —Leeds
- Full-time
- Hybrid work
- Azure
- Analysis skills
- APIs
- Annual leave
- Employee assistance programme
Quick apply
Senior Microwave Filter Design Engineer
Filtronic —Yeadon
- Full-time
- Bachelor's degree
Quick apply
Principal QA Engineer
Pharmacy2U —Leeds
- Full-time
- Hybrid work
- JavaScript
- APIs
- Annual leave
- Employee assistance programme
Quick apply

I want to receive the latest job alerts for release engineer in ilkley, wyk

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

AI Tester

SmartSearch -
Ilkley

Quick apply

Job details

Permanent | Full-time

Benefits

Cycle to work scheme
Company pension
Employee assistance programme
Private medical insurance
Paid volunteer time

Qualifications

Law
Test automation
Master's degree
SQL
Analysis skills
Scripting
APIs
Software testing
Test cases
AI
Python

Full job description

SmartSearch's distinctive Anti-Money Laundering verification software protects our clients by offering the most advanced and comprehensive features available from an AML provider.

SmartSearch has grown rapidly by fostering an incredibly collaborative and supportive culture. As we continue our ambitious growth plans, we will strive to remain a truly exciting, rewarding, and unique place to work.

HOW WILL YOU MAKE A DIFFERENCE?

We're looking for an AI Quality Analysist to help validate and improve Generative AI products and features. This role focuses on testing LLM-based systems, prompt workflows, agent behaviours, RAG pipelines, and AI-driven user experiences. You'll work closely with product, engineering, and AI teams to identify quality risks, design robust test strategies, and ensure our GenAI solutions are reliable, safe, and production ready.

VARIED DAY TO DAY RESPONSIBILITIES

Design and execute test plans for Generative AI applications, including chat, summarization, extraction, classification, and agent workflows
Validate LLM outputs for quality, relevance, accuracy, consistency, tone, and policy compliance
Test prompt behaviour across normal, edge, and adversarial scenarios
Evaluate RAG systems for retrieval quality, grounding, hallucination risk, and citation accuracy
Create test cases for multi-step AI workflows, tool use, memory, and orchestration logic
Partner with engineers and product managers to define acceptance criteria for AI features
Identify and document defects, regressions, safety issues, and model failure patterns
Build and maintain test datasets, evaluation rubrics, and benchmark suites
Support automated testing for AI features, APIs, and end-to-end workflows
Track model and prompt changes to assess quality impact over time
Contribute to release readiness by reporting on AI quality metrics, risks, and recommendations

WHAT ARE WE LOOKING FOR IN A CANDIDATE?

3+ years in QA, software testing, or test engineering
Hands-on experience testing AI/ML or Generative AI applications
Strong understanding of LLM behaviour, including hallucinations, prompt sensitivity, grounding, and non-deterministic outputs
Experience writing detailed test cases, bug reports, and test summaries
Familiarity with API testing tools and test automation frameworks
Ability to evaluate model outputs using structured rubrics and human judgment
Strong analytical skills and attention to detail
Comfortable working cross-functionally in a fast-moving product environment

Preferred Qualifications

Experience testing chatbots, copilots, agents, or RAG-based applications
Familiarity with prompt engineering and prompt/version evaluation
Experience with Python, SQL, or scripting for test data and automation
Knowledge of AI safety, red teaming, bias testing, and policy evaluation
Experience with model evaluation frameworks, telemetry, or experimentation
Exposure to cloud AI platforms and LLM providers

WHAT IS LIFE LIKE AT SMARTSEARCH?

We are a multi-award winning Tech company with an aspirational mentality
Some of our most recent recognitions include: named in the renowned RegTech100 list for 2024, listed in the Top 100 Fasted Growing Tech Companies by Northern Tech Awards 2024 as well as being named Technology Provider of the Year by Corporate Finance Awards 2024
We have been Great Place To Work Certified since 2022
There are excellent progression opportunities due to our growth and you will have personal development goals, regular feedback and support
We are a diverse and inclusive team committed to promoting Diversity & Inclusion and Social Responsibility. Through our DE&I group, charitable initiatives and support for local schools, we actively foster a positive Impact on our community

COMPANY BENEFITS

Our comprehensive benefit package includes:

25 days holiday rising to 30 with each year of service
Private Medical Insurance covering dental and optical
Company pension scheme
Life Assurance - 4x your annual salary
1 day paid volunteering per year
Enhanced maternity / paternity offerings
Employee Assistance Programme
Cycle to work scheme
Access to a gym

Quick apply

Refine Your Search

release engineer jobs in ilkley, wyk

AI Tester

PowerBI Developer

Release & Environments Engineer

Highways Project Engineer

Cloud Architect

Senior Software Engineer

Lead Platform Engineer-UK

Senior Quality Engineer (Bulk Inspection)

Principal Engineer - Member Experience Platform

Sr Platform Engineer-UK

Principal Engineer - Customer Engagement Platform

Virtual School Associate Applications Engineer

Apprentice Pump Engineer

Principal Engineer - Core Banking Platform

DevSecOps Capability Manager

Principal Engineer - Digital Experience Platform

Microwave Filter Design Engineer

QA Test Engineer

Senior Microwave Filter Design Engineer

Principal QA Engineer

I want to receive the latest job alerts for release engineer in ilkley, wyk

Explore jobs in more locations

HOW WILL YOU MAKE A DIFFERENCE?

VARIED DAY TO DAY RESPONSIBILITIES

WHAT ARE WE LOOKING FOR IN A CANDIDATE?

WHAT IS LIFE LIKE AT SMARTSEARCH?

COMPANY BENEFITS

Jobseeker tools

Employer Tools

Browse

Stay Connected