Ai evaluation specialist Work, Jobs in Remote (with Salaries)

Audio Specialist- Freelance AI Trainer Project
Meridial —Remote
- £11.00 - £30.65 an hour
- Remote
- Computer literacy
- English
- Communication skills
- Annual leave
Welsh Audio Specialist - Freelance AI Trainer Project
Meridial —Remote
- £6 - £65 an hour
- Remote
- Bilingual
- Computer literacy
- Analysis skills
- Annual leave
British Sign Language (BSL) - Freelance AI Trainer Project
Meridial —Remote
- £6 - £65 an hour
- Remote
- Engineering
- English
- Master's degree
- Annual leave
Remote Financial Trading Specialist
Turing —Remote
- £100 - £200 an hour
- Remote
- English
- Master's degree
- AI
Quick apply
1d
Litigation Attorney Specialist - Freelance Project
Meridial —Remote
- £40 - £70 an hour
- Remote
- AI
- Annual leave
Mergers & Acquisitions Attorney - Freelance Project
Meridial —Remote
- Up to £200 an hour
- Remote
- AI
- Annual leave
Remote Resident Medical Specialist (MD/DO)
Turing —Remote
- £200 - £300 an hour
- Remote
- Analysis skills
- IT
- AI
Quick apply
1d
Operations AWS Senior UX Specialist
Capita —Remote
- Full-time
- Remote
- AWS
- Scripting
- APIs
- Employee discount
Senior Purview Specialist
BlueVoyant —Remote
- Full-time
- Remote
- Scripting
- Communication skills
Quick apply
Research Communications Manager
Alzheimer's Society —Remote
- £50,898 - £56,553 a year
- Remote
- Travel
- In-person
2d
Specialist, Cloud Security (Remote, GBR)
CrowdStrike —Remote
- Full-time
- Remote
- Azure
- Up to 50% travel
- Sales
2d
Mathematics Specialist (Fluent in German) - Freelance Trainer Project
Meridial —Remote
- £6 - £65 an hour
- Remote
- Doctoral degree
- Engineering
- Master's degree
- Annual leave
Technical Lead, Central AI Lab
Jonas Software —Remote
- Full-time
- Remote
- Azure
- Master's degree
- AWS
Regional Health and Safety Manager (North of England & Scotland)
IVC —Remote
- Remote
- Travel
- Communication skills
- Employee assistance programme
8d
Senior Learning Specialist/Trainer (Product Design and Delivery)
QA Limited —Remote
- Remote
- AI
- Annual leave
- Employee assistance programme
Police AI - Head of Engineering
College of Policing —Remote
- £75,860 - £82,300 a year
- Full-time
- Remote
- Presentation skills
- Travel
- IT
- Employee discount
1d

More jobs to discover

Find similar jobs that you might be interested in.

Welsh Audio Specialist - Freelance AI Trainer Project
Meridial —Remote
As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios like flight bookings, financial services,…
£6 - £65 an hour

I want to receive the latest job alerts for ai evaluation specialist in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Audio Specialist- Freelance AI Trainer Project

Meridial
Remote

Apply Now

Job details

Freelance
£11.00 - £30.65 an hour

Benefits

Annual leave

Qualifications

Computer literacy
English
Customer support
Communication skills

Full job description

A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program's mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities

Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
- Flight bookings and travel support
- Financial services
- Telecommunications and technical support
Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
Evaluate model performance across a standardized set of qualitative and quantitative metrics.
Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:

Task completion accuracy and efficiency
Conversational naturalness (tone, flow, and coherence)
Audio comprehension and response quality
Instruction adherence and contextual understanding
Basic computer programming literacy, including:
- Understanding of JSON structures
- Familiarity with functions and methods
- Ability to reason about structured data and simple logic
Technical communication clarity when handling support-style problem-solving

Technical & Equipment Requirements

Strong verbal communication skills in a simulated customer support context
English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
Comfort working with structured prompts, evaluation rubrics, and technical guidelines
Device capable of running audio recording software and opening large technical documentation

We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you'll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level

Apply Now

Refine Your Search

ai evaluation specialist jobs in remote

Audio Specialist- Freelance AI Trainer Project

Welsh Audio Specialist - Freelance AI Trainer Project

British Sign Language (BSL) - Freelance AI Trainer Project

Remote Financial Trading Specialist

Litigation Attorney Specialist - Freelance Project

Mergers & Acquisitions Attorney - Freelance Project

Remote Resident Medical Specialist (MD/DO)

Operations AWS Senior UX Specialist

Senior Purview Specialist

Research Communications Manager

Specialist, Cloud Security (Remote, GBR)

Mathematics Specialist (Fluent in German) - Freelance Trainer Project

Technical Lead, Central AI Lab

Regional Health and Safety Manager (North of England & Scotland)

Senior Learning Specialist/Trainer (Product Design and Delivery)

Police AI - Head of Engineering

More jobs to discover

I want to receive the latest job alerts for ai evaluation specialist in remote

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected