AI Operations Specialist - Professional
AI Operations Specialist - Professional
1840
Remote, London, London, United Kingdom
About the Company
1840 & Company is a global organization focused on delivering innovative business solutions that help companies grow, scale, and succeed. Operating in over 150 countries, we support organizations through a range of workforce, operational, and business services designed to drive efficiency and long-term success.
About the Job
We are seeking an experienced AI Operations Specialist Professional to apply advanced professional expertise to evaluate and improve AI-generated content. Specialists assess professional accuracy, reasoning, practical relevance, and quality within structured AI operations workflows.
Job Overview
Employment Type:
Full-Time Independent Contractor
Department:
Administration
Education & Experience
Years Of Experience:
10 Years
Minimum Education Level:
Doctorate
Qualification:
-
10+ Years Of Directly Relevant Professional Experience OR Doctorate In A Relevant Discipline.
-
Specialties: Law, Medicine, Data Science, Software Development/Coding, Insurance, Healthcare Retail And Related Professional Fields.
-
Advanced Expertise In The Applicable Professional Field.
-
Strong Analytical, Critical-Thinking, And Professional Judgment.
-
Ability To Independently Evaluate Complex Professional Scenarios And Identify Material Errors.
-
Strong Written Communication And Attention To Detail.
-
Ability To Work Effectively Within Structured, Technology-Enabled Workflows.
Preferred Qualifications
-
Relevant Professional Certification, License, Or Specialized Credential.
-
Experience Reviewing, Supervising, Auditing, Teaching, Or Evaluating Professional Work.
-
Experience With AI Evaluation, Annotation, RLHF, Preference Ranking, Red Teaming, Or Similar Work.
-
Familiarity With Generative AI And Large Language Models.
Skills
Tools/Platforms:
Generative AI / LLM Platforms
AI Evaluation Platforms
AI Model Validation Tools
Red Teaming Tools / Environments
Data Annotation Platforms
Additional Skills:
Experience With RLHF, Preference Ranking, Or Red Teaming (Preferred)
Common Methodologies/Frameworks:
AI Model Evaluation
Human-In-The-Loop (HITL) AI Evaluation
AI Reasoning Evaluation
AI Response Ranking & Validation
Professional Accuracy Validation
Additional Skills:
Experience With RLHF, Preference Ranking, Or Red Teaming (Preferred)
General Skills:
Cross-Functional Collaboration
Research Methodologies
Quality Assurance
Additional Skills:
Experience With RLHF, Preference Ranking, Or Red Teaming (Preferred)
Soft Skills:
Critical Thinking
Attention To Detail
Time Management
Additional Skills:
Experience With RLHF, Preference Ranking, Or Red Teaming (Preferred)
Requirements
Technological Requirements:
Responsibilities
-
Evaluate AI-generated content for professional accuracy, reasoning, relevance, and practical applicability.
-
Identify factual, procedural, regulatory, technical, or professional errors.
-
Create or review expert responses, scenarios, explanations, and reasoning examples.
-
Compare, rank, annotate, classify, and validate model outputs using defined criteria.
-
Assess content against applicable professional practices, standards, and risks.
-
Support model safety, red-teaming, and validation activities as required.
-
Apply project guidelines consistently and document evaluation rationale when needed.
-
Meet established quality, productivity, attendance, and scheduled-hour requirements.
Working Hours
Flexible working hours
