ai evaluation engineer

AI Evaluation Engineer Rate / Duration / Location £700-£750/day Inside IR35 | Duration: 4 months | Clearance: BPSS + SC eligible | Location: London, Bristol or Manchester | Hybrid: 2 days onsite per week. Overview We're looking for an experienced AI Evaluation Engineer to join a specialist Public Sector Technology team. This hands-on role focuses on...

AI Evaluation & Benchmarking Engineer Location: Remote (United Kingdom)Salary: £60,000–£75,000 DOEContract: Full-time, 40 hours per weekEmployer: Intergral UKReports to: Director of Engineering You must already have the right to work in the UK, as we're unable to sponsor visas for this role. About the Role We're looking for an AI Evaluation &...

About The Job You're Considering Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. If you are successfully offered this position, you will go...

**About The Job You're Considering** **Hybrid working:** The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. If you are successfully offered this position, you...

Circle, a fully remote company building an AI-powered, all-in-one platform for digital businesses, is seeking a Lead Engineer for the AI Quality Engineering team. You will design evaluation frameworks, observability tooling, and diagnostic infrastructure to ensure Circle's AI Agents perform reliably, efficiently, and at scale.You will lead and grow the AI...

This role sits at the centre of how we measure and improve AI systems in production.You’ll define what good performance means across LLMs, ASR, TTS, and full speech-to-speech pipelines, and build the datasets, metrics, and evaluation systems that make AI quality measurable and comparable in the real world.You’ll work closely with engineering and product...

Work From Anywhere is seeking a highly experienced software engineer (SR+) to evaluate AI coding agents such as OpenAI Codex and Claude Code. This is not a traditional coding role; you will judge whether the model thinks like a great engineer and if responses are useful and well-reasoned.The position is remote worldwide, 10-20 hours per week, with take-home...

Capgemini is seeking an AI evaluation engineer to own the golden datasets, gates, and drift monitors for our regulated claims and payments product line. You will build evidence packs used by model-risk validation teams and ensure artifacts align with platform patterns.You will partner with domain experts and engineers, shape evaluation pipelines, and...

Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. If you are successfully offered this position, you will go through a series of pre-employment...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract Compensation: $100–$150/hour Location: Remote Role...

DescriptionAbout GramianGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.About the RoleWe are seeking Backend...

British English AI Product Evaluator🎯 The ProjectProductive Playhouse is building a talent pool of British English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is...

About ApturaAptura is building the reinforcement learning data company that powers frontier model training globally. We combine deep expertise in finance with cutting-edge in-house tech to deliver tailored, domain-specific training data and feedback loops.At work, we're building a high-performance, people-first culture. We move quickly, think ambitiously,...

About Us:Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who...

AI Product Analyst (AI Metrics & Model Evaluation) | London | £80,000-£85,000 Join an award-winning, internationally recognised consultancy that's growing fast and building client-facing, cutting-edge AI products used across highly regulated industries, where real users act on high-level advice relating to legislative, regulatory and legal...

Mercor is recruiting an experienced Data Engineering Expert for a short, intensive project with a globally leading AI lab. You will design and implement production data pipelines, collaborate with domain experts, and shape evaluation rubrics used to train frontier AI models.Your hands-on experience with SQL, Python, ETL/ELT, and modern data tooling will be...

AI Product Analyst (AI Metrics & Model Evaluation) | London | £80,000-£85,000 Join an award-winning, internationally recognised consultancy that's growing fast and building client-facing, cutting-edge AI products used across highly regulated industries, where real users act on high-level advice relating to legislative, regulatory and legal frameworks. As...

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities...

Why Faculty? We established Faculty in 2014 because we thought that AI would be the most important technology of our time. Since then, we’ve worked with over 350 global customers to transform their performance through human-centric AI. You can read about our real-world impact here.We don’t chase hype cycles. We innovate, build and deploy responsible AI...

Line of ServiceInternal Firm ServicesIndustry/SectorTechnologySpecialismIFS - Information Technology (IT)Management LevelManagerJob Description & SummaryAbout the role: You’ll join our AI Research team as a Data Scientist - AI Evaluation & Benchmarking Manager, helping to shape and evolve the model benchmarking and experimentation capabilities that...