Senior/Staff Code Review Experts
1 week ago
Mercor is partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We're seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term, fully remote engagement helps shape the future of developer-assisting AI systems.
Key Responsibilities
• Review long-form transcripts between users and AI coding assistants
• Analyze the AI's logic, execution, and stated actions in detail
• Score each transcript using a 10-point rubric across multiple criteria
• Optionally write brief justifications citing examples from the dialogue
• Detect mismatches between claims and actions (e.g., saying "I'll run tests" but not doing so)
Ideal Qualifications
Top choices:
• Senior or Staff Engineers with deep code review experience and execution insight
• QA Engineers with strong verification and consistency-checking habits
• Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation
Also a strong fit:
• Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows
• DevOps or SRE professionals familiar with tool orchestration and system behavior analysis
Languages and Tools:
• Proficiency in Python is helpful (most transcripts are Python-based)
• Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus
• Comfort with Git workflows, testing frameworks, and debugging tools is valuable
More About the Opportunity
• Remote and asynchronous — complete tasks on your own schedule
• Must complete each transcript batch within 5 hours of starting (unlimited tasks to be done)
• Flexible, task-based engagement with potential for recurring batches
Compensation & Contract Terms
• Competitive hourly rates based on geography and experience
• Contractors will be classified as independent service providers
• Payments issued weekly via Stripe Connect
Application Process
• Submit your resume to begin
• If selected, you'll receive rubric documentation and access to the evaluation platform
• Most applicants hear back within a few business days
About Mercor
• Mercor is a talent marketplace that connects top experts with leading AI labs and research organizations
• Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey
• Thousands of professionals across law, engineering, and research contribute to frontier AI projects via Mercor
-
Charge Reviewer
4 days ago
London, Greater London, United Kingdom Sarah Bush Lincoln Full time $23 - $35Internal Employees: Please ensure that you are logged into Workday and applying through the Jobs Hub before proceeding.Charge ReviewerJob DescriptionCharge Reviewer's primary responsibilities include the assignment of facility charge selection for emergency department records, assignment of modifiers, contact with medical staff, nursing, and ancillary...
-
Lead No-Code
4 days ago
London, Greater London, United Kingdom Rosie's People Full time £80,000 - £120,000 per yearStealth-Mode Start-Up Client is seeking a Lead No-Code & AI Platform Engineer (Equity-Only) to take ownership of an existing AI-generated build and prepare the platform for launch within accelerated timelines. This role requires expert-level capability in no-code development, AI tooling, and workflow optimisation, including the ability to review,...
-
Event Manager
2 weeks ago
London, Greater London, United Kingdom CODE Hospitality Full time £35,000 - £42,000 per yearEvents Manager | Knife & Fork Media (CODE Hospitality, The Good Food Guide) | London, UKKEY INFORMATIONContract:Permanent, full-time role (37.5 hours per week) Location:Office based (Soho, London) with option to work from home up to two days per week. Salary:£35k-£42k Start date:7th January We're looking for an organised and proactive Events...
-
Partnerships account executive
2 weeks ago
London, Greater London, United Kingdom CODE Hospitality Full time £384,000 - £456,000 per yearPartnerships Account Executive – New Business | Knife & Fork Media (CODE Hospitality, The Good Food Guide) | London, UKKEY INFORMATIONContract:Permanent, full-time role (37.5 hours per week)Location:Office based (Soho, London) with option to work from home up to two days per week.Salary:£32k-£38kStart date:1st FebruaryTo apply please email: ABOUT THE...
-
Member of Technical Staff, Agent Code
7 days ago
London, Greater London, United Kingdom Cohere Full time £80,000 - £120,000 per yearWho are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...
-
London, Greater London, United Kingdom Sourced Experts Full time £50,000 - £100,000 per yearAre you a skilled Senior Maintenance Coordinator, Scheduler? Join our client's innovative property management company to plan, schedule, and coordinate materials, equipment, and engineering for luxury property clients and work orders. Use your initiative and independent judgment to excel in this role within a forward-thinking team that values your...
-
Senior Staff
4 days ago
London, Greater London, United Kingdom City of Lee's Summit Full time $60,047 - $117,373The City of Lee's Summit is a thriving, progressive community situated 16 miles southeast of downtown Kansas City. With an estimated population of over 107,000, Lee's Summit has all the very best attributes of a small town while enjoying the amenities of a large city. Complemented by a growing business community and superior quality of life, Lee's Summit has...
-
Staff Software Engineer
1 week ago
London, Greater London, United Kingdom Marks & Spencer Full time £80,000 - £120,000 per yearDescriptionAs part of the M&S Software Engineering team, you'll be joining a well-loved historic brand, working on solutions that serve millions of loyal customers and thousands of colleagues With ethical values that run right through the company's core and technology leaders that truly understand software engineers and engineering, it's an exciting time as...
-
London, Greater London, United Kingdom Prisma Health Full time £40,000 - £80,000 per yearInspire health. Serve with compassion. Be the difference.Job SummaryResponsible for leading coding teams, coder training, work que management, performing prebill and second-level coding reviews utilizing auditing software and documents findings to improve CC/MCC capture, Risk Variable capture, HAC/PSI, HCC and Quality Indicator validation. Uses knowledge of...
-
Expert Backend Engineer
4 days ago
London, Greater London, United Kingdom Wiz Full time £80,000 - £120,000 per yearSUMMARY We're looking an experienced Expert Backend Engineer to join our expanding R&D team and help drive the growth of Wiz. In this role, you'll be responsible for developing and maintaining large-scale distributed components that power Wiz.We're looking for candidates who are passionate about tackling scaling challenges and take pride in writing clean,...