Lead Generative AI Model Evaluator

2 weeks ago

London, Greater London, United Kingdom Meta Full time
About the Role

We are seeking an experienced AI Research Scientist to join our Generative AI Evaluation Foundations team, focusing on developing cutting-edge methodologies for evaluating GenAI models. Your primary responsibility will be to conduct research on metrics and evaluation methods for GenAI models, collaborating closely with cross-functional teams to leverage state-of-the-art solutions.

Key Responsibilities:
  • Evaluate GenAI Models: Conduct in-depth evaluations of GenAI models, particularly Llama models, using various metrics and methodologies.
  • Cross-Functional Collaboration: Work closely with partner teams to ensure seamless integration of GenAI models, co-developing evaluation solutions when necessary.
  • Stay Up-to-Date: Maintain a strong understanding of the latest developments in Generative AI and their evaluations, ensuring our methodologies remain at the forefront of innovation.
  • Communicate Research Findings: Effectively communicate research results and recommendations to stakeholders and the scientific community, providing actionable insights for improving GenAI models.
RequirementsQualifications:
  • A PhD in Deep Learning, Machine Learning, Computer Vision, NLP, Computer Science, or a related field is required.
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field is also required.
  • Proven experience in conducting research and publishing in top-tier peer-reviewed journals and conferences.
  • Excellent communication and collaboration skills are essential.
Preferred Qualifications:
  • Background or previous work in Generative AI or evaluations of GenAI models is desirable.
  • At least 3 years of experience after completing your PhD is preferred.
  • A track record of setting technical direction, driving consensus, and successful cross-functional partnership is advantageous.
What We Offer

We offer a competitive salary range of $175,000 - $250,000 per year, based on qualifications and location. In addition, we provide benefits, including health insurance, retirement plans, and paid time off. Meta is committed to fostering an inclusive environment where employees feel valued and supported.

  • AI Researcher

    1 month ago

    London, Greater London, United Kingdom AI Safety Institute Full time

    We're advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research focuses on extreme risks from autonomous AI systems, capable of interacting with the real world. As a risk modelling researcher, your work will span the full space of risks from...

  • AI Engineering Team Lead

    6 days ago

    London, Greater London, United Kingdom Symphony Industrial AI, Inc. Full time

    Job SummaryA highly skilled AI Engineer is needed to lead the development of cutting-edge AI solutions for our London-based Trading & Investing team. This role involves collaborating with Data Engineers and Full Stack developers to build innovative AI systems, leveraging expertise in multi-agent generative AI frameworks, machine learning, AIOps, and...

  • Senior Generative AI Specialist

    1 week ago

    London, Greater London, United Kingdom Sacher AI Full time

    **Job Summary:**Sacher AI is looking for a skilled Senior Generative AI Specialist to join our team. As a key member of our AI Research and Innovation Lab, you will lead the advancement of LLM and generative AI projects, managing the entire lifecycle from concept to deployment.**About Us:**We are a small but fast-growing team at an exciting stage of...

  • Data Analyst

    1 month ago

    London, Greater London, United Kingdom Allen Recruitment Consulting Full time

    Unlocking the Potential of AI: Data Analyst RoleWe are seeking a skilled Data Analyst to join our team at a leading tech company for a 6-month contract in the UK on a remote basis. You will play a vital role in developing protocols for measuring the quality of their face-generation models.Key Responsibilities:Collaborate with the team to design and refine...

  • Data Scientist

    1 day ago

    London, Greater London, United Kingdom C3 AI Full time

    C3 AI, Inc. (NYSE:AI) is a leading Enterprise AI software provider accelerating digital transformation. The proven C3 AI Platform provides comprehensive services to build enterprise-scale AI applications more efficiently and cost-effectively than alternative approaches.Job OverviewThe C3 AI Data Science team is seeking an experienced Senior Data Scientist to...

  • AI Training Expert for Generative Models

    7 days ago

    London, Greater London, United Kingdom Outlier Full time

    Train AI Models with OutlierOutlier is a pioneering company that enhances AI models by incorporating human feedback. As an experienced software engineer, you have the opportunity to lend your expertise and contribute to training AI models.About OutlierWe partner with innovative organizations to develop and train AI large language models. Our goal is to...

  • AI Safety Researcher

    3 weeks ago

    London, Greater London, United Kingdom AI Safety Institute Full time

    We're focused on addressing extreme risks from autonomous AI systems that can interact with the real world. To do this, we're advancing the state of the art in risk modeling, incorporating insights from other safety-critical and adversarial domains, and developing novel techniques. We're also empirically evaluating these risks through one of the world's...

  • Lead AI Engineer for Generative Models

    1 week ago

    London, Greater London, United Kingdom Snapchat Full time

    About the RoleWe're seeking an exceptional Lead AI Engineer to spearhead our Generative Models team at Snap Inc. This is a unique opportunity to join a dynamic team that's shaping the future of augmented reality experiences and pushing the boundaries of generative models.

  • AI Model Developer

    6 days ago

    London, Greater London, United Kingdom Writer Full time

    About WriterWriter is a leading provider of enterprise-grade generative AI solutions, empowering organizations to transform their operations and drive growth.Job DescriptionWe are seeking an experienced AI Model Developer to join our team of experts in developing and deploying cutting-edge language models. As a key member of our engineering team, you will be...

  • AI Alignment Research Engineer

    1 month ago

    London, Greater London, United Kingdom Atla Ai Full time

    About AtlaWe are a London-based start-up building the most capable AI evaluation models. Our mission is to engineer safe, beneficial AI systems that will have a massive positive impact on the future of humanity.RoleAs Atla's alignment research engineer, you'll develop language models as evaluators and use your insights to construct safety guardrails for...

  • AI Alignment Research Engineer

    1 week ago

    London, Greater London, United Kingdom Atla Ai Full time

    Atla Ai: Safeguarding the Future of HumanityAbout Us:We're Atla Ai, a pioneering London-based start-up dedicated to engineering safe and beneficial AI systems. Our mission is to drive positive change in the world by developing cutting-edge AI evaluation models.Role Overview:As our alignment research engineer, you'll play a pivotal role in shaping the future...

  • Lead Data Scientist

    2 days ago

    London, Greater London, United Kingdom C3 AI Full time

    C3 AI is a leading Enterprise AI software provider that enables digital transformation. Our proven C3 AI Platform provides comprehensive services to build enterprise-scale AI applications more efficiently and cost-effectively than alternative approaches.About the RoleWe are seeking an experienced Lead Data Scientist to join our C3 AI Data Science team. As a...

  • Advanced Physics Model Evaluator

    6 days ago

    London, Greater London, United Kingdom DataAnnotation Full time

    Job OverviewDataAnnotation is seeking an experienced physicist to join our team as a physics model evaluator. In this role, you will work on training and evaluating advanced AI models that focus on physics-related tasks.The ideal candidate will have a strong understanding of physics and mathematics, with the ability to evaluate the accuracy and performance...

  • Alignment Researcher, AI Safety Specialist

    3 weeks ago

    London, Greater London, United Kingdom Atla Ai Full time

    Atla is dedicated to developing safe, beneficial AI systems with a profound impact on humanity's future. As a leading London-based startup, we're building the most advanced AI evaluation models. We're seeking an exceptional individual to join our team and collaborate with industry leaders to shape the future of AI.As Atla's alignment researcher, you'll be...

  • Innovative AI Engineer Position

    7 days ago

    London, Greater London, United Kingdom Atla Ai Full time

    Atla Ai is committed to creating safe, beneficial AI systems that will have a significant positive impact on humanity's future. We are a London-based start-up developing the most capable AI evaluation models.Role and ResponsibilitiesAs Atla Ai's Research Engineer, you'll develop and fine-tune language models as evaluators and use your insights to construct...

  • Leading Machine Learning Engineer for AI-Powered Customer Experience

    2 weeks ago

    London, Greater London, United Kingdom Higher - AI recruitment Full time

    OVO Group is a pioneering energy technology company dedicated to transforming the way people interact with clean, affordable energy. With a strong commitment to sustainability and innovation, they aim to create a world where everyone has access to reliable and environmentally friendly energy solutions.The Tech organisation at OVO is undergoing an exciting...

  • Data Scientist Lead for Generative AI Development

    2 weeks ago

    London, Greater London, United Kingdom Amazon Full time

    Company OverviewAWS Industries is a leading provider of innovative AI solutions, empowering businesses to unlock transformational opportunities. Our team of experts collaborates with customers to design and implement cutting-edge generative AI algorithms. Job SummaryWe are seeking an experienced Data Scientist Lead to spearhead the development of our...

  • Senior AI Architect

    6 days ago

    London, Greater London, United Kingdom Symphony Industrial AI, Inc. Full time

    The Symphony Industrial AI, Inc. is seeking an experienced AI Engineer to join our Trading & Investing team in London. As a key member of the team, you will be responsible for developing and implementing cutting-edge AI solutions that drive business value for our clients. Your primary focus will be on designing and implementing robust multi-agent workflows...

  • AI Expert

    3 days ago

    London, Greater London, United Kingdom Engine AI Full time

    Senior AI EngineerWe're expanding our AI capabilities at Engine AI and seeking a seasoned Senior AI Engineer to spearhead the development of Data Agents. This role involves crafting tools that translate natural language queries into actionable insights, including SQL query generation, entity matching, and data visualizations.As a key member of our team,...

  • AI Researcher

    4 weeks ago

    London, Greater London, United Kingdom Tencent Full time

    Job SummaryWe are seeking a highly skilled AI Researcher to join our team at LightSpeed Studios. As an AI Researcher, you will be responsible for developing and optimizing AI systems to generate high-quality 3D models from textual descriptions or image inputs.ResponsibilitiesDevelop and optimize AI systems for 3D model generationCollaborate with...