Current jobs related to AI Research Scientist, Generative AI Evaluation Foundations - London - Meta


  • London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...

  • AI Research Engineer

    2 weeks ago


    London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job DescriptionFlawless AI is seeking a highly skilled Research Scientist Intern to join our Neural Rendering team. As a key member of our team, you will be responsible for conducting cutting-edge research in 3D-controlled dynamic face neural rendering, solving real-world problems in enabling audio-driven photorealistic talking head synthesis, and developing...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job DescriptionFlawless AI is seeking a highly skilled Research Scientist Intern to join our Neural Rendering team. As a key member of our team, you will be responsible for conducting cutting-edge research in 3D-controlled dynamic face neural rendering, solving real-world problems in enabling audio-driven photorealistic talking head synthesis, and developing...


  • London, Greater London, United Kingdom Stealth AI Startup Full time

    Transformative AI Research OpportunityWe are seeking a highly skilled Senior Research Engineer to join our team at Stealth AI Startup and contribute to the development of cutting-edge large language models. As a key member of our research team, you will be responsible for designing and implementing pre-training pipelines for state-of-the-art foundational...


  • London, Greater London, United Kingdom Stealth AI Startup Full time

    Transformative AI Research OpportunityWe are seeking a highly skilled Senior Research Engineer to join our team at Stealth AI Startup and contribute to the development of cutting-edge large language models. As a key member of our research team, you will be responsible for designing and implementing pre-training pipelines for state-of-the-art foundational...

  • Research Scientist

    2 weeks ago


    London, Greater London, United Kingdom Meta Full time

    About the RoleMeta is seeking a highly skilled Research Scientist to join its Generative AI organization. As a Research Scientist, you will play a key role in advancing the capabilities of large foundation models through fine-tuning and experimentation.Key ResponsibilitiesConduct research that extends the capabilities of foundation models through model...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    About the RoleThe Department for Science, Innovation & Technology is seeking a highly skilled Cyber Security Researcher to join our team at the AI Safety Institute. As a Cyber Security Researcher, you will play a critical role in helping us understand and mitigate the risks associated with advanced AI systems.Key ResponsibilitiesDesign and develop...

  • AI Research Scientist

    4 weeks ago


    London, Greater London, United Kingdom BYJU'S Full time

    Opportunity for a Research Scientist in AI Are you driven by the potential of AI to transform digital education? At BYJU'S, a prominent player in the education technology sector, we are on the lookout for a Research Scientist. This role is ideal for those who are experts in AI research, particularly in the domains of Language Processing, Computer Vision,...

  • Research Scientist

    1 week ago


    London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    About the RoleThe Department for Science, Innovation & Technology is seeking a highly skilled Research Scientist to join our team in the field of AI Safety. As a Research Scientist, you will contribute to our evaluation of biology and chemistry specific models, developing and running model evaluations and providing expertise to the wider team.Key...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job Description**About Flawless AI**Flawless AI is a pioneering company in the field of artificial intelligence, revolutionizing the film industry with its cutting-edge technology. Our mission is to empower filmmakers with innovative tools that enable creativity without compromise, expand storytelling possibilities, and deliver unparalleled visual and...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job Description**About Flawless AI**Flawless AI is a pioneering company in the field of artificial intelligence, revolutionizing the film industry with its cutting-edge technology. Our mission is to empower filmmakers with innovative tools that enable creativity without compromise, expand storytelling possibilities, and deliver unparalleled visual and...

  • AI Research Scientist

    2 weeks ago


    London, Greater London, United Kingdom BYJU'S Full time

    Job OverviewAs a Research Scientist at BYJU'S, you will be a subject matter expert in at least one area of AI research, including but not limited to Language, Vision, and Reinforcement learning. You will be the driving force behind building new technologies that impact digital learning.Key ResponsibilitiesAdvance fundamental AI technologies to impact...


  • London, Greater London, United Kingdom BYJU'S Full time

    Job OverviewAs a Research Scientist at BYJU'S, you will be a subject matter expert in at least one area of AI research, including but not limited to Language, Vision, and Reinforcement learning. You will be the driving force behind building new technologies that impact digital learning.Key ResponsibilitiesAdvance fundamental AI technologies to impact...

  • AI Research Scientist

    2 weeks ago


    London, Greater London, United Kingdom Autodesk Full time

    About the RoleWe are seeking a highly skilled AI Research Scientist to join our team at Autodesk Research. As a member of our AI Lab, you will be working on cutting-edge research projects that aim to advance the field of artificial intelligence and its applications in various industries.Key ResponsibilitiesDevelop and implement new machine learning models...


  • London, Greater London, United Kingdom Autodesk Full time

    About the RoleWe are seeking a highly skilled AI Research Scientist to join our team at Autodesk Research. As a member of our AI Lab, you will be working on cutting-edge research projects that aim to advance the field of artificial intelligence and its applications in various industries.Key ResponsibilitiesDevelop and implement new machine learning models...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting responsible AI development for the benefit of society. We are committed to fostering a team of skilled professionals who are focused on addressing the challenges posed by advanced AI technologies.We are on a...

  • Ai Leader

    3 months ago


    London, United Kingdom Mesh-AI Full time

    **About Mesh-AI** We are the leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors. We have grown from 0-100 people in 2 years and have huge...

  • Ai Leader

    3 months ago


    London, United Kingdom Mesh-AI Full time

    London **About Mesh-AI** We are the leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors. We have grown from 0-100 people in 2 years and...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the benefit of society. Our mission is to ensure that the development of AI technologies is conducted responsibly and with the utmost consideration for public welfare.We are on a fast track to...

AI Research Scientist, Generative AI Evaluation Foundations

4 months ago


London, United Kingdom Meta Full time
Meta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now

The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers, autoevals), covering a broad spectrum of metrics from helpfulness to safety and beyond. We are looking for a strong AI research scientist, with passion for Generative AI and in particular measurement/assessment of these cutting edge models. You’d join one of our projects and build methods to solve open challenges and unblock the execution and application of AI-assisted measurements to GenAI models, particularly Llama models. We are looking for a team player, who thrives in ambiguity, quickly adapting to new problems and AI metrics from helpfulness to safety; preferred candidates have experience in doing applied research/evaluations on large scale GenAI models.

Required Skills:

AI Research Scientist, Generative AI Evaluation Foundations Responsibilities:

Conduct research on the metrics and methodologies to assess/evaluate GenAI models (in particular Llama models)

Collaborate with cross-functional teams to ensure that our GenAI models are assessed leveraging state of the art solutions, and potentially co-develop them with partner teams

Stay up-to-date with the latest developments in the field of Generative AI and their evaluations/AI-assisted evaluation in particular

Communicate research findings and recommendations to stakeholders and scientific community

Minimum Qualifications:

Minimum Qualifications:

PhD in the field of Deep learning, Machine Learning, Computer Vision, NLP, Computer Science or a related field.

Bachelor's degree in Computer Science, Computer Engineering, or a related field

Experience with conducting research and publishing in top tier peer-reviewed journals and AI conferences

Excellent communication and collaboration skills

Ability to work independently and as part of a team

3+ years of experience after PhD

Track record of setting technical direction, driving consensus and successful cross-functional partnership

Preferred Qualifications:

Preferred Qualifications:

Background and/or previous work in Generative AI

Background and/or previous work in evaluations of GenAI models

#J-18808-Ljbffr