Current jobs related to AI Safety Research Scientist - London, Greater London - Department for Science, Innovation & Technology


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyThe AI Safety Institute research unit is seeking highly motivated and talented Research Scientists to work on critical areas of AI safety, including risk models, frontier models, and large-scale targeted manipulation and deception.Key Responsibilities:Conduct research on AI safety and risk models, including...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyThe AI Safety Institute research unit is seeking highly motivated and talented Research Scientists to work on critical areas of AI safety, including risk models, frontier models, and large-scale targeted manipulation and deception.Key Responsibilities:Conduct research on AI safety and risk models, including...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our mission is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our mission is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our goal is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our goal is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our mission is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research Scientist in AI SafetyWe're a team of scientists, engineers, and domain experts at the AI Safety Institute, focused on mitigating the risks associated with autonomous AI systems. Our mission is to advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    The AI Safety Institute is seeking a highly motivated and talented Research Scientist to join our team in the area of AI safety research. The successful candidate will work on studying, evaluating, and recommending mitigations for extreme risks from autonomous AI systems.Key ResponsibilitiesConduct research on AI safety and risk mitigationDevelop and...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Research TeamThe AI Safety Institute is seeking highly motivated and talented Research Scientists to work on critical projects related to AI safety. Our team is dedicated to advancing the field of AI safety research and developing innovative solutions to mitigate risks associated with autonomous AI systems.Key ResponsibilitiesConduct research on AI...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Research TeamThe AI Safety Institute is seeking highly motivated and talented Research Scientists to work on critical projects related to AI safety. Our team is dedicated to advancing the field of AI safety research and developing innovative solutions to mitigate risks associated with autonomous AI systems.Key ResponsibilitiesConduct research on AI...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We're pushing the boundaries of AI safety research at the AI Safety Institute. As a research scientist, you'll be part of a dynamic team exploring the risks of autonomous AI systems. Your expertise will help us advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains. You'll work closely with...

  • AI Safety Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Join the AI Safety Institute TeamAISI is launching a new Mechanistic Interpretability team to research the fundamental question of how can we tell if a model is scheming? This is an ambitious bet to bring interpretability as a field into prime time. We believe that this is a vital challenge that mechanistic interpretability can help solve, ensuring that...

  • AI Safety Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Join the AI Safety Institute TeamAISI is launching a new Mechanistic Interpretability team to research the fundamental question of how can we tell if a model is scheming? This is an ambitious bet to bring interpretability as a field into prime time. We believe that this is a vital challenge that mechanistic interpretability can help solve, ensuring that...

  • Research Scientist

    2 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Unlock the Secrets of AI SafetyAISI is pioneering a groundbreaking Mechanistic Interpretability team to tackle the fundamental question of how can we ensure AI models are safe and transparent? This ambitious project aims to bring interpretability to the forefront, ensuring that AI systems can be reliably evaluated for safety and alignment. We're seeking a...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistJoin the AI Safety Institute as a Machine Learning Research Scientist and contribute to the development of safety cases for AI systems. As a key member of our research team, you will conduct foundational research to advance the understanding of AI safety and governance.About the RoleWe are seeking a highly...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistJoin the AI Safety Institute as a Machine Learning Research Scientist and contribute to the development of safety cases for AI systems. As a key member of our research team, you will conduct foundational research to advance the understanding of AI safety and governance.About the RoleWe are seeking a highly...

  • Research Scientist

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    AI Safety Institute: Launching a New Mechanistic Interpretability TeamAISI is embarking on a groundbreaking project to develop mechanistic interpretability, a crucial challenge in ensuring the safety of AI systems. We seek a team lead, research scientists, and research engineers to join our mission.Key Responsibilities:Conduct hands-on mechanistic...

  • Research Scientist

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    AI Safety Institute: Launching a New Mechanistic Interpretability TeamAISI is embarking on a groundbreaking project to develop mechanistic interpretability, a crucial challenge in ensuring the safety of AI systems. We seek a team lead, research scientists, and research engineers to join our mission.Key Responsibilities:Conduct hands-on mechanistic...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and developing innovative solutions to mitigate risks associated with AI systems.About...

AI Safety Research Scientist

2 months ago


London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

Position Overview

About the Department for Science, Innovation & Technology

The Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the benefit of society. Our mission is to advocate for responsible practices in advanced technology by assembling a talented group of technical experts.

We have significant goals and a pressing need for action.

  • Innovate and Assess Advanced AI Systems: Identifying safety-critical capabilities, evaluating societal implications, and improving security measures.
  • Develop Governance Tools for AI: Crafting frameworks and methodologies to assess safety and societal impacts, and predicting how technical advancements can shape AI governance.
  • Promote Information Sharing: Creating effective channels for communication with national and international stakeholders.

Our team includes seasoned professionals from leading organizations and academic institutions. We are currently on the lookout for exceptional technical talent worldwide to help us establish international standards for AI safety.

As we anticipate the emergence of more advanced AI models, our commitment to promoting safe and responsible AI development is increasingly vital.

Core Values:

  • Diverse Perspectives: Valuing a variety of backgrounds and experiences as essential to our success.
  • Collaborative Environment: Fostering teamwork, open collaboration, and appreciating contributions of all sizes.
  • Innovation and Impact: Committed to achieving meaningful progress in AI safety and capability, encouraging innovative thinking and bold ideas.
  • Inclusive Culture: Creating a welcoming environment where every individual feels valued and can contribute authentically. We believe that embracing diversity enhances innovation and decision-making.

Role Description

About the Research Team

The Autonomous Systems team is focused on addressing the catastrophic risks associated with autonomous AI technologies.

Our strategy involves analyzing potential hazards from autonomous systems, developing tools to measure and predict these risks, and collaborating with other teams to ensure our research informs practical AI safety measures and policy recommendations.

The Autonomous Systems Team is currently seeking motivated Research Scientists and Research Engineers to contribute to our mission of mitigating catastrophic risks from autonomous AI.

We have openings for individuals with varying levels of experience and expertise.

You will be part of one of our specialized research sub-teams:

  • Agents Team: Focusing on the research and engineering of agent systems that exceed current state-of-the-art models.
  • Self-Improvement Team: Examining risks related to uncontrolled self-enhancement of AI models.
  • Auto-Replication Team: Investigating risks associated with autonomous AI replicating itself across different hardware or devices.
  • Manipulation & Deception Team: Advancing research on identifying manipulation and deception by autonomous systems.

As a Research Scientist/Engineer, you will collaborate within a dedicated research team, contributing to guiding research directions, resolving technical challenges, and enhancing the quality of our research outputs.

You will receive mentorship from industry experts and have opportunities to engage with renowned researchers in the field.

Candidate Profile

We are looking for candidates with a blend of specific skills, experience, and attitudes suited for either Research Scientist or Research Engineer roles.

For those with a stronger engineering background:

  • Extensive experience in producing high-quality code.
  • A proven history of designing and maintaining complex technical products or delivering high-quality academic work.
  • Demonstrated ability to drive progress, mentor peers, and foster technical excellence.

We are hiring individuals at various levels of experience within this team. The final title and compensation will be determined during the recruitment process, and we encourage all interested candidates to consider applying.

Preferred Qualifications:

  • Proficiency in Python programming and familiarity with its best practices and broader ecosystem.
  • Research experience, such as a PhD in a technical field or publications in reputable conferences.
  • Experience collaborating with multidisciplinary teams in leading research environments.

Benefits

The Department for Science, Innovation & Technology offers a competitive benefits package, including:

  • Flexible working arrangements.
  • Generous pension contributions.
  • Increasing annual leave based on tenure.
  • Access to professional development opportunities.
  • Employee discounts for various services and products.
  • Hybrid working policy allowing for a mix of office and remote work.