Senior AI Safety Researcher

4 weeks ago


London, Greater London, United Kingdom AI Safety Institute Full time

Estimated Salary: £80,000 - £110,000 per annum

About the Role

We are seeking an exceptional Senior AI Safety Researcher to join our team at the AI Safety Institute. This is a unique opportunity to contribute to the development of safety cases and advance the field of AI governance.

Key Responsibilities
  • Conduct foundational research on safety cases to help drive innovation in AI governance
  • Collaborate with external partners and researchers to develop novel methods for AI control and formal verification
  • Develop high-level research into safety case material, including methods and properties for argument correctness
  • Input into our strategy on safety case work, including how to increase its occurrence and improve results
Requirements
  • Relevant machine learning research experience in industry, academia, or open-source collectives
  • Broad knowledge of technical safety methods (T-shaped)
  • Strong writing ability and motivated to conduct technical research with direct policy impact
  • Comprehensive understanding of large language models, including literature and hands-on experience
What We Offer

A competitive salary package, including flexible working options, comprehensive benefits, and opportunities for professional development

The Department for Science, Innovation and Technology operates a discretionary hybrid working policy, allowing staff to balance work hours between their place of work and home in the UK



  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the AI Safety InstituteThe AI Safety Institute (AISI) is a pioneering organization dedicated to advancing AI safety for the public interest. Our mission is to assess and mitigate risks from frontier AI systems, including cyber attacks on critical infrastructure, AI-enhanced chemical and biological threats, large-scale societal disruptions, and...

  • AI Safety Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly motivated and talented Research Scientist/Engineer to join our Societal Impacts team at the AI Safety Institute. The successful candidate will work with other researchers to design and run studies that answer important questions about the effect of AI on society.The ideal candidate will have a strong background in...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About AI Safety InstituteAISI is a leading research institution in the field of artificial intelligence safety. We are dedicated to developing and applying cutting-edge technologies to ensure that AI systems align with human values.We are currently seeking a highly skilled researcher to join our Mechanistic Interpretability team. As a researcher, you will be...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Role OverviewThe AI Safety Institute is seeking a highly skilled Senior AI Safety Researcher to join its Safeguard Analysis Team. The successful candidate will play a key role in researching and developing interventions that secure systems from abuse by bad actors.About the RoleThis is a challenging and rewarding opportunity for an experienced researcher to...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    AI Safety Institute Job OverviewThe Department for Science, Innovation and Technology is seeking a highly skilled Senior AI Research Specialist to join its esteemed team at the forefront of artificial intelligence safety research. This role offers an exceptional opportunity for individuals with expertise in machine learning, large language models, and...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleThis is an exceptional opportunity to join our research unit as a Research Scientist/Engineer and contribute to cutting-edge projects that impact both technical AI safety and AI governance.You will work with a multidisciplinary team to design and run studies that answer important questions about the effect AI has on society.We are looking for...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Role OverviewWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. This role offers a unique opportunity to work closely with world-class researchers and contribute to the development of safety cases for AI systems.About the RoleThis is a challenging and rewarding role that requires strong technical...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    **Job Title:** Policy Lead**Location:** N/AAs a leading expert in the field of human-AI interaction risks, you will lead a multidisciplinary research team at the AI Safety Institute to evaluate and mitigate the behavioral and psychological risks that emerge from AI systems. The position offers a unique opportunity to push forward an emerging field and be...

  • AI Safety Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly motivated and talented Research Scientist to join our Societal Impacts team at the AI Safety Institute. The successful candidate will work with our team to design and run studies that answer important questions about the effect AI will have on society.Key ResponsibilitiesDesign and run studies to evaluate the impact of...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    At the AI Safety Institute, we are dedicated to optimizing AI systems for state-of-the-art performance across various risk domains. Our Post-Training Team works tirelessly to fine-tune and scaffold AI models, ensuring they reach their full potential.About the RoleWe are seeking a strong Research Scientist to join our team. As a member of this team, you will...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    As advanced AI systems continue to evolve, the potential risks associated with their cyber capabilities pose a significant threat to organizational and individual security. These risks are particularly concerning when combined with other AI risk areas, such as harmful outcomes from biological and chemical capabilities, and autonomous systems.The AI Safety...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our Post-Training Team at the AI Safety Institute. The successful candidate will use cutting-edge machine learning techniques to improve model performance in our domains of interest. This includes developing and optimizing large language models (LLMs) for various applications, such as...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job DescriptionWe are seeking a highly skilled Research Scientist to join our team at the AI Safety Institute. This role offers an exciting opportunity to contribute to the development of rigorous scientific techniques for the measurement of frontier AI system capabilities.As a member of our Science of Evaluations team, you will be responsible for conducting...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We are seeking an exceptional Cybersecurity Research Engineer to join our team at the AI Safety Institute. Our goal is to develop first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in cyber security. The selected candidate will work closely with a cross-functional team of cybersecurity researchers, machine...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Company Overview">The AI Safety Institute is a leading organization dedicated to ensuring the safe development and deployment of Artificial Intelligence. Our mission is to equip policymakers with an empirical understanding of safety-relevant AI capabilities, specifically at the intersection of AI with biology and chemistry.">About the Role">We are seeking a...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    As a highly motivated and talented AI Safety Specialist, you will be part of a multidisciplinary team at the AI Safety Institute studying the effects of advanced AI models on society. We are looking for individuals who can work collaboratively with our researchers to design and run studies that answer crucial questions about the impact of AI on people and...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We are looking for a Societal AI Researcher to join our team at the AI Safety Institute. As a Societal AI Researcher, you will be responsible for conducting research on the societal impacts of advanced AI models, with a focus on understanding how these models can impact people and society.You will work closely with our researchers to design and run studies...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We are advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research aims to empirically evaluate these risks by building one of the world's largest agentic evaluation suites and pushing forward the science of model evaluations.Job RoleYou will work as...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Explore the forefront of AI safety research at the AI Safety Institute, where our team of experts is dedicated to mitigating the risks associated with autonomous AI systems.About the RoleWe are seeking a highly skilled Research Scientist to join our team and contribute to the advancement of risk modeling, evaluation, and mitigation strategies for autonomous...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    **About the Role:**We are seeking a highly skilled Research Lead to join our team at the AI Safety Institute. In this role, you will be responsible for advancing the state of science in evaluating societal-level harms caused by advanced AI systems.The Crime and Social Destabilisation workstream is a new initiative that focuses on assessing and mitigating...