Research Scientist, AI Safety

24 hours ago


London, Greater London, United Kingdom Atla Ai Full time
About Atla

We're a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on humanity's future. Our mission is to create the most capable AI evaluation models, and we're seeking talented individuals to join our growing team.

Role

As an alignment research engineer at Atla, you'll play a crucial role in developing language models as evaluators and using your expertise to construct safety guardrails for LLMs. Your responsibilities will include:

  1. Designing and implementing effective prompting, supervised fine-tuning, and adversarial training techniques to steer LLMs towards alignment with human preferences.
  2. Developing comprehensive evaluation and red teaming frameworks, including custom internal tooling, datasets, and metrics for rigorous assessment of alignment and safety risks.
  3. Collaborating with our founders, advisors, and top-tier researchers to define and steer Atla's evolving AI safety research direction, contributing significant findings to top-tier conferences in the field.
  4. Working closely with our team to navigate the complexities of AI alignment and build a high-performing applied research organization.
Qualifications

We're looking for exceptional ML engineers with a proven track record in empirical research, including designing and executing experiments, and effectively writing up and communicating findings. Key qualifications include:

  1. Proficiency in training and evaluating language models across GPUs, preferably in PyTorch.
  2. Strong software engineering experience with software design/architecture skills, preferably in Python.
  3. Aptitude for distilling and applying ideas from complex research papers in our products.
  4. Experience at elite AI research labs (OpenAI, DeepMind, Meta, Anthropic, etc.).
What We Offer

We offer a competitive salary, significant equity as one of the first joiners, and the opportunity to make a dent in the universe by engineering safe, beneficial AI systems.


  • Research Scientist

    19 hours ago


    London, Greater London, United Kingdom RI Research Instruments GmbH Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at RI Research Instruments GmbH. As a Research Scientist, you will play a key role in advancing our research efforts in AI safety and developing beneficial AI systems.Key ResponsibilitiesConduct research in AI safety and develop new methods for automatically red teaming...

  • Research Scientist

    15 hours ago


    London, Greater London, United Kingdom RI Research Instruments GmbH Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at RI Research Instruments GmbH. As a Research Scientist, you will play a key role in advancing our research efforts in AI safety and developing beneficial AI systems.Key ResponsibilitiesConduct research in AI safety and develop new methods for automatically red teaming...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistJoin the AI Safety Institute as a Machine Learning Research Scientist and contribute to the development of safety cases for AI systems. As a key member of our research team, you will conduct foundational research to advance the understanding of AI safety and governance.About the RoleWe are seeking a highly...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistJoin the AI Safety Institute as a Machine Learning Research Scientist and contribute to the development of safety cases for AI systems. As a key member of our research team, you will conduct foundational research to advance the understanding of AI safety and governance.About the RoleWe are seeking a highly...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and governance.Key ResponsibilitiesConduct foundational research to develop safety cases for AI systemsCollaborate with...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and governance.Key ResponsibilitiesConduct foundational research to develop safety cases for AI systemsCollaborate with...

  • Research Scientist

    2 days ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research EngineerWe are seeking a highly motivated and talented Research Engineer to join our team at the AI Safety Institute. As a Research Engineer, you will play a key role in developing and implementing cutting-edge AI systems that prioritize safety and security.About the RoleAs a Research Engineer, you will be responsible for...

  • Research Scientist

    2 days ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team as a Research EngineerWe are seeking a highly motivated and talented Research Engineer to join our team at the AI Safety Institute. As a Research Engineer, you will play a key role in developing and implementing cutting-edge AI systems that prioritize safety and security.About the RoleAs a Research Engineer, you will be responsible for...

  • Research Scientist

    3 weeks ago


    London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    About the RoleThe Department for Science, Innovation & Technology is seeking a highly skilled Research Scientist to join our team in the field of AI Safety. As a Research Scientist, you will contribute to our evaluation of biology and chemistry specific models, developing and running model evaluations and providing expertise to the wider team.Key...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting advancements in AI safety for the benefit of society. Our mission is to ensure that the development of AI technologies is conducted responsibly and with a focus on public welfare.As we strive to address the...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is committed to promoting AI safety for the benefit of society. Our mission emphasizes the importance of having a proficient and empowered team of technology experts to navigate the complexities of AI governance.We are focused on...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the benefit of society. Our mission is to advocate for responsible practices in advanced technology by assembling a talented group of technical experts.We have significant goals and a pressing...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety in the public interest. We aim to ensure that the development of AI technologies is conducted responsibly and with a focus on societal well-being.In this role, you will engage in:Evaluating Advanced...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is committed to enhancing AI safety in the public interest. We recognize that the rapid evolution of AI technology necessitates a skilled and empowered group of experts to navigate its complexities.As we strive to meet our ambitious...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is committed to promoting the safe and responsible development of artificial intelligence. Our mission is to ensure that AI technologies are developed with a focus on safety and societal benefits.We are on an ambitious path and are...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team of Cybersecurity ExpertsWe are seeking highly motivated and talented Research Engineers to join our team at the AI Safety Institute. As a Research Engineer, you will work closely with our Cybersecurity and policy specialists to develop and implement cutting-edge AI systems that prioritize safety and security.About the RoleThis is an exciting...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team of Cybersecurity ExpertsWe are seeking highly motivated and talented Research Engineers to join our team at the AI Safety Institute. As a Research Engineer, you will work closely with our Cybersecurity and policy specialists to develop and implement cutting-edge AI systems that prioritize safety and security.About the RoleThis is an exciting...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is committed to promoting the safe and responsible development of artificial intelligence. Our mission is to ensure that advancements in AI technology benefit society as a whole, and we are dedicated to fostering a skilled team of...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting responsible AI development for the benefit of society. We are committed to fostering a team of skilled professionals who are focused on addressing the challenges posed by advanced AI technologies.We are on a...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Join Our Team of Cybersecurity ExpertsWe are seeking highly motivated and talented Research Engineers to join our team at the AI Safety Institute. As a Research Engineer, you will work closely with our Cybersecurity and policy specialists to develop and implement cutting-edge AI systems that prioritize safety and security.About the RoleThis is an exciting...