AI Safety Specialist

2 weeks ago


London, Greater London, United Kingdom Mistral AI Full time

Our team at Mistral AI is looking for an AI Safety Specialist to join our ranks. As an AI Safety Specialist, you will be responsible for evaluating, enhancing, and building safety mechanisms for our large language models. 


The ideal candidate will have a strong background in AI, computer science, or a related field. They will be familiar with Python and proficient in software engineering. The successful candidate will also have hands-on experience with AI frameworks and tools, as well as a high technical engineering competence. Additionally, they will have a high scientific track record in their field.



About the Role

Key Responsibilities:

  • Evaluate potential risks and harms associated with LLM outputs.
  • Develop monitoring systems to prevent misuse and ensure user well-being.
  • Collaborate with the AI development team to create and implement safety measures.


About You


  • You have a degree in Computer Science, AI, Machine Learning, or a related field.
  • You are familiar with Python and have hands-on experience with AI frameworks and tools.
  • You have high technical engineering competence and a high scientific track record in your field.


Benefits

We offer a competitive cash salary, equity, and a range of benefits including:


Food: Daily lunch vouchers


Sport: Monthly contribution to a Gympass subscription


Transportation: Monthly contribution to a mobility pass


Health: Full health insurance for you and your family


Parental: Generous parental leave policy


Visa sponsorship


Competitive Healthcare program


Monthly contribution to a pension scheme


Monthly contribution to a transportation scheme


Monthly contribution to a sport scheme


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


Visa sponsorship in France or the UK


Full health insurance for you and your family in France or the UK


Generous parental leave policy in France or the UK


Competitive Healthcare program in France or the UK


Monthly contribution to a pension scheme in France or the UK


Monthly contribution to a transportation scheme in France or the UK


Monthly contribution to a sport scheme in France or the UK


  • AI Safety Specialist

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Key ResponsibilitiesThe successful candidate will play a crucial role in shaping the AI Safety Institute's approach to AI safety, working closely with the Research Unit to develop and implement safety frameworks and guidelines.Key TasksDevelop and maintain safety frameworks and guidelines for AI development and deploymentCollaborate with the Research Unit to...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    The AI Safety Institute is seeking a highly motivated and talented Research Scientist to join our team in the area of AI safety research. The successful candidate will work on studying, evaluating, and recommending mitigations for extreme risks from autonomous AI systems.Key ResponsibilitiesConduct research on AI safety and risk mitigationDevelop and...

  • AI Safety Researcher

    2 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    We're focused on addressing extreme risks from autonomous AI systems that can interact with the real world. To do this, we're advancing the state of the art in risk modeling, incorporating insights from other safety-critical and adversarial domains, and developing novel techniques. We're also empirically evaluating these risks through one of the world's...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We're pushing the boundaries of AI safety research at the AI Safety Institute. As a research scientist, you'll be part of a dynamic team exploring the risks of autonomous AI systems. Your expertise will help us advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains. You'll work closely with...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly skilled Workstream Lead to spearhead our Systemic Safety and Responsible Innovation team. As a key member of our leadership team, you will be responsible for developing and delivering a strategy to advance systemic AI safety research, shaping a market-shaping agenda, and building a multidisciplinary team focused on...

  • Research Scientist

    3 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Job SummaryWe are seeking a highly skilled Research Scientist to join our Science of Evaluations team at the AI Safety Institute. As a Research Scientist, you will play a key role in conducting applied and foundational research focused on the measurement of frontier AI system capabilities.Key ResponsibilitiesDevelop and apply rigorous scientific techniques...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    We are seeking an exceptional Cybersecurity Research Engineer to join our team at the AI Safety Institute. Our goal is to develop first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in cyber security. The selected candidate will work closely with a cross-functional team of cybersecurity researchers, machine...

  • AI Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Unlock the Future of AI Safety ResearchWe're pushing the boundaries of AI safety research at the AI Safety Institute, and we're looking for talented individuals to join our team. As a risk modeling researcher, you'll play a critical role in advancing our understanding of extreme risks from autonomous AI systems.Key Responsibilities:Develop and apply novel...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Lead the Way in AI GovernanceAISI is launching a new workstream focused on understanding and mitigating the risks that arise from repeated or prolonged human-AI interaction.As the lead for this novel team, you will build and lead a multidisciplinary team to evaluate and mitigate the behavioural and psychological risks that emerge from AI systems.Develop and...


  • London, Greater London, United Kingdom Atla Ai Full time

    Atla is dedicated to developing safe, beneficial AI systems with a profound impact on humanity's future. As a leading London-based startup, we're building the most advanced AI evaluation models. We're seeking an exceptional individual to join our team and collaborate with industry leaders to shape the future of AI.As Atla's alignment researcher, you'll be...

  • AI Researcher

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    We're advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research focuses on extreme risks from autonomous AI systems, capable of interacting with the real world. As a risk modelling researcher, your work will span the full space of risks from...


  • London, Greater London, United Kingdom Sacher AI Full time

    **Job Summary:**Sacher AI is looking for a skilled Senior Generative AI Specialist to join our team. As a key member of our AI Research and Innovation Lab, you will lead the advancement of LLM and generative AI projects, managing the entire lifecycle from concept to deployment.**About Us:**We are a small but fast-growing team at an exciting stage of...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Us: Mesh-AI is a forward-thinking company dedicated to harnessing the power of artificial intelligence to drive business innovation and efficiency.Job Title: AI Business Growth SpecialistAbout the Role:We are seeking an experienced AI Business Growth Specialist to join our team. As a key member of our organization, you will be responsible for...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    About the RoleWe are seeking a highly motivated and talented Research Engineer to join our Cyber Evaluations Team at the AI Safety Institute. As a key member of our team, you will play a crucial role in developing first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in the domain of cyber security.Key...


  • London, Greater London, United Kingdom Atla Ai Full time

    Unlock the Future of AI with Atla AiAtla Ai is revolutionizing the field of Artificial Intelligence by developing safe and beneficial AI systems. We are a London-based start-up backed by top investors and founders, and we're looking for a talented Research Engineer to join our team.Role and ResponsibilitiesAs a Research Engineer at Atla Ai, you will be...

  • Research Scientist

    4 weeks ago


    London, Greater London, United Kingdom AI Safety Institute Full time

    Unlock the Secrets of AI SafetyAISI is pioneering a groundbreaking Mechanistic Interpretability team to tackle the fundamental question of how can we ensure AI models are safe and transparent? This ambitious project aims to bring interpretability to the forefront, ensuring that AI systems can be reliably evaluated for safety and alignment. We're seeking a...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    As the Head of Cyber Resilience at the AI Safety Institute, you will lead the development of a robust security strategy to protect the organization's assets and ensure the integrity of its operations. You will work closely with the AI Safety Institute's leadership team to identify and mitigate potential security risks, and develop policies and procedures to...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    AI Safety Institute Research OpportunityThe AI Safety Institute is seeking talented researchers to join its Safeguard Analysis Team. This team focuses on developing and analyzing interventions to secure AI systems from abuse by bad actors.Key Responsibilities:Conduct research on AI security threats and interventionsDevelop and analyze attacks and protections...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    The AI Safety Institute is seeking a highly skilled Machine Learning Research Scientist to join our team and contribute to the development of safety cases for AI systems. As a key member of our research team, you will work closely with our Research Director and other experts to advance our understanding of AI safety and governance.Key...


  • London, Greater London, United Kingdom AI Safety Institute Full time

    Job Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and developing innovative solutions to mitigate risks associated with AI systems.About...