AI Safety Specialist
2 weeks ago
Our team at Mistral AI is looking for an AI Safety Specialist to join our ranks. As an AI Safety Specialist, you will be responsible for evaluating, enhancing, and building safety mechanisms for our large language models.
The ideal candidate will have a strong background in AI, computer science, or a related field. They will be familiar with Python and proficient in software engineering. The successful candidate will also have hands-on experience with AI frameworks and tools, as well as a high technical engineering competence. Additionally, they will have a high scientific track record in their field.
About the Role
Key Responsibilities:
- Evaluate potential risks and harms associated with LLM outputs.
- Develop monitoring systems to prevent misuse and ensure user well-being.
- Collaborate with the AI development team to create and implement safety measures.
About You
- You have a degree in Computer Science, AI, Machine Learning, or a related field.
- You are familiar with Python and have hands-on experience with AI frameworks and tools.
- You have high technical engineering competence and a high scientific track record in your field.
Benefits
We offer a competitive cash salary, equity, and a range of benefits including:
Food: Daily lunch vouchers
Sport: Monthly contribution to a Gympass subscription
Transportation: Monthly contribution to a mobility pass
Health: Full health insurance for you and your family
Parental: Generous parental leave policy
Visa sponsorship
Competitive Healthcare program
Monthly contribution to a pension scheme
Monthly contribution to a transportation scheme
Monthly contribution to a sport scheme
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
Visa sponsorship in France or the UK
Full health insurance for you and your family in France or the UK
Generous parental leave policy in France or the UK
Competitive Healthcare program in France or the UK
Monthly contribution to a pension scheme in France or the UK
Monthly contribution to a transportation scheme in France or the UK
Monthly contribution to a sport scheme in France or the UK
-
AI Safety Specialist
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeKey ResponsibilitiesThe successful candidate will play a crucial role in shaping the AI Safety Institute's approach to AI safety, working closely with the Research Unit to develop and implement safety frameworks and guidelines.Key TasksDevelop and maintain safety frameworks and guidelines for AI development and deploymentCollaborate with the Research Unit to...
-
Research Scientist in AI Safety
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe AI Safety Institute is seeking a highly motivated and talented Research Scientist to join our team in the area of AI safety research. The successful candidate will work on studying, evaluating, and recommending mitigations for extreme risks from autonomous AI systems.Key ResponsibilitiesConduct research on AI safety and risk mitigationDevelop and...
-
AI Safety Researcher
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe're focused on addressing extreme risks from autonomous AI systems that can interact with the real world. To do this, we're advancing the state of the art in risk modeling, incorporating insights from other safety-critical and adversarial domains, and developing novel techniques. We're also empirically evaluating these risks through one of the world's...
-
Senior Research Scientist in AI Safety
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe're pushing the boundaries of AI safety research at the AI Safety Institute. As a research scientist, you'll be part of a dynamic team exploring the risks of autonomous AI systems. Your expertise will help us advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains. You'll work closely with...
-
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly skilled Workstream Lead to spearhead our Systemic Safety and Responsible Innovation team. As a key member of our leadership team, you will be responsible for developing and delivering a strategy to advance systemic AI safety research, shaping a market-shaping agenda, and building a multidisciplinary team focused on...
-
Research Scientist
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob SummaryWe are seeking a highly skilled Research Scientist to join our Science of Evaluations team at the AI Safety Institute. As a Research Scientist, you will play a key role in conducting applied and foundational research focused on the measurement of frontier AI system capabilities.Key ResponsibilitiesDevelop and apply rigorous scientific techniques...
-
Cybersecurity Research Engineer
1 day ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe are seeking an exceptional Cybersecurity Research Engineer to join our team at the AI Safety Institute. Our goal is to develop first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in cyber security. The selected candidate will work closely with a cross-functional team of cybersecurity researchers, machine...
-
AI Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeUnlock the Future of AI Safety ResearchWe're pushing the boundaries of AI safety research at the AI Safety Institute, and we're looking for talented individuals to join our team. As a risk modeling researcher, you'll play a critical role in advancing our understanding of extreme risks from autonomous AI systems.Key Responsibilities:Develop and apply novel...
-
AI Safety Institute Policy Director
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeLead the Way in AI GovernanceAISI is launching a new workstream focused on understanding and mitigating the risks that arise from repeated or prolonged human-AI interaction.As the lead for this novel team, you will build and lead a multidisciplinary team to evaluate and mitigate the behavioural and psychological risks that emerge from AI systems.Develop and...
-
Alignment Researcher, AI Safety Specialist
1 week ago
London, Greater London, United Kingdom Atla Ai Full timeAtla is dedicated to developing safe, beneficial AI systems with a profound impact on humanity's future. As a leading London-based startup, we're building the most advanced AI evaluation models. We're seeking an exceptional individual to join our team and collaborate with industry leaders to shape the future of AI.As Atla's alignment researcher, you'll be...
-
AI Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe're advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research focuses on extreme risks from autonomous AI systems, capable of interacting with the real world. As a risk modelling researcher, your work will span the full space of risks from...
-
Senior Generative AI Specialist
1 day ago
London, Greater London, United Kingdom Sacher AI Full time**Job Summary:**Sacher AI is looking for a skilled Senior Generative AI Specialist to join our team. As a key member of our AI Research and Innovation Lab, you will lead the advancement of LLM and generative AI projects, managing the entire lifecycle from concept to deployment.**About Us:**We are a small but fast-growing team at an exciting stage of...
-
AI Business Growth Specialist
2 days ago
London, Greater London, United Kingdom Mesh-AI Full timeAbout Us: Mesh-AI is a forward-thinking company dedicated to harnessing the power of artificial intelligence to drive business innovation and efficiency.Job Title: AI Business Growth SpecialistAbout the Role:We are seeking an experienced AI Business Growth Specialist to join our team. As a key member of our organization, you will be responsible for...
-
Cybersecurity Research Engineer
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly motivated and talented Research Engineer to join our Cyber Evaluations Team at the AI Safety Institute. As a key member of our team, you will play a crucial role in developing first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in the domain of cyber security.Key...
-
Artificial Intelligence Research Engineer
4 weeks ago
London, Greater London, United Kingdom Atla Ai Full timeUnlock the Future of AI with Atla AiAtla Ai is revolutionizing the field of Artificial Intelligence by developing safe and beneficial AI systems. We are a London-based start-up backed by top investors and founders, and we're looking for a talented Research Engineer to join our team.Role and ResponsibilitiesAs a Research Engineer at Atla Ai, you will be...
-
Research Scientist
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeUnlock the Secrets of AI SafetyAISI is pioneering a groundbreaking Mechanistic Interpretability team to tackle the fundamental question of how can we ensure AI models are safe and transparent? This ambitious project aims to bring interpretability to the forefront, ensuring that AI systems can be reliably evaluated for safety and alignment. We're seeking a...
-
Head of Cyber Resilience
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAs the Head of Cyber Resilience at the AI Safety Institute, you will lead the development of a robust security strategy to protect the organization's assets and ensure the integrity of its operations. You will work closely with the AI Safety Institute's leadership team to identify and mitigate potential security risks, and develop policies and procedures to...
-
London, Greater London, United Kingdom AI Safety Institute Full timeAI Safety Institute Research OpportunityThe AI Safety Institute is seeking talented researchers to join its Safeguard Analysis Team. This team focuses on developing and analyzing interventions to secure AI systems from abuse by bad actors.Key Responsibilities:Conduct research on AI security threats and interventionsDevelop and analyze attacks and protections...
-
London, Greater London, United Kingdom AI Safety Institute Full timeThe AI Safety Institute is seeking a highly skilled Machine Learning Research Scientist to join our team and contribute to the development of safety cases for AI systems. As a key member of our research team, you will work closely with our Research Director and other experts to advance our understanding of AI safety and governance.Key...
-
Machine Learning Research Scientist
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and developing innovative solutions to mitigate risks associated with AI systems.About...