AI Safety Engineer
2 months ago
The Post-Training Team at the AI Safety Institute is dedicated to optimizing AI systems for state-of-the-art performance in various risk domains. This involves a combination of scaffolding, prompting, supervised and RL fine-tuning of AI models.
Key Responsibilities:- Improve model performance using cutting-edge machine learning techniques
- Develop methodologies for in-depth analysis of agent behavior
- Implement new tools for LLM agents or create pipelines for supporting and fine-tuning large open-source models
As a Research Scientist on this team, you will work closely with our Agents sub-team to develop highly capable LLM-based agents and our Finetuning Team to build out finetuning pipelines.
Our ideal candidate has experience conducting empirical machine learning research, particularly on LLMs, and experience with machine learning engineering or software engineering with relevant skills/knowledge.
-
AI Safety Engineer
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeCompany Overview: The AI Safety Institute is a leading organization in the field of artificial intelligence safety. Our mission is to ensure that AI systems are developed and used in ways that benefit society.Salary: £80,000 - £120,000 per annum, depending on experience.Job Description: We are seeking a highly skilled Research Engineer to join our...
-
AI Safety Researcher
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the AI Safety InstituteThe AI Safety Institute (AISI) is a pioneering organization dedicated to advancing AI safety for the public interest. Our mission is to assess and mitigate risks from frontier AI systems, including cyber attacks on critical infrastructure, AI-enhanced chemical and biological threats, large-scale societal disruptions, and...
-
AI Safety Engineer
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeResearch Scientist Position:We are seeking a skilled Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will contribute to the development of cutting-edge AI security solutions and help drive our mission forward.Your primary responsibility will be to design and deploy novel AI systems that can...
-
AI Safety Specialist
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe are seeking a highly skilled AI Safety Specialist to join our team at the AI Safety Institute. In this role, you will be responsible for leading a multidisciplinary team of research engineers and scientists in advancing safety science for advanced AI models.The ideal candidate will have a strong background in AI/ML applied to engineering biology and...
-
AI Safety Researcher
1 month ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly motivated and talented Research Scientist/Engineer to join our Societal Impacts team at the AI Safety Institute. The successful candidate will work with other researchers to design and run studies that answer important questions about the effect of AI on society.The ideal candidate will have a strong background in...
-
Advanced AI Safety Engineer
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are hiring an experienced Advanced AI Safety Engineer to join our research unit. The successful candidate will be responsible for designing, shipping, and maintaining complex tech products while ensuring their safety and security.The ideal candidate will have a strong understanding of large language models, including their strengths and...
-
AI Safety Research Professional
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob Overview:We are seeking a highly skilled Research Scientist/Engineer to join our team at the AI Safety Institute. As a Research Scientist/Engineer, you will play a critical role in advancing our understanding of the societal impacts of AI and contributing to the development of AI safety policies and guidelines. This is an exciting opportunity to work...
-
AI Safety Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout AI Safety InstituteAISI is a leading research institution in the field of artificial intelligence safety. We are dedicated to developing and applying cutting-edge technologies to ensure that AI systems align with human values.We are currently seeking a highly skilled researcher to join our Mechanistic Interpretability team. As a researcher, you will be...
-
AI Safety Expertise Developer
4 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe AI Safety Institute is looking for exceptional individuals to join our team as Research Engineers. As part of this role, you will be working on developing first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in the domain of cybersecurity.Job DescriptionWe are seeking experienced researchers with expertise...
-
Machine Learning Engineer for AI Safety
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe development of advanced AI capabilities in the domain of cybersecurity presents a unique set of challenges and opportunities for organisations and individuals alike. The AI Safety Institute's Cyber Evaluations Team is leading the charge in this area, working to develop first-of-its-kind government-run infrastructure to benchmark the progress of these...
-
AI Safety Research Scientist
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the AI Safety InstituteThe AI Safety Institute (AISI) is a pioneering organization dedicated to advancing AI safety for the public interest. Our mission is to assess and mitigate risks from frontier AI systems, including cyber attacks on critical infrastructure, AI-enhanced chemical and biological threats, large-scale societal disruptions, and...
-
AI Safety Research Specialist
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleThis is an exceptional opportunity to join our research unit as a Research Scientist/Engineer and contribute to cutting-edge projects that impact both technical AI safety and AI governance.You will work with a multidisciplinary team to design and run studies that answer important questions about the effect AI has on society.We are looking for...
-
AI Safety Specialist
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAs a highly motivated and talented AI Safety Specialist, you will be part of a multidisciplinary team at the AI Safety Institute studying the effects of advanced AI models on society. We are looking for individuals who can work collaboratively with our researchers to design and run studies that answer crucial questions about the impact of AI on people and...
-
AI Safety Researcher
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeSalary: £80,000 - £110,000 per annumA career-defining opportunity awaits at the AI Safety Institute as a PhD Research Scientist. This role will see you contribute to cutting-edge research in AI safety and governance, working closely with experts in the field to develop and apply rigorous scientific techniques for measuring AI system capabilities.The team...
-
AI Safety Specialist
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeCompany OverviewThe AI Safety Institute is a leading organisation dedicated to advancing the science of risk modelling and mitigating the risks associated with autonomous AI systems. We are focused on extreme risks from autonomous AI systems - those capable of interacting with the real world.To address this, we're advancing the state of the science in risk...
-
Responsible AI Engineer
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob DescriptionAs an AISI resident, you'll be mentored by a multi-disciplinary team including scientists, engineers and domain experts on autonomy risks. You will work in a team of other scholars to build evaluations.Some of the areas we focus on include:Autonomous Research and Development (R&D): Investigating AI systems' potential to conduct research,...
-
AI Security and Safety Expert
3 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the Job: We are looking for a talented individual to work with our cross-functional team of cybersecurity researchers, machine learning researchers, research engineers, and infrastructure engineers to create new kinds of capability and safety evaluations for frontier AI systems. As a Cybersecurity Research Engineer, you will play a key role in running...
-
Senior Technical Lead for AI Safety
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe are excited to announce an outstanding opportunity for a Senior Technical Lead to join our Bio-Chem work stream at the AI Safety Institute. This role requires a seasoned expert in AI/ML applied to engineering biology/chemistry who can lead a talented team and drive innovation.About the PositionIn this critical role, you will be responsible for advancing...
-
Research Lead in AI Safety
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeJoin Our TeamWe are seeking a talented Research Lead in AI Safety to join our team at the AI Safety Institute. As a leading researcher in the field of AI safety and governance, you will play a key role in shaping our research agenda and contributing to the development of cutting-edge AI systems.About the RoleThis is an exciting opportunity to work on some of...
-
Machine Learning Engineer
2 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob Description: As a Senior Research Engineer in the LLM Evaluations Team, you will be responsible for developing and running evaluations that measure the ability of Large Language Models to provide detailed instructions and troubleshooting advice for complex tasks. You will collaborate closely with other researchers and receive coaching and mentorship from...