AI Safety Research Engineer
1 month ago
At the AI Safety Institute, we are dedicated to optimizing AI systems for state-of-the-art performance across various risk domains. Our Post-Training Team works tirelessly to fine-tune and scaffold AI models, ensuring they reach their full potential.
About the RoleWe are seeking a strong Research Scientist to join our team. As a member of this team, you will utilize cutting-edge machine learning techniques to enhance model performance in our areas of interest. Your responsibilities will include designing new techniques for scaling inference-time computation, developing methodologies for in-depth analysis of agent behavior, and implementing tools for our LLM agents.
This role offers a unique opportunity to span or alternate between research-oriented tasks and engineering responsibilities. We recognize that some technical staff may prefer to balance these aspects, and this versatility is something we actively look for in our hires.
About YouTo be successful in this role, you will require:
- A PhD in a technical field and/or papers at top ML conferences, particularly on LLMs
- Experience with machine learning engineering or extensive experience as a software engineer with relevant skills/knowledge in machine learning
- Experience building LLM agents in industry or open-source collectives, particularly in areas adjacent to our main interests
You will also have the opportunity to lead research on improving and measuring the capabilities of LLM agents, build pipelines for fine-tuning, and finetune or pretrain LLMs in a research context.
What We OfferWe offer a range of pension options, a competitive salary of approximately $140,000 per year, and the chance to work on cutting-edge projects in the field of AI safety.
-
AI Safety Researcher
18 hours ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the AI Safety InstituteThe AI Safety Institute (AISI) is a pioneering organization dedicated to advancing AI safety for the public interest. Our mission is to assess and mitigate risks from frontier AI systems, including cyber attacks on critical infrastructure, AI-enhanced chemical and biological threats, large-scale societal disruptions, and...
-
AI Safety Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly motivated and talented Research Scientist/Engineer to join our Societal Impacts team at the AI Safety Institute. The successful candidate will work with other researchers to design and run studies that answer important questions about the effect of AI on society.The ideal candidate will have a strong background in...
-
AI Safety Researcher
1 week ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout AI Safety InstituteAISI is a leading research institution in the field of artificial intelligence safety. We are dedicated to developing and applying cutting-edge technologies to ensure that AI systems align with human values.We are currently seeking a highly skilled researcher to join our Mechanistic Interpretability team. As a researcher, you will be...
-
AI Safety Research Specialist
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleThis is an exceptional opportunity to join our research unit as a Research Scientist/Engineer and contribute to cutting-edge projects that impact both technical AI safety and AI governance.You will work with a multidisciplinary team to design and run studies that answer important questions about the effect AI has on society.We are looking for...
-
Cybersecurity Research Engineer
1 month ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe are seeking an exceptional Cybersecurity Research Engineer to join our team at the AI Safety Institute. Our goal is to develop first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in cyber security. The selected candidate will work closely with a cross-functional team of cybersecurity researchers, machine...
-
London, Greater London, United Kingdom AI Safety Institute Full timeAs advanced AI systems continue to evolve, the potential risks associated with their cyber capabilities pose a significant threat to organizational and individual security. These risks are particularly concerning when combined with other AI risk areas, such as harmful outcomes from biological and chemical capabilities, and autonomous systems.The AI Safety...
-
AI Safety Engineer
1 week ago
London, Greater London, United Kingdom AI Safety Institute Full timeCompany Overview: The AI Safety Institute is a leading organization in the field of artificial intelligence safety. Our mission is to ensure that AI systems are developed and used in ways that benefit society.Salary: £80,000 - £120,000 per annum, depending on experience.Job Description: We are seeking a highly skilled Research Engineer to join our...
-
AI Safety Engineer
1 month ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe Post-Training Team at the AI Safety Institute is dedicated to optimizing AI systems for state-of-the-art performance in various risk domains. This involves a combination of scaffolding, prompting, supervised and RL fine-tuning of AI models.Key Responsibilities:Improve model performance using cutting-edge machine learning techniquesDevelop methodologies...
-
AI Safety Expert Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeWe are advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research aims to empirically evaluate these risks by building one of the world's largest agentic evaluation suites and pushing forward the science of model evaluations.Job RoleYou will work as...
-
Research Director for AI Safety
1 week ago
London, Greater London, United Kingdom AI Safety Institute Full time**Job Title:** Policy Lead**Location:** N/AAs a leading expert in the field of human-AI interaction risks, you will lead a multidisciplinary research team at the AI Safety Institute to evaluate and mitigate the behavioral and psychological risks that emerge from AI systems. The position offers a unique opportunity to push forward an emerging field and be...
-
Senior AI Researcher
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeRole OverviewWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. This role offers a unique opportunity to work closely with world-class researchers and contribute to the development of safety cases for AI systems.About the RoleThis is a challenging and rewarding role that requires strong technical...
-
AI Safety Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly motivated and talented Research Scientist to join our Societal Impacts team at the AI Safety Institute. The successful candidate will work with our team to design and run studies that answer important questions about the effect AI will have on society.Key ResponsibilitiesDesign and run studies to evaluate the impact of...
-
Advanced AI Researcher Position
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe AI Safety Institute is looking for a talented Cybersecurity Research Engineer to join our research unit. As a key member of our team, you will play a critical role in developing and implementing new AI safety techniques.The successful candidate will have a strong background in cybersecurity and extensive experience working with large language models. You...
-
Machine Learning Engineer for AI Safety
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeThe development of advanced AI capabilities in the domain of cybersecurity presents a unique set of challenges and opportunities for organisations and individuals alike. The AI Safety Institute's Cyber Evaluations Team is leading the charge in this area, working to develop first-of-its-kind government-run infrastructure to benchmark the progress of these...
-
AI Safety Researcher
13 hours ago
London, Greater London, United Kingdom AI Safety Institute Full timeAbout the RoleWe are seeking a highly skilled Research Scientist to join our Post-Training Team at the AI Safety Institute. The successful candidate will use cutting-edge machine learning techniques to improve model performance in our domains of interest. This includes developing and optimizing large language models (LLMs) for various applications, such as...
-
Senior AI Safety Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeEstimated Salary: £80,000 - £110,000 per annumAbout the RoleWe are seeking an exceptional Senior AI Safety Researcher to join our team at the AI Safety Institute. This is a unique opportunity to contribute to the development of safety cases and advance the field of AI governance.Key ResponsibilitiesConduct foundational research on safety cases to help...
-
Research Scientist in AI Safety
1 week ago
London, Greater London, United Kingdom AI Safety Institute Full timeJob DescriptionWe are seeking a highly skilled Research Scientist to join our team at the AI Safety Institute. This role offers an exciting opportunity to contribute to the development of rigorous scientific techniques for the measurement of frontier AI system capabilities.As a member of our Science of Evaluations team, you will be responsible for conducting...
-
Research Scientist for AI Governance
19 hours ago
London, Greater London, United Kingdom AI Safety Institute Full timeJoin Our Mission to Ensure AI SafetyWe're a team of experts dedicated to ensuring AI safety and governance. Our mission is to advance AI safety for the public interest by assessing and mitigating risks from frontier AI systems. We're looking for exceptional researchers to join our Societal Impacts team and contribute to designing and running studies that...
-
AI Safety Specialist
5 days ago
London, Greater London, United Kingdom AI Safety Institute Full timeAs a highly motivated and talented AI Safety Specialist, you will be part of a multidisciplinary team at the AI Safety Institute studying the effects of advanced AI models on society. We are looking for individuals who can work collaboratively with our researchers to design and run studies that answer crucial questions about the impact of AI on people and...
-
Senior AI Safety Researcher
4 weeks ago
London, Greater London, United Kingdom AI Safety Institute Full timeRole OverviewThe AI Safety Institute is seeking a highly skilled Senior AI Safety Researcher to join its Safeguard Analysis Team. The successful candidate will play a key role in researching and developing interventions that secure systems from abuse by bad actors.About the RoleThis is a challenging and rewarding opportunity for an experienced researcher to...