AI Safety Research Engineer

We are seeking an exceptional Cybersecurity Research Engineer to join our team at the AI Safety Institute. Our goal is to develop first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in cyber security. The selected candidate will work closely with a cross-functional team of cybersecurity researchers, machine...

The AI Safety Institute is seeking a highly motivated and talented Research Scientist to join our team in the area of AI safety research. The successful candidate will work on studying, evaluating, and recommending mitigations for extreme risks from autonomous AI systems.Key ResponsibilitiesConduct research on AI safety and risk mitigationDevelop and...

We're pushing the boundaries of AI safety research at the AI Safety Institute. As a research scientist, you'll be part of a dynamic team exploring the risks of autonomous AI systems. Your expertise will help us advance the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains. You'll work closely with...

We're focused on addressing extreme risks from autonomous AI systems that can interact with the real world. To do this, we're advancing the state of the art in risk modeling, incorporating insights from other safety-critical and adversarial domains, and developing novel techniques. We're also empirically evaluating these risks through one of the world's...

The Post-Training Team at the AI Safety Institute is dedicated to optimizing AI systems for state-of-the-art performance in various risk domains. This involves a combination of scaffolding, prompting, supervised and RL fine-tuning of AI models.Key Responsibilities:Improve model performance using cutting-edge machine learning techniquesDevelop methodologies...

Job SummaryWe are seeking a highly skilled Research Scientist to join our Science of Evaluations team at the AI Safety Institute. As a Research Scientist, you will play a key role in conducting applied and foundational research focused on the measurement of frontier AI system capabilities.Key ResponsibilitiesDevelop and apply rigorous scientific techniques...

Key ResponsibilitiesThe successful candidate will play a crucial role in shaping the AI Safety Institute's approach to AI safety, working closely with the Research Unit to develop and implement safety frameworks and guidelines.Key TasksDevelop and maintain safety frameworks and guidelines for AI development and deploymentCollaborate with the Research Unit to...

The AI Safety Institute is seeking a highly skilled Research Engineer to join our team in the field of AI safety. The successful candidate will be responsible for studying, evaluating, and recommending mitigations for extreme risks from autonomous AI systems. This includes risk models such as auto-replication, iterative self-improvement, and large-scale...

The Post-Training Team at AI Safety Institute focuses on optimising AI systems to achieve state-of-the-art performance across various risk domains. This is accomplished through scaffolding, prompting, supervised and RL fine-tuning of AI models, which include access to tools for interacting with the underlying operating system.Job OverviewWe are seeking...

Atla is dedicated to developing safe, beneficial AI systems with a profound impact on humanity's future. As a leading London-based startup, we're building the most advanced AI evaluation models. We're seeking an exceptional individual to join our team and collaborate with industry leaders to shape the future of AI.As Atla's alignment researcher, you'll be...

Unlock the Future of AI with Atla AiAtla Ai is revolutionizing the field of Artificial Intelligence by developing safe and beneficial AI systems. We are a London-based start-up backed by top investors and founders, and we're looking for a talented Research Engineer to join our team.Role and ResponsibilitiesAs a Research Engineer at Atla Ai, you will be...

About the RoleWe are seeking a highly motivated and talented Research Engineer to join our Cyber Evaluations Team at the AI Safety Institute. As a key member of our team, you will play a crucial role in developing first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in the domain of cyber security.Key...

About the RoleWe are seeking a highly skilled Workstream Lead to spearhead our Systemic Safety and Responsible Innovation team. As a key member of our leadership team, you will be responsible for developing and delivering a strategy to advance systemic AI safety research, shaping a market-shaping agenda, and building a multidisciplinary team focused on...

About AtlaWe are a London-based start-up building the most capable AI evaluation models. Our mission is to engineer safe, beneficial AI systems that will have a massive positive impact on the future of humanity.RoleAs Atla's alignment research engineer, you'll develop language models as evaluators and use your insights to construct safety guardrails for...

We're advancing the state of the science in risk modeling, incorporating insights from safety-critical and adversarial domains, while developing novel techniques. Our research focuses on extreme risks from autonomous AI systems, capable of interacting with the real world. As a risk modelling researcher, your work will span the full space of risks from...

We are seeking a highly skilled Senior Research Manager to lead our team of scientists and engineers in the development of novel techniques for risk modeling and evaluation of autonomous AI systems.Key Responsibilities:Managing a multi-disciplinary team of scientists, engineers, and domain experts to advance the state of the science in risk modeling and...

AI Safety Institute Research OpportunityThe AI Safety Institute is seeking talented researchers to join its Safeguard Analysis Team. This team focuses on developing and analyzing interventions to secure AI systems from abuse by bad actors.Key Responsibilities:Conduct research on AI security threats and interventionsDevelop and analyze attacks and protections...

Atla Ai: Safeguarding the Future of HumanityAbout Us:We're Atla Ai, a pioneering London-based start-up dedicated to engineering safe and beneficial AI systems. Our mission is to drive positive change in the world by developing cutting-edge AI evaluation models.Role Overview:As our alignment research engineer, you'll play a pivotal role in shaping the future...

About the RoleWe are seeking a highly motivated and talented Research Engineer to join our Cyber Evaluations Team at the AI Safety Institute. As a key member of our team, you will play a crucial role in developing first-of-its-kind government-run infrastructure to benchmark the progress of advanced AI capabilities in the domain of cyber security.Key...

Job Title: Machine Learning Research ScientistWe are seeking a highly skilled Machine Learning Research Scientist to join our team at the AI Safety Institute. As a key member of our research unit, you will play a critical role in advancing our understanding of AI safety and developing innovative solutions to mitigate risks associated with AI systems.About...