AI Safety Specialist

6 days ago


London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time
About the Role

We are seeking a highly skilled Cybersecurity Researcher to join our team at the Department for Science, Innovation & Technology. As a key member of our Cyber Evaluations Team, you will play a crucial role in measuring the capabilities of AI systems against scenarios covered by our threat model, with a focus on measuring their performance on tasks related to cybersecurity.

Key Responsibilities
  • Design and conduct experiments to measure the capabilities of AI systems against scenarios covered by our threat model.
  • Communicate and interpret results to inform the development of AI safety evaluations and risk mitigation strategies.
  • Collaborate with cross-functional teams to build better tooling for measuring and understanding risk due to increases in model capability.
  • Design experiments to measure the uplift that AI systems might provide to malicious attackers, and conduct research to develop mitigations to prevent misuse of AI systems or better defend against AI-enabled cyber attacks.
Requirements
  • Relevant experience in industry, academia, or open-source collectives in a field related to machine learning, AI, AI security, or computer security.
  • Experience in building software systems to meet research requirements and have led or been a significant contributor to relevant software projects, demonstrating cross-functional collaboration skills.
  • Knowledge of training, fine-tuning, scaffolding, prompting, deploying, and/or evaluating current cutting-edge machine learning systems, such as large language models.
  • Knowledge of statistics.
  • A strong curiosity in understanding AI systems and studying the security implications of this technology.
  • Motivated to conduct research that is not only curiosity-driven but also solves concrete open questions in governance and policy making.
  • Ability to work autonomously and in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem.
  • Bring your own voice and experience but also an eagerness to support your colleagues together with a willingness to do whatever is necessary for the team's success and find new ways of getting things done within government.
  • Have a sense of mission, urgency, and responsibility for success, demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done.
Nice-to-Have Skills
  • Relevant Cyber Security Expertise.
  • Extensive Python experience, including understanding the intricacies of the language, the good vs. bad Pythonic ways of doing things, and much of the wider ecosystem/tooling.
  • Direct research experience (PhD in a technical field and/or spotlight papers at NeurIPS/ICML/ICLR).
  • Experience working with world-class multi-disciplinary teams, including both scientists and engineers (in a top-3 lab).
What We Offer
  • A culture of flexible working, such as job sharing, homeworking, and compressed hours.
  • Automatic enrolment into the pension scheme, with an average employer contribution of 27%.
  • A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
  • An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
  • Access to a range of retail, travel, and lifestyle employee discounts.


  • London, Greater London, United Kingdom Real Voice AI Full time

    About RealVoice AIWe are a cutting-edge startup at the intersection of artificial intelligence and telecommunications. Our mission is to transform the telecommunications industry through innovative AI solutions.Job SummaryAs an AI Recruitment Specialist at RealVoice AI, you will be responsible for building and managing a team, leveraging our unique AI...


  • London, Greater London, United Kingdom Real Voice AI Full time

    About RealVoice AIWe are a cutting-edge startup at the intersection of artificial intelligence and telecommunications. Our mission is to transform the telecommunications industry through innovative AI solutions.Job SummaryAs an AI Recruitment Specialist at RealVoice AI, you will be responsible for building and managing a team, leveraging our unique AI...


  • London, Greater London, United Kingdom Real Voice AI Full time

    About RealVoice AIWe are a cutting-edge startup at the intersection of artificial intelligence and telecommunications, revolutionizing how businesses communicate. Our mission is to transform the telecommunications industry through innovative AI solutions.Job SummaryWe are seeking an AI Recruitment Specialist to join our team and be at the forefront of...


  • London, Greater London, United Kingdom Ai Forge Full time

    About UsAi Forge is a pioneering organization dedicated to empowering the next generation of AI entrepreneurs. Our mission is to provide comprehensive support to turn groundbreaking AI ideas into market-ready solutions.Role OverviewAs our AI Innovation Outreach Specialist, you will play a pivotal role in expanding our reach and nurturing our community. You...


  • London, Greater London, United Kingdom Ai Forge Full time

    About UsAi Forge is a pioneering organization dedicated to empowering the next generation of AI entrepreneurs. Our mission is to provide comprehensive support to turn groundbreaking AI ideas into market-ready solutions.Role OverviewAs our AI Innovation Outreach Specialist, you will play a pivotal role in expanding our reach and nurturing our community. You...


  • London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...


  • London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the public good. Our objective is to foster responsible actions in advanced technology by bringing together a talented group of technical experts.We are driven by ambitious goals and a...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing public safety in the realm of artificial intelligence. Our objective is to foster responsible development in advanced technologies by assembling a team of skilled professionals committed to this cause.We are...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting responsible AI development and ensuring public safety in the face of rapid technological advancements. Our mission is to cultivate a team of skilled professionals who can navigate the complexities of AI...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We are seeking a visionary leader to drive innovation and deliver...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We are seeking a visionary leader to drive innovation and deliver...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2.5 years and have huge ambitions...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2.5 years and have huge ambitions...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2.5 years and have huge ambitions...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2.5 years and have huge ambitions...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to advancing the responsible development of artificial intelligence for the benefit of society. Our mission is to foster a safe and secure AI landscape through rigorous research and collaboration with experts across...


  • London, Greater London, United Kingdom Mesh-AI Full time

    About Mesh-AIWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2.5 years and have huge ambitions...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is committed to promoting AI safety for the benefit of society. Our mission emphasizes the importance of having a proficient and empowered team of technology experts to navigate the complexities of AI governance.We are focused on...


  • London, Greater London, United Kingdom Mesh-AI Limited Full time

    About Mesh-AI LimitedWe are a leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors.We have grown from 0-100 people in 2 years and have huge...