AI Security Research Specialist

3 weeks ago


London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

Position Overview

About the Department for Science, Innovation & Technology

The Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the public good. We are focused on fostering a group of skilled professionals who can address the challenges posed by advanced AI technologies.

Our mission is urgent and ambitious. We are seeking top-tier talent to contribute to our objectives:

Conduct evaluations on cutting-edge AI systems. This involves characterizing safety-critical capabilities, understanding the security and reliability of these systems, and evaluating their societal implications.Create innovative tools for AI governance. We aim to develop practical frameworks and methodologies to assess the safety and societal effects of advanced AI systems, while anticipating future research needs in AI governance.Enhance information sharing. We will establish effective communication channels between our department and various national and international stakeholders, including policymakers and partners.

Our team comprises experienced professionals from leading tech companies, start-ups, and academia. We invite exceptional individuals to contribute to shaping the future of AI safety.

Core Responsibilities

About the Safeguards Team

As AI technologies become increasingly powerful, the mechanisms that prevent misuse are critical. The Safeguard Analysis Team focuses on evaluating the vulnerabilities of advanced AI systems, including testing their protective measures.

This team takes a comprehensive approach to security, considering both machine learning-based and traditional security threats and defenses.

The team's responsibilities include:

Researching emerging threats to understand how advancements in AI functionality impact security assessments.Analyzing information security protocols to identify weaknesses and evaluate their influence on system risk.Developing strategies to control and mitigate risks associated with the misuse of AI systems.Conducting evaluations and red teaming exercises to assess the effectiveness of protective measures in place.

We are hiring at various levels of expertise, including senior positions. Final titles, seniority, and compensation will be determined during the recruitment process.

As a Research Scientist/Research Engineer in the Safeguard Analysis Team, you will play a key role in defining our approach to enhancing AI security. Your contributions will include:

Designing and executing evaluations of AI systems and analyzing their results.Contributing to strategies for improving AI security, including developing threat models.Innovating new attack methodologies against AI systems and exploring potential mitigations.Investigating AI controls and defenses to identify the most effective risk reduction strategies.Building tools to facilitate efficient evaluation processes.Engaging in research projects addressing critical open questions in AI security.Collaborating with team leads, engineers, and other scientists.Working with external experts and organizations to enhance our research efforts.

Candidate Profile

Ideal candidates will have a background in technical research related to machine learning, computer security, or information security.

We seek individuals with the following qualifications:

Experience in industry, academia, or relevant open-source projects related to AI or computer security.Proficiency in Python programming.Strong communication skills, both written and verbal.Familiarity with large language models and related technologies.Experience in developing software systems for research purposes.Knowledge of statistical methods.Ability to work independently and adapt in a dynamic environment.A collaborative mindset and a commitment to team success.A sense of responsibility and urgency in achieving objectives.Experience in enhancing scientific and technical standards through mentorship.

Core Requirements

Availability to work at least four days a week.Commitment to a minimum engagement period.Flexibility to work both in-office and remotely.

Benefits

The Department offers a competitive benefits package, including:

Flexible working arrangements.Automatic enrollment in a pension scheme with substantial employer contributions.A minimum of 25 days of paid annual leave, increasing with tenure.Access to extensive learning and professional development opportunities.Employee discounts on various services.A hybrid working policy allowing a mix of office and remote work.

  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting the safe advancement of artificial intelligence for the benefit of society. We are committed to fostering a robust environment where technical experts can collaborate to ensure the responsible development of...


  • London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...


  • London, Greater London, United Kingdom Atla Ai Full time

    About Atla AIWe are a London-based start-up dedicated to developing safe and beneficial AI systems that will have a profound impact on the future of humanity.Our mission is to engineer AI systems that align with human values and preferences, and we are seeking a highly skilled Research Engineer to join our team.Job SummaryWe are looking for a talented...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the public good. Our mission is to ensure that the development and deployment of AI technologies are conducted responsibly and ethically.We are seeking skilled professionals to help us achieve...


  • London, Greater London, United Kingdom Mmr Research Full time

    About the Role:We are seeking a highly skilled and experienced Senior AI Research Executive to join our team at Mmr Research. As a key member of our Conversational AI Research team, you will play a critical role in championing the adoption of Conversational AI across our organization.Key Responsibilities:Develop and deliver tailored training programs for our...


  • London, Greater London, United Kingdom Mmr Research Full time

    About the Role:We are seeking a highly skilled and experienced Senior AI Research Executive to join our team at Mmr Research. As a key member of our Conversational AI Research team, you will play a critical role in championing the adoption of Conversational AI across our organization.Key Responsibilities:Develop and deliver tailored training programs for our...


  • London, Greater London, United Kingdom Databricks Full time

    Become a Key Member of Our Responsible AI TeamAt Databricks, we are committed to creating and executing AI solutions that emphasize fairness, transparency, and accountability. We are seeking a qualified individual to engage in security design assessments, red team activities, and innovative research in the field of AI security.Stay updated with the latest...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to promoting responsible AI development and ensuring public safety in the face of rapid technological advancements. Our mission is to cultivate a team of skilled professionals who can navigate the complexities of AI...

  • Research Manager

    17 hours ago


    London, Greater London, United Kingdom MBN Solutions Full time

    Job OverviewMBN Solutions is seeking a visionary Research Manager to lead our Data & Security Research Group at the forefront of technological innovation, shaping the future of data trust and advanced AI security.This is an opportunity to lead and contribute to research that will define the future of data security and AI, working on the most pressing...

  • Research Manager

    20 hours ago


    London, Greater London, United Kingdom MBN Solutions Full time

    Job OverviewMBN Solutions is seeking a visionary Research Manager to lead our Data & Security Research Group at the forefront of technological innovation, shaping the future of data trust and advanced AI security.This is an opportunity to lead and contribute to research that will define the future of data security and AI, working on the most pressing...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing AI safety for the public good. Our objective is to foster responsible actions in advanced technology by bringing together a talented group of technical experts.We are driven by ambitious goals and a...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    Position OverviewAbout the Department for Science, Innovation & TechnologyThe Department for Science, Innovation & Technology is dedicated to enhancing public safety in the realm of artificial intelligence. Our objective is to foster responsible development in advanced technologies by assembling a team of skilled professionals committed to this cause.We are...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job DescriptionFlawless AI is seeking a highly skilled Research Scientist Intern to join our Neural Rendering team. As a key member of our team, you will be responsible for conducting cutting-edge research in 3D-controlled dynamic face neural rendering, solving real-world problems in enabling audio-driven photorealistic talking head synthesis, and developing...

  • Research Manager

    4 days ago


    London, Greater London, United Kingdom MBN Solutions Full time

    Job OverviewMBN Solutions is seeking a visionary Research Manager to lead our Data & Security Research Group in shaping the future of data trust and advanced AI security.This is a unique opportunity to work on groundbreaking projects essential for a data-driven world, collaborating with a dynamic global research team to push the boundaries of research and...


  • London, Greater London, United Kingdom Department for Science, Innovation & Technology Full time

    About the RoleThe Department for Science, Innovation & Technology is seeking a highly skilled Cyber Security Researcher to join our team at the AI Safety Institute. As a Cyber Security Researcher, you will play a critical role in helping us understand and mitigate the risks associated with advanced AI systems.Key ResponsibilitiesDesign and develop...

  • Research Manager

    2 days ago


    London, Greater London, United Kingdom MBN Solutions Full time

    Job Title: Research Manager - Data Security AI LeaderJob Summary:We are seeking a visionary Research Manager to lead our Data Security and AI research efforts. As a key member of our global research team, you will be responsible for driving innovation and pushing the boundaries of research and development in data security and AI.Key Responsibilities:Lead and...

  • Research Manager

    2 days ago


    London, Greater London, United Kingdom MBN Solutions Full time

    Job Title: Research Manager - Data Security AI LeaderJob Summary:We are seeking a visionary Research Manager to lead our Data Security and AI research efforts. As a key member of our global research team, you will be responsible for driving innovation and pushing the boundaries of research and development in data security and AI.Key Responsibilities:Lead and...


  • London, Greater London, United Kingdom Stealth AI Startup Full time

    Transformative AI Research OpportunityWe are seeking a highly skilled Senior Research Engineer to join our team at Stealth AI Startup and contribute to the development of cutting-edge large language models. As a key member of our research team, you will be responsible for designing and implementing pre-training pipelines for state-of-the-art foundational...


  • London, Greater London, United Kingdom Stealth AI Startup Full time

    Transformative AI Research OpportunityWe are seeking a highly skilled Senior Research Engineer to join our team at Stealth AI Startup and contribute to the development of cutting-edge large language models. As a key member of our research team, you will be responsible for designing and implementing pre-training pipelines for state-of-the-art foundational...


  • London, Greater London, United Kingdom Flawless AI Full time

    Job DescriptionFlawless AI is seeking a highly skilled Research Scientist Intern to join our Neural Rendering team. As a key member of our team, you will be responsible for conducting cutting-edge research in 3D-controlled dynamic face neural rendering, solving real-world problems in enabling audio-driven photorealistic talking head synthesis, and developing...