Alignment Research Engineer

1 week ago


London, Greater London, United Kingdom Atla Ai Full time £10,000

About Atla

Atla is committed to engineering safe, beneficial AI systems that will have a massive positive impact on the future of humanity. We are a London-based start-up building the most capable AI evaluation models. Become part of our growing world-class team, backed by Y Combinator, Creandum, and the founders of Reddit, Cruise, Rappi, Instacart and more.

Role

As Atla's alignment research engineer, you'll develop language models as evaluators as well as use your insights to construct safety guardrails for LLMs, pushing the state of the art further. As part of your role, you will:

  • Steer LLMs to become strong evaluators aligned with human preferences by using prompting, supervised fine-tuning, and adversarial training to effectively scale human oversight.
  • Develop comprehensive evaluation and red teaming frameworks, including custom internal tooling, datasets and metrics for rigorous assessment of alignment and safety risks.
  • Collaborate in defining and steering Atla's evolving AI safety research direction to contribute significant findings to top-tier conferences in the field.
  • Work closely with founders, advisors, and top-tier researchers to navigate the complexities of AI alignment.
  • Build and grow our applied research organisation, setting a high bar of excellence that propels Atla forward.

Please note that this role is in-person (we can sponsor visas and offer international relocation support)

*This role is supported by AI Futures Grants , a UK Government scheme designed to help the next generation of AI leaders meet the costs of relocating to the UK. AI Futures Grants provide financial support to reimburse relocation costs such as visa fees, the immigration health surcharge and travel/subsistence expenses. Successful candidates for this role may be able to get up to £10,000 to meet relocations costs, subject to terms and conditions.

Qualifications

Evidence of exceptional ML engineering ability:

  • Proficiency in training and evaluating language models across GPUs, preferably in PyTorch.
  • Proven track record in empirical research, including designing and executing experiments, and effectively writing up and communicating findings.
  • Strong software engineering experience with software design / architecture skills, preferably in Python.
  • Aptitude for distilling and applying ideas from complex research papers in our products.
  • Experience at elite AI research labs (OpenAI, DeepMind, Meta, Anthropic, etc.).

Nice to have

  • Publications in top AI conferences.
  • Experience as an early engineer at a fast growing startup.
  • Interested in and thoughtful about the impacts of AI technology.

About you

You are going to thrive at Atla with the following mindset:

  • Collaborative and team-oriented, with strong communication skills.
  • Comfortable with the uncertainty and fast pace of a hyper-growth startup.
  • Willingness to continuously learn and adapt in a dynamic environment.
  • Unpretentious and hard working; find the best ideas wherever they come from.

Compensation

  • Competitive salary
  • Significant stake in equity as one of the first joiners

Join our driven founding team to make a dent in the universe by engineering safe, beneficial AI systems

#J-18808-Ljbffr

  • London, Greater London, United Kingdom G-Research Full time

    Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips?G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to nurture their talent in a dynamic, flexible and highly stimulating culture where...


  • London, Greater London, United Kingdom G-Research Full time

    Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips?G-Research is a leading quantitative research and technology firm, with offices in London and Dallas. We are proud to employ some of the best people in their field and to nurture their talent in a dynamic, flexible and highly stimulating culture where...

  • Research Engineers

    1 week ago


    London, Greater London, United Kingdom Atla Ai Full time £10,000

    Atla is committed to engineering safe, beneficial AI systems that will have a massive positive impact on the future of humanity. We are a London-based start-up building the most capable AI evaluation models. Become part of our growing world-class team, backed by Y Combinator, Creandum, and the founders of Reddit, Cruise, Rappi, Instacart and more. As Atla's...


  • London, Greater London, United Kingdom IFF Research Full time

    We have a number of opportunities across our teams for experienced Senior Research Managers.You MUST have current UK social market research experience.You must have experience that is relevant to our positions and be able to demonstrate skills that align with the social research sector and our clients.Who is IFF?We're an award-winning social and market...

  • Research Engineer

    1 week ago


    London, Greater London, United Kingdom Genei Full time $13,000 - $19,000

    Full Time] NLP Research Engineer at Genei (United States) | BEAMSTART Jobs NLP Research Engineer Full Time Remote Work We're a highly motivated and talented team of scientists and engineers building at the intersection of massive scale language modelling, reinforcement learning and AI alignment. io , delivers state of the art search and summarisation...

  • Research Engineers

    1 week ago


    London, Greater London, United Kingdom Anthropic Full time

    You want to build and run elegant and thorough machine learning experiments to help us understand and steer the behavior of powerful AI systems. You care about making AI helpful, honest, and harmless, and are interested in the ways that this could be challenging in the context of human-level capabilities. As a Research Engineer on Alignment Science, you'll...

  • Research Engineer

    1 week ago


    London, Greater London, United Kingdom in Canada Full time $280,000

    About AnthropicAnthropic's goal is to create reliable and controllable AI systems. Our mission is to ensure that AI is safe and beneficial for all users and society as a whole. We are a growing team of dedicated researchers, engineers, policy experts, and business leaders committed to developing beneficial AI systems.If you're excited about building and...

  • Director of Research

    1 month ago


    London, Greater London, United Kingdom Institute for Voluntary Action Research Full time

    We're looking for someone to lead and develop our research team of staff and freelance research associates and be part of our Senior Leadership Team. We work with charities, foundations and public agencies to strengthen UK communities through action research. We champion the role and contribution of the voluntary sector, listen and learn with charities to...


  • London, Greater London, United Kingdom Majorplayers Full time

    Principal Research Engineer Location: London Reports to: Head of R&D Line Reports: Senior Research Engineer Key Linkages: CTO, Principal Legal Solutions Engineer, Head of Product As the Principal Research Engineer for our esteemed client, you wil an ultimate legal AI platform. You will lead the R&D function's efforts in leveraging advanced data...


  • London, Greater London, United Kingdom Arrows Full time

    Job Description Principal Research Engineer As the Principal Research Engineer for our esteemed client, you will shape the ultimate legal AI platform. Your responsibilities will include leading the R&D function's efforts in leveraging advanced data science techniques, with a particular focus on Large Language Models (LLMs), to drive innovation and pioneer...

  • Hardware Engineer

    1 week ago


    London, Greater London, United Kingdom Tower Research Capital Full time

    Tower Research Capital, a high-frequency proprietary trading firm founded in 1998, seeks a Hardware Engineer to join one of our highly specialized, trading team-aligned engineering teams. This team works closely with one of Tower's major global trading teams to devise and support ultra-low latency market access solutions. With access to a wide and...

  • DevSecOps Engineer

    1 week ago


    London, Greater London, United Kingdom Qube Research & Technologies Full time

    Qube Research & Technologies (QRT) is a leading global quantitative and systematic investment management firm that operates across various liquid asset classes worldwide. The company thrives on a data-driven, technology-centric approach to investing, fostering a collaborative environment that tackles intricate challenges with innovation. At the heart of...


  • London, Greater London, United Kingdom Qube Research & Technologies Limited Full time

    Your core objective is to create high quality predictive signals. By leveraging access to large and diversified datasets you will identify statistical patterns and opportunities. Share and discuss research results, methodology, data sets and processes with other researchers. Implement the signals and the relevant datasets within the global execution...


  • London, Greater London, United Kingdom Vanda Research Full time

    Vanda Research is a prominent independent research organization specializing in providing highly tactical macro strategic analysis to institutional investors. We offer top-notch macro insights within a 0–3-month time horizon through a comprehensive approach that integrates cross-asset and cross-geography perspectives.Our distinctive combination of...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Vanda Research Full time

    Company Overview:Vanda Research is a leading independent research house specializing in delivering highly tactical macro strategy analysis to institutional investors. With a comprehensive approach integrating cross-asset and cross-geography perspectives, we provide first-class macro insights within a 0–3-month time horizon. Our unique blend of alternative...


  • London, Greater London, United Kingdom Hamilton Barnes Associates Limited Full time $100,000

    Ready to embark on an exciting career with a trailblazer in comprehensive IT solutions? We're seeking a dedicated and skilled professional to join our client's team as a Technical Alignment Manager. Delve into cutting-edge technologies, drive technical alignment, and be a pivotal force in elevating their clients' IT experiences. Responsibilities: Client...


  • London, Greater London, United Kingdom Eaglecliff Limited Full time

    Exciting opportunity for a Aligne SME to join this global Energy company. This is an exciting time to be joining this world-leading company as they transform themselves from a traditional Oil & Gas company into a leading name within the Renewables sector. This includes the creation of an already highly successful new Power Trading desk within the Energy...


  • London, Greater London, United Kingdom COL Limited Full time

    Please note that due to a high volume of very talented applicants, there may be a lag of several weeks between submission and follow-up from Apollo Research on your application. The challenges could stem from either deliberate misuse or the deployment of sophisticated, yet misaligned AI models. At Apollo Research, we are especially concerned with deceptive...


  • London, Greater London, United Kingdom The Engineer Full time £75,000

    Head of Future Engineering & International Co-ordination - FCAS Join us in crafting and delivering the Future Combat Air Programme (FCAS) for the RAF in record time As the Senior Engineering representative leading a multifunctional team of experts, you will hold a significant position within the Programme. Reporting into the Chief Engineer and with...


  • London, Greater London, United Kingdom Imperial College London Full time

    Job Summary­­­Are you a Research Engineer or Laboratory Technician looking to further your career? The Division of Mechanics and Materials is looking to appoint a Research Engineer to support our High Temperature Testing (HTT) and Thermal Mechanical (TM) laboratory facilities. Working in the subject areas of thermo-mechanical loading, fracture testing,...