Research Scientist, Large Scale Pre-Training Model

2 weeks ago

London, United Kingdom Google DeepMind Full time

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

Snapshot

At Google DeepMind, we've built a unique culture and work environment where long-term ambitious research can flourish. We are seeking a highly motivated Research Scientist to join our team and contribute to groundbreaking fundamental research and deployment in large scale pre-training.

About Us

Artificial Intelligence could be one of humanity’s most useful inventions. At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The Role

We’re looking for a Research Scientist with a strong empirical and theoretical understanding of deep learning (architecture, optimisation, data, LLMs), as well as strong engineering skills and understanding of distributed systems.

Key responsibilities:
  • Develop strong intuitions grounded in scaling laws and theoretical insights that can lead to research breakthroughs and new model capabilities.
  • Understand and measure effects of scaling on training dynamics and model performance via scaling laws and other analysis tools.
  • Conduct modelling research: Use empirical and theoretical insights to derive novel research ideas that improve Gemini models.
  • Dive deep into specific aspects of pre-training (modelling, optimisation, data) to understand and improve model dynamics.
  • Collaborate with the wider Gemini team, engaging closely with the Data, Infrastructure and the Post-Training teams.
About You

In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:

  • A PhD in machine learning or closely related field, or similar experience.
  • A proven track record of large scale deep learning with hands-on experience with Python and neural network training (publications, open-source projects, relevant work experience, …).
  • An in-depth knowledge of Transformer models and LLM training dynamics.
  • Ability to communicate technical ideas effectively, e.g. through discussions, whiteboard sessions, written documentation.

In addition, the following would be an advantage:

  • Experience with GPU/TPU kernel development (Triton, Pallas).
  • Experience with distributed systems and large scale deep learning performance optimisation.
  • Experience with running large scale data processing pipelines.
#J-18808-Ljbffr

  • Research Scientist, Large Scale Pre-Training Model

    3 weeks ago

    London, United Kingdom Google DeepMind Full time

    At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual...

  • Research Scientist, Large Scale Pre-Training Data

    3 weeks ago

    London, United Kingdom Google DeepMind Full time

    At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual...

  • Senior Researcher, Large Scale Pre-Training

    1 week ago

    London, Greater London, United Kingdom Lifelancer Full time

    About the RoleWe are seeking a highly motivated Research Scientist to join our team and contribute to groundbreaking fundamental research and deployment in large scale pre-training.As a key member of our Gemini team, you will be responsible for developing strong intuitions grounded in scaling laws and theoretical insights that can lead to research...

  • Large Scale Pre-Training Data Scientist

    2 weeks ago

    London, Greater London, United Kingdom Lifelancer Full time

    About the JobWe are looking for a Research Scientist with a strong empirical and theoretical understanding of deep learning with a focus on data, as well as strong engineering skills and understanding of distributed systems.Key ResponsibilitiesConduct careful empirical research to validate novel research ideas to improve performance of Gemini models.Develop...

  • Large Scale Pre-Training Specialist

    2 weeks ago

    London, Greater London, United Kingdom DeepMind Full time

    Job OverviewAs a Research Scientist at Google DeepMind, you'll contribute to groundbreaking fundamental research and deployment in large scale pre-training. Our team is seeking a highly motivated individual with a strong background in deep learning and data processing.ResponsibilitiesYou will be responsible for:Conducting empirical research to validate novel...

  • Data Scientist, Pre-Training Model Optimization

    2 weeks ago

    London, Greater London, United Kingdom Lifelancer Full time

    At Lifelancer, we're on a mission to revolutionize the way talent is connected with opportunities in pharma, biotech, health sciences, and IT domains.We're looking for a highly skilled Data Scientist to join our team and contribute to groundbreaking fundamental research and deployment in large scale pre-training models.About UsLifelancer is a cutting-edge...

  • AI Scientist

    2 weeks ago

    London, Greater London, United Kingdom DeepMind Full time

    Research OpportunitiesAs a Research Scientist at Google DeepMind, you'll work on cutting-edge AI projects with a focus on large scale pre-training. Our team is committed to advancing the state of the art in AI and developing new technologies for public benefit.Key ResponsibilitiesYou will be responsible for:Designing and conducting experiments to evaluate...

  • Research Scientist in Large Scale Pre-Training Models

    2 weeks ago

    London, Greater London, United Kingdom DeepMind Full time

    Company OverviewAt Google DeepMind, we've built a unique culture and work environment where long-term ambitious research can flourish. Our team of scientists, engineers, machine learning experts, and more work together to advance the state of the art in artificial intelligence.Our technologies are used for widespread public benefit and scientific discovery,...

  • Large Language Model Research Scientist

    9 hours ago

    London, Greater London, United Kingdom Amazon Full time

    Amazon's Alexa team seeks an experienced Applied Scientist to develop novel algorithms and modeling solutions for large language models.KEY RESPONSIBILITIESResearch and implement novel algorithms and modeling solutions for conversational systemsCollaborate with other scientists and engineers to enable conversational assistants capabilitiesDevelop machine...

  • Large Scale AI Research Engineer

    1 month ago

    London, Greater London, United Kingdom DALLAS VA RESEARCH CORPORATION Full time

    About the RoleWe are seeking a highly skilled Research Engineer to join our team at Dallas VA Research Corporation. As a Research Engineer, you will play a key role in designing and developing large-scale artificial intelligence (AI) systems from the ground up.Key ResponsibilitiesYou will work closely with our team to design, develop, and deploy large-scale...

  • Large Language Model Engineer

    2 weeks ago

    London, Greater London, United Kingdom numi Full time

    AI Engineer Position:numi is seeking a Large Language Model Engineer to join its team in London. As an AI Engineer, you will play a pivotal role in advancing large language models (LLMs) and developing foundational models.Main Responsibilities:Develop and refine next-generation LLMs through pre-training and fine-tuning foundation modelsLead experiments to...

  • AI Researcher: Scaling Deep Learning

    1 month ago

    London, Greater London, United Kingdom DeepMind Technologies Limited Full time

    At DeepMind Technologies Limited, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership...

  • Machine Learning Research Scientist

    2 weeks ago

    London, Greater London, United Kingdom Lifelancer Full time

    Are you passionate about advancing the state of artificial intelligence? Do you have a strong background in machine learning and a desire to work on large-scale pre-training projects?We are seeking a highly motivated Data-Driven AI Expert to join our team at Lifelancer, a leading talent-hiring platform for Life Sciences, Pharma, and IT. As a Research...

  • Senior Computational Research Scientist

    2 weeks ago

    London, Greater London, United Kingdom European Society of Human Genetics Full time

    Job SummaryWe are seeking an ambitious and motivated computational research scientist to join our new lab, working on integrating multi-scale neuro-genomic and imaging datasets. The role involves pre-processing and curation of large neurogenomic datasets, developing open-source tools for genomic data visualization, and training deep learning models.

  • Research Scientist

    2 weeks ago

    London, Greater London, United Kingdom Google DeepMind Full time

    Job DescriptionWe are seeking a highly motivated Research Scientist to join our team and contribute to groundbreaking fundamental research and deployment in large scale pre-training. This role requires a strong empirical and theoretical understanding of deep learning (architecture, optimisation, data, LLMs), as well as strong engineering skills and...

  • Data Scientist with Expertise in Deep Learning

    2 weeks ago

    London, Greater London, United Kingdom Google DeepMind Full time

    About the RoleAs a Research Scientist at Google DeepMind, you will contribute to groundbreaking fundamental research and deployment in large scale pre-training. You will work on careful empirical research to validate novel research ideas to improve performance of Gemini models.About UsWe're a team of scientists, engineers, machine learning experts and more,...

  • Molecular Research Scientist

    2 weeks ago

    London, Greater London, United Kingdom THE INSTITUTE OF CANCER RESEARCH Full time

    The Institute of Cancer Research is a world-leading centre for cancer research, with a strong focus on translating scientific discoveries into clinical benefits. As a Postdoctoral Training Fellow in our Target Biology and Genome Stability team, you will play a key role in advancing our understanding of the molecular mechanisms underlying cancer development...

  • AI Research Engineer

    2 weeks ago

    London, Greater London, United Kingdom Lifelancer Full time

    About the CompanyLifelancer is a leading talent-hiring platform in Life Sciences, Pharma and IT. We connect top talent with opportunities in pharma, biotech, health sciences, healthtech, and IT domains.Job DescriptionWe are seeking a highly motivated Research Scientist to join our team and contribute to groundbreaking fundamental research and deployment in...

  • Large Scale Economic Modeller

    8 hours ago

    London, Greater London, United Kingdom Skill Farm Corp. Full time

    Job Summary:Skill Farm Corp. is a leader in the field of economic research and modelling. We are currently seeking a Large Scale Economic Modeller to join our team in a highly competitive salary range of $100,000 - $135,000 per year. As a key member of our team, you will be responsible for developing bespoke models and forecasts for clients, as well as...

  • Cybersecurity Research Scientist

    2 weeks ago

    London, Greater London, United Kingdom AI Safety Institute Full time

    We are seeking a highly skilled and motivated Machine Learning Engineer to join our research team at the AI Safety Institute.About the JobThe successful candidate will be responsible for designing, shipping, and maintaining complex tech products with a focus on safety and security. This includes studying how frontier models, as well as specialised narrow AI...