AI Research Scientist, Generative AI Evaluation Foundations
2 weeks ago
The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers, autoevals), covering a broad spectrum of metrics from helpfulness to safety and beyond. We are looking for a strong AI research scientist, with passion for Generative AI and in particular measurement/assessment of these cutting edge models. You’d join one of our projects and build methods to solve open challenges and unblock the execution and application of AI-assisted measurements to GenAI models, particularly Llama models. We are looking for a team player, who thrives in ambiguity, quickly adapting to new problems and AI metrics from helpfulness to safety; preferred candidates have experience in doing applied research/evaluations on large scale GenAI models.
Required Skills:
AI Research Scientist, Generative AI Evaluation Foundations Responsibilities:
Conduct research on the metrics and methodologies to assess/evaluate GenAI models (in particular Llama models)
Collaborate with cross-functional teams to ensure that our GenAI models are assessed leveraging state of the art solutions, and potentially co-develop them with partner teams
Stay up-to-date with the latest developments in the field of Generative AI and their evaluations/AI-assisted evaluation in particular
Communicate research findings and recommendations to stakeholders and scientific community
Minimum Qualifications:
Minimum Qualifications:
PhD in the field of Deep learning, Machine Learning, Computer Vision, NLP, Computer Science or a related field.
Bachelor's degree in Computer Science, Computer Engineering, or a related field
Experience with conducting research and publishing in top tier peer-reviewed journals and AI conferences
Excellent communication and collaboration skills
Ability to work independently and as part of a team
3+ years of experience after PhD
Track record of setting technical direction, driving consensus and successful cross-functional partnership
Preferred Qualifications:
Preferred Qualifications:
Background and/or previous work in Generative AI
Background and/or previous work in evaluations of GenAI models
#J-18808-Ljbffr-
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted...
-
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted...
-
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted...
-
London, United Kingdom Facebook Full timeThe Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers,...
-
London, United Kingdom Facebook Full timeThe Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers,...
-
London, Greater London, United Kingdom Facebook Full timeThe Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers,...
-
AI Research Scientist
2 weeks ago
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation...
-
AI Research Scientist
2 weeks ago
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation...
-
AI Research Scientist
2 weeks ago
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation...
-
AI Research Scientist
2 weeks ago
London, United Kingdom Meta Full timeMeta AI Research Scientist, Generative AI Evaluation Foundations London , United Kingdom Apply Now The Generative AI Evaluation aims to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI-assisted evaluation...
-
Applied AI Engineer
5 days ago
London, United Kingdom Engine AI Full timeJob Description We are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of...
-
Applied AI Engineer
2 weeks ago
London, United Kingdom Engine AI Full timeWe are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of AI applications,...
-
Applied AI Engineer
1 month ago
London, United Kingdom Engine AI Full timeWe are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of AI applications,...
-
Applied AI Engineer
1 month ago
London, United Kingdom Engine AI Full timeJob Description We are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of...
-
Applied AI Engineer
1 month ago
London, United Kingdom Engine AI Full timeWe are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of AI applications,...
-
Applied AI Engineer
2 weeks ago
London, United Kingdom Engine AI Full timeWe are expanding our capabilities in AI and are now looking to hire an Applied AI Engineer. If you have a passion for Generative models and are excited about implementing the latest advancements in AI, come and join us! You’ll be working with a team of experienced developers, data scientists, and product managers to shape the future of AI applications,...
-
AI Research Scientist
4 weeks ago
London, Greater London, United Kingdom Facebook Full timeMeta is seeking a Research Scientist to join Monetization Generative AI (MGenAI) in London. In the past year, generative AI has seen some of the most significant breakthroughs ever achieved, particularly in large language models and generative image models. Meta Monetization GenAI's mission is to lead the charge in generative AI technology and build products...
-
Ai Leader
2 days ago
London, United Kingdom Mesh-AI Full timeLondon **About Mesh-AI** We are the leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors. We have grown from 0-100 people in 2 years and...
-
Ai Leader
4 weeks ago
London, United Kingdom Mesh-AI Full timeLondon **About Mesh-AI** We are the leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors. We have grown from 0-100 people in 2 years and...
-
Ai Leader
3 days ago
London, United Kingdom Mesh-AI Full time**About Mesh-AI** We are the leading specialist Data and AI consultancy that works with major enterprise customers across the Financial Services and Energy Industries. Our projects range from strategy to implementation and deliver groundbreaking results from Data and AI faster than our competitors. We have grown from 0-100 people in 2 years and have huge...
