Academic Research AI Evaluation Lead

Academic Research AI Evaluation Lead Do you thrive at the intersection of AI, research, and evaluation? Do you enjoy partnering with data scientists, researchers, and product teams to ensure generative AI solutions meet the highest standards of trust, quality, and reliability in advancing science and education? About our Team Elsevier’s Academic and Government (A&G) division empowers researchers, institutions, and governments to advance discovery and innovation. Our Generative AI Evaluation team leads the design and execution of rigorous evaluation strategies for Elsevier’s AI-driven research and academic products—ensuring that outputs are accurate, explainable, equitable, and aligned with the principles of Responsible AI. About the Role We are seeking an experienced Academic Research AI Evaluation Lead to lead evaluation strategy for Elsevier’s Academic and Government products.You will define frameworks for assessing the accuracy, transparency, and utility of generative AI in research workflows, guiding multidisciplinary teams across data science, product, and domain experts.This role combines strategic leadership with deep understanding of the research ecosystem—ensuring our AI systems support and accelerate trusted, evidence-based discovery. Responsibilities Set and drive strategy for evaluating generative AI across research, academic, and government products, establishing frameworks to assess reliability, transparency, and bias. Co-develop evaluation roadmaps with product and data science teams to ensure AI models enhance research efficiency and integrity. Lead governance and standardization for evaluation processes, aligning with our Elsevier Evaluation playbook, global Responsible AI, and research integrity principles. Design and oversee evaluations of product performance across research domains Enhance evaluation methodologies addressing factual accuracy, source grounding, bias mitigation, and reproducibility in scientific content generation. Foster cross-functional collaboration among research scientists, technologists, and academic partners to refine evaluation metrics and standards. Guide evolution of evaluation tooling and dashboards that surface insights into AI model performance and research impact. Mentor evaluation scientists and research specialists in applying rigorous evaluation methods to generative AI use cases. Represent Elsevier externally, contributing to industry standards and thought leadership in Responsible AI for research. Requirements Masters degree or equivalent advanced degree in a research discipline (e.g., information science, data science, computational linguistics, or a STEM field). Solid experience in academic research, scientific publishing, or research technology. Demonstrated expertise in evaluating AI or machine learning models in research or scholarly communication contexts. Good understanding of research data workflows, scholarly metadata, and citation or bibliometric systems. Proven experience developing frameworks for assessing content quality, bias, or reproducibility in AI systems. Experience leading multidisciplinary evaluation or research teams in a global environment. Excellent communication skills—able to bridge complex technical and academic concepts across diverse stakeholders. Track record of thought leadership in research integrity, Responsible AI, or open science. Experience with Scopus, ScienceDirect, or similar scholarly databases preferred. Familiarity with regulatory or ethical frameworks for AI in research (e.g., EU AI Act, UNESCO, OECD AI principles). Working with us We are an equal opportunity employer committed to helping you succeed. You’ll join a collaborative, inclusive, and innovative environment where your work contributes to the advancement of global research and education. Working for you We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: Dutch Share Purchase Plan Annual Profit Share Bonus Comprehensive Pension Plan Home, office or commuting allowance Generous vacation entitlement and option for sabbatical leave Maternity, Paternity, Adoption and Family Care leave Flexible working hours Personal Choice budget Variety of online training courses and career roadshows Wellbeing programs and gym facility in the office Internal communities and networks Various employee discounts About Elsevier Elsevier is a global leader in information and analytics, helping researchers and professionals advance science and improve outcomes for society. Building on our publishing heritage, we combine trusted information with powerful analytics and AI to empower discovery, accelerate innovation, and foster a more sustainable future. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here . Please read our Candidate Privacy Policy. We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights. #J-18808-Ljbffr