Experimentation Lead

Job Details Posted 3 days ago - be among the first 25 applicants Job Band: E Contract Type: Fixed-term Department: Chief Operating Group / Product Group / Engineering & Data / Experimentation Location: London – Salford (Hybrid - 2 days in the office a week) Proposed Salary Range: £75,000 - £85,000 depending on relevant skills, knowledge and experience. Purpose of the Role To define and maintain how we design, conduct and analyse experiments across the BBC. This role is crucial in creating a culture of experimentation through consistent, evolving processes that inform decision making. You will work with product teams across the BBC to create elegant solutions and templates that streamline operations and improve the ease of applying experimentation methodologies. Key Responsibilities and Impact Develop an understanding of our product, operations, systems and processes by interacting with product managers, engineering and business teams. Work with the Product, Design, Engineering and experimentation teams to improve ways to identify, prioritise, design, implement and own the backlog of experiments. Establish experimentation standards that promote consistency and best practices across the business, and communicate these standards effectively to the broader data team. Work with the experimentation team to develop methods and tools that increase the rigor and efficiency of our experimentation platform and analyses that are constructed using causal inference techniques. Partner with design and product to identify key questions and opportunities, and construct pragmatic agendas to guide hypothesis-based learning strategies to build an experimentation roadmap and answer these questions. Work with the Data Platforms team to improve the processes, knowledge, and tools to support growing business demand for high-quality experimentation planning and execution. Advocate for experimentation depth, rigor, and consistency across the data and business teams, and coach data team members on the principles of effective experimentation and inference. Maintain a high level view of the experimentation activities across all products: identifying, reviewing and communicating the key problems the business is trying to solve through experimentation. Champion hypotheses definition and experimental design processes across the product development lifecycle. Collaborate with cross-functional teams to define experiment goals, set up tracking and measurement, and interpret results. Ensure high-quality experiments with appropriate statistical rigor and validity. Analyze and interpret experimental results, presenting findings to stakeholders. Communicate insights and recommendations to stakeholders, including senior leadership, in a clear and actionable manner. Stay up-to-date with experimentation best practices and share knowledge with the broader team. Drive a culture of experimentation where everyone is encouraged to test assumptions and learn from experiments. Skills and Experience 7+ years experience with statistical analysis and tools like Excel, R, or Python. 5+ years experience designing experiments, including A/B testing and randomized controlled trials, and an understanding of experimental design principles. Ability to formulate hypotheses and test them using statistical methods and testing tools. Excellent communication skills, both written and verbal. Strong problem‑solving skills and ability to develop innovative solutions to complex problems. Project management experience and ability to manage multiple experiments simultaneously. Business acumen: understanding of business objectives and ability to align experimentation goals with these objectives. Attention to detail: detail-oriented with a strong focus on accuracy when analysing data and designing experiments. Essential Criteria Advanced statistical & causal inference expertise. Deeply skilled in experimental design, power analysis, causal methods, and interpreting complex data with rigor. Strong hands‑on technical capability. Fluent in Python/R, SQL, experimentation platforms, analytics tooling, and able to build or optimize experimentation workflows. Experience scaling experimentation systems. Proven ability to design and improve frameworks, templates, and automated processes that enable high‑quality experimentation at scale. Ability to diagnose and resolve technical experimentation issues. Strong debugging mindset for data pipelines, tracking, measurement, instrumentation, and experiment validity threats. Data‑driven decision leadership. Able to translate complex analyses into clear insights, influence technical and non‑technical teams, and drive adoption of experimentation best practices. Desired But Not Required Experience with large‑scale digital media or streaming products, ideally in organisations with broad audience reach, large & complex data sets. Familiarity with experimentation platforms such as Optimizely, Growthbook, Redshift, or home‑grown experimentation frameworks. Knowledge of advanced causal inference techniques beyond standard A/B testing (e.g., difference‑in‑differences, synthetic controls, Bayesian experimentation). Experience mentoring or training teams on data literacy, experimentation culture, or statistical thinking. Before your Start Date Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Contracts of Employment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer. Disclaimer This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved. Recruitment Process Please note: If you were to be offered this role, the BBC will conduct employment screening checks which include Reference checks, Eligibility to work checks, and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory. Redeployment The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and will give priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk. #J-18808-Ljbffr