Experimentation Lead

1 week ago


London, United Kingdom Head Office Full time

**What’s the role about?**

Are you a champion of experimentation?

As our Experimentation Lead, you will be leading the “Centre of Excellence” function for our high-volume (1000+/year) experimentation programme during a time of exceptional growth. You will be responsible for all aspects of Experimentation within John Lewis including Programme Governance, Education, Automation, Measurement and Skills Development across dozens of agile product experimentation teams. Your primary focus will not be on individual experiments but on making the flywheel of experimentation spin faster in these teams, removing human cost and friction from testing and increasing the business value and quality of experimentation.

The remit of your team is to collect and report data on experimentation and data quality, as well as managing or providing automation, tooling, education, onboarding, pairing, peer-review and skills development across experimentation teams. You will get to build both an Analytical Function (Education, Programme Measurement, Analysis) as well as a Product Function (workflow, process automation and tooling for product teams) to support a network of ambassadors embedded within product teams.

In this role, you will grow your own team of data engineers, developers, data scientists, and educators alongside the ambassador network, to scale the volume and quality of decisions made through testing. As well as supporting education and skills, we’d like you to iterate and improve the culture of experimentation within The Partnership - building a vibrant and supportive internal experimentation community as well as establishing links with peers and experts outside the organisation.

This is an excellent opportunity for someone to be able to influence and design the scaling of our experimentation programme, helping grow your personal and professional skills as well as links with the experimentation community. Come and make your mark in the domain of experimentation by building a world-class centre-of-excellence team and taking an already successful programme to new heights.

**What will you be doing?**

You will develop the long-term strategy for Experimentation within John Lewis by building a centre-of-excellence and ambassador programme to provide the following functions: Automation, Tooling, Education, Onboarding, Pairing, Peer-Review and Skills Development for Experimentation Teams as well as growing our internal culture and connections with the wider experimentation community.

Support a multidisciplinary network of teams running experiments, by having a shared objective to continually evolve the maturity of experimentation within John Lewis. Your role is to design and lead the expertise, education, documentation, organisational frameworks and data products that scale our experimentation capabilities in an efficient and automated way.

You’ll be responsible for all aspects of driving the implementation of the structure, process, people, resources, organisational design and metrics that will be required to govern our experimentation programme effectively.

To make the flywheel of experimentation spin faster for all the teams running tests. You’ll achieve this by decreasing human time, cost and friction in running experiments as well as governing the measurement and improvement in value of the results.

Your team will be delivering standardised tools, methods, approaches, documentation and experiment designs to automate repetitive tasks as well as facilitating the sharing of results, pairing, peer review and experiment scorecards. The centre-of-excellence is there to monitor, measure, support and guide the quality and reliability of experiments being executed by product teams.

Your team will also drive the development of the experimentation process and analytical frameworks. This will include collecting, documenting, teaching and sharing best practices as well as building the necessary data products and tooling to support the ambassadors and teams through automation.

Design and implement a governance framework to measure the quality and value of experimentation (scorecards, metrics, targets, peer review, business value) across teams, so you can provide measurement around the efficacy of the experimentation programme or know which teams you need to provide with additional support. The approach is that “we all want to help each other get much better at running experiments”.

You’ll build our internal community through the ambassador programme but also with internal events, drop-in sessions, knowledge repositories, communications, driving curiosity, interest and awareness across the wider business. We expect you also to drive awareness and understanding of the strategic role of experimentation in making reliable business decisions, so Leadership awareness and skills are important here too.

We want you to be active in external networks, communities and events to build links with the external experime



  • London, United Kingdom BBC Full time

    This job is with BBC, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.JOB DETAILSJOB BAND: E CONTRACT TYPE: Fixed-term DEPARTMENT: Chief Operating Group / Product Group / Engineering & Data / Experimentation LOCATION: London - Salford (Hybrid- 2 days...


  • London - London Broadcasting House, United Kingdom BBC Full time

    JOB DETAILS JOB BAND: ECONTRACT TYPE: Fixed-term DEPARTMENT: Chief Operating Group / Product Group / Engineering & Data / Experimentation LOCATION: London – Salford (Hybrid- 2 days in the office a week) PROPOSED SALARY RANGE: £75,000 - £85,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects...


  • Greater London, United Kingdom BBC Full time

    This job is with BBC, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. JOB DETAILS JOB BAND : E CONTRACT TYPE : Fixed-term DEPARTMENT : Chief Operating Group / Product Group / Engineering & Data / Experimentation LOCATION : London - Salford (Hybrid-...

  • Experimentation Lead

    2 weeks ago


    London, United Kingdom Just Eat Takeaway.com Full time

    **Ready for a Challenge?** **Optimisation Lead**: We’re looking for an optimisation lead who can deliver data-driven insights and find improvement opportunities. Want to take on a key role in our company, helping a talented team create the best product for our customers based on data? Then keep reading **All about the role** You are the driver for a...


  • London, United Kingdom Yolo Group Full time

    Our **UX & Design Team** is growing, and we are looking for a new talent to join us on our journey! Optimisation & Experimentation Lead will establish a culture of experimentation, drive data-informed decision-making, and collaborate cross-functionally to identify and test opportunities that improve both user experience and business outcomes. This is a...


  • London, United Kingdom NewsUK Full time

    **The Team**: Forming part of the wider Times Media customer team, and sitting within the Customer Operations team, we work to deliver front end optimisations and experiments which improve the customer journeys and experiences, to directly drive business value. **Role Objectives**: - Lead the customer optimisation function, driving a culture of continuous...


  • London, United Kingdom Harnham Full time

    **EXPERIMENTATION MANAGER** **£60,000 - £75,000** **LONDON** This is a unique chance to join a leading streaming service as an Experimentation Manager, to aid with understanding customer behaviour and maximise the effectiveness of campaigns! **THE COMPANY** This company is a world-renowned streaming service with millions of customers worldwide! They...


  • Greater London, United Kingdom Tesco UK Full time

    A leading retail company in Greater London is looking for a Senior Optimisation Manager to lead experimentation efforts that enhance user experience and media performance. This role requires collaboration with Product, UX, Engineering, and Analytics teams to identify opportunities and design tests. Candidates should have a proven track record in...

  • Lead Analyst

    5 days ago


    London, United Kingdom Flutter UK & Ireland Full time

    Reporting to the Head of Marketing BI, you will lead the execution of intelligence-led approaches to UKI marketing - ensuring insights meet the needs of the organisation’s business goals and align with each of the brands’ strategies across Sky Betting & Gaming, Paddy Power and Betfair. The Lead Analyst will join us on our mission to grow our...

  • Lead Analyst

    6 days ago


    London, United Kingdom Flutter UK & Ireland Full time

    Your TeamReporting to the Head of Marketing BI, you will lead the execution of intelligence-led approaches to UKI marketing - ensuring insights meet the needs of the organisation's business goals and align with each of the brands' strategies across Sky Betting & Gaming, Paddy Power and Betfair.The Lead Analyst will join us on our mission to grow our...