Senior Data Engineer

3 weeks ago


London, Greater London, United Kingdom HEAD OFFICE Full time
What's the role about?

As the UK's most effective omni-channel retailer, E-Commerce is a key part of Our Business - we run two of the busiest websites in the UK, driving a significant proportion of our sales. Our Engineering practice includes 60+ teams, working on everything from Cloud Platforms to Mobile Apps, from E-Commerce functionality to Machine Learning.

Our Engineers work collaboratively and share knowledge, and learning is extremely important to us. We support our Engineers to continuously improve their skills and keep abreast of the latest technologies.

Find out more about being a Data Engineer in the Partnership, and the technology we use.

What you'll be doing?

This is an opportunity to join our John Lewis Partnership Data Platform (PDP) team working as a Senior Data Engineer.

You will be using your extensive Data Engineering skills and experience in designing, implementing and supporting secure cloud-based data platforms, ensuring high-quality delivery outcomes across our data landscape.

The vision for PDP is to embed data-driven decision-making and analytics at scale, across the Partnership. We recognise the importance of data and are backing a significant investment in developing the platform.

We are transforming our in-house Data Engineering capability, which has been at the heart of a move to a cloud-native data platform, to become Product delivery focused. Recent successes have been the PDP underpinning customer experience and loyalty outcomes such as my JL Rewards and the relaunch of my Waitrose.

As a Senior Data Engineer, you will participate in the shaping and delivery of data solutions to meet the needs of a wide variety of stakeholders from across the Partnership. You will be able to propose and build, run and own high quality data products.

You will have a passion for using technology to deliver innovative and innovative software and data solutions and will have a proven history of working in teams delivering complex, performant, high-quality software. We want you to work well in a fast-paced environment and have a focus on quality, ensuring the delivery aligns with the needs of the business, whilst also being supportable and maintainable and with clear ownership. You will be a mentor for exceptional data DevSecOps for our Partners and customers.

Internally this role is called Product Engineer (PL6)

What you'll already have:

Expert skills in building cloud-based data pipelines using data orchestration and workflow platforms. We use Airflow/Cloud Composer with Python but you may have experience with different orchestration/workflow tools or programming languages.

Experienced running/coaching teams - responsible for designing solutions and aiding the team implement these solutions.Advanced SQL skills, with a deep understanding of how to write performant SQL and debug problemsExperience with a cloud-based relational Data Warehousing productData transformation tools, preferably DBTCloud-Based data platforms, preferably Snowflake or Big QueryDesigning secure data pipelines and fixing security/performance issuesIdentification of data quality issuesDeploying to at least one major Cloud Platform such as AWS, GCP or AzureExperience in platform as a code, particularly TerraformContinuous Integration/Continuous DeliveryTDD, pair programming, preferably PythonAgile development methods such as Scrum or Kanban.What else you could bring:

Containerisation, KubernetesBuilt and/or championed observability platformsEvent-driven designGitlab CI, Jenkins, Circle CI, JiraData orchestration and workflow technologies such as AirflowVisualisation & reporting tools such as Tableau or LookerETL tools such as Apache Beam or AbInitioKnowledge or experience of DataVault (DV2)Data VisualisationUnderstanding of Data Management Concepts.Where will you be working?:

We have opportunities at both our John Lewis Head Office in London, Pimlico and Waitrose Head Office in Bracknell, Berkshire.

We have a blended hybrid approach of working from our offices and a home/remote UK location. You are contracted to a Partnership office location. If you choose to work remotely you should be aware that from time to time, you will need to come into the office. This decision is made within your team.

  • London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...


  • London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...


  • London, Greater London, United Kingdom Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that provide foundational data for our organization's products and services.Key ResponsibilitiesDesign and develop...


  • London, Greater London, United Kingdom Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that provide foundational data for our organization's products and services.Key ResponsibilitiesDesign and develop...

  • Data Engineer I

    1 day ago


    London, Greater London, United Kingdom Tampa Gardens Senior Living Full time

    Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Tampa Gardens Senior Living. As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining high-quality datasets and data pipelines to support business decision-making.Key Responsibilities:Lead the development of...

  • Data Engineer I

    23 hours ago


    London, Greater London, United Kingdom Tampa Gardens Senior Living Full time

    Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Tampa Gardens Senior Living. As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining high-quality datasets and data pipelines to support business decision-making.Key Responsibilities:Lead the development of...


  • London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...


  • London, Greater London, United Kingdom NTT DATA Full time

    About the RoleWe are seeking an experienced Senior Data Engineering Project Manager to join our team at NTT DATA. As a key member of our Data Engineering service line, you will be responsible for overseeing Data Engineering projects and programmes across our Data transformation portfolio.Key ResponsibilitiesLead highly-skilled technical teams in a...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time £120,000

    About the RoleWe are partnering with a leading InsurTech company to find a seasoned Data Engineering Leader to join their team. This is an exciting opportunity to grow the data platform and build a high-performing team.Key ResponsibilitiesDevelop and implement a strategy to grow the data team and introduce new technologies to ensure the platform is built...

  • Cloud Data Engineer

    4 days ago


    London, Greater London, United Kingdom SENIOR SPIRIT OF ROSELLE PARK Full time

    About Senior Spirit of Roselle ParkSenior Spirit of Roselle Park is a leading provider of data science solutions, with a team of over 350 data scientists and 1,000 projects since 2006. Our global presence in Paris, London, NY, and HK enables us to lead projects in over 50 countries across various industries, including automotive, financial services, retail,...

  • Cloud Data Engineer

    2 days ago


    London, Greater London, United Kingdom SENIOR SPIRIT OF ROSELLE PARK Full time

    About Senior Spirit of Roselle ParkSenior Spirit of Roselle Park is a leading provider of data science solutions, with a team of over 350 data scientists and 1,000 projects since 2006. Our global presence in Paris, London, NY, and HK enables us to lead projects in over 50 countries across various industries, including automotive, financial services, retail,...


  • London, Greater London, United Kingdom SENIOR SPIRIT OF ROSELLE PARK Full time

    About Senior Spirit of Roselle ParkSenior Spirit of Roselle Park is a leading provider of data science solutions, with a team of over 350 data scientists and 1,000 projects since 2006. Our global presence in Paris, London, NY, and HK enables us to lead projects in over 50 countries across various industries, including automotive, financial services, retail,...


  • London, Greater London, United Kingdom SENIOR SPIRIT OF ROSELLE PARK Full time

    About Senior Spirit of Roselle ParkSenior Spirit of Roselle Park is a leading provider of data science solutions, with a team of over 350 data scientists and 1,000 projects since 2006. Our global presence in Paris, London, NY, and HK enables us to lead projects in over 50 countries across various industries, including automotive, financial services, retail,...

  • Senior Data Engineer

    8 hours ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleThis fast-growing e-commerce company is seeking a seasoned Senior Data Engineer to join their expanding data team. As a key member of the team, you will be responsible for building and maintaining their Google Cloud Platform (GCP) infrastructure.Key ResponsibilitiesDesign and implement scalable data pipelines using Python.Collaborate with...

  • Senior Data Engineer

    6 hours ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    About the RoleThis fast-growing e-commerce company is seeking a seasoned Senior Data Engineer to join their expanding data team. As a key member of the team, you will be responsible for building and maintaining their Google Cloud Platform (GCP) infrastructure.Key ResponsibilitiesDesign and implement scalable data pipelines using Python.Collaborate with...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...


  • London, Greater London, United Kingdom ON Data Staffing Full time

    About the RoleWe are seeking a highly skilled Senior Data Solutions Architect to join our team at ON Data Staffing. As a key member of our data engineering team, you will play a pivotal role in delivering innovative big data solutions to our clients.Key ResponsibilitiesClient EngagementCollaborate directly with our clients to understand their business...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job SummaryHarnham - Data & Analytics Recruitment is partnering with a leading InsurTech company to find a highly skilled Head of Data Engineering to lead their data platform team.About the CompanyThe company is a fully digital InsurTech that aims to make insurance more accessible, affordable, and tailored to individual needs. With a strong focus on...