AWS Lead Data Engineer

4 weeks ago

London, Greater London, United Kingdom Cornwallis Elt Full time
Job Title

A leading workplace pensions provider is seeking a highly skilled Lead Data Engineer to run their expanding data engineering team in their London office.

The team has recently built a next-gen data lake hosted in AWS, utilizing Dremio, Data Mesh architecture, and various AWS tools. The focus now shifts to enhancing the data stored within, including monitoring, cleaning, and designing robust ETL pipelines for effective integration with the wider business.

As a Lead Engineer, you will oversee a small team of Data Engineers, setting and driving best practices and standards, ensuring project delivery is on track, and regularly engaging with stakeholders up to C-suite for feedback and updates.

This role involves working closely with the Head of Data Platforms to ensure ongoing engineering work aligns with the overall architecture and roadmap, as well as future project planning.

  • 7-8 years of experience in Python programming, particularly in data analysis, automation, and building data pipelines, with a strong understanding of data warehousing concepts.
  • Strong SQL skills, especially in ETL processes and data management, including querying, cleaning, and storing.
  • Experience working with and deploying to AWS cloud, including S3, Glue, Lambda, and Step Functions.
  • Usage of PowerBI for data visualization.
  • Experience with Dremio and Data Mesh Architecture.
  • Prior experience leading software engineering teams, including line management.
  • Clear, confident communication with previous experience working directly with business users.

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Northrop Grumman Corp. (AU) Full time

    Job Title: AWS Lead Data EngineerNorthrop Grumman Corp. (AU) is seeking a highly skilled AWS Lead Data Engineer to join our team.Job Summary:We are looking for a talented Data Engineer with experience in designing, implementing, and maintaining scalable big data systems on AWS. The successful candidate will work closely with cross-functional teams to ensure...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Northrop Grumman Corp. (AU) Full time

    Job Title: AWS Lead Data EngineerNorthrop Grumman Corp. (AU) is seeking a highly skilled AWS Lead Data Engineer to join our team.Job Summary:We are looking for a talented Data Engineer with experience in designing, implementing, and maintaining scalable big data systems on AWS. The successful candidate will work closely with cross-functional teams to ensure...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom The Barton Partnership Full time

    Transformative Data Engineering OpportunityWe are seeking a highly skilled AWS Lead Data Engineer to join our team at The Barton Partnership. This is a unique opportunity to own the management and development of Data Engineering within our organisation, reporting to the Head of Data. You will be responsible for building out the Data Engineering function and...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom The Barton Partnership Full time

    Transformative Data Engineering OpportunityWe are seeking a highly skilled AWS Lead Data Engineer to join our team at The Barton Partnership. This is a unique opportunity to own the management and development of Data Engineering within our organisation, reporting to the Head of Data.This hire will play a critical role in delivering platform/cloud...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom The Barton Partnership Full time

    Transformative Data Engineering OpportunityWe are seeking a highly skilled AWS Lead Data Engineer to join our team at The Barton Partnership. This is a unique opportunity to own the management and development of Data Engineering within our organisation, reporting to the Head of Data.This hire will play a critical role in delivering platform/cloud...

  • AWS Lead Data Engineer

    1 month ago

    London, Greater London, United Kingdom easyJet Airline Company PLC Full time

    Job Title: AWS Lead Data EngineerAt easyJet, we're looking for a highly skilled AWS Lead Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, delivering, and implementing data solutions within our IT estate.Key Responsibilities:Design and deliver production-grade data solutions to support business...

  • AWS Lead Data Engineer

    1 month ago

    London, Greater London, United Kingdom easyJet Airline Company PLC Full time

    Job Title: AWS Lead Data EngineerAt easyJet, we're looking for a highly skilled AWS Lead Data Engineer to join our team. As a key member of our data engineering team, you'll be responsible for designing, delivering, and implementing data solutions within our IT estate.Key Responsibilities:Design and deliver production-grade data solutions to support business...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Cornwallis Elt Full time

    Job OpportunityWe are seeking a highly skilled Lead Data Engineer to join our team at Cornwallis Elt in London. As a key member of our data engineering team, you will be responsible for designing, building, and implementing robust data pipelines and ETL processes to support our business needs.The ideal candidate will have a strong background in Python...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Cornwallis Elt Full time

    Job OpportunityWe are seeking a highly skilled Lead Data Engineer to join our team at Cornwallis Elt in London. As a key member of our data engineering team, you will be responsible for designing, building, and implementing robust data pipelines and ETL processes to support our business needs.The ideal candidate will have a strong background in Python...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom easyJet Airline Company PLC Full time

    Job Title: AWS Lead Data EngineerAt easyJet Airline Company PLC, we're seeking an experienced AWS Lead Data Engineer to join our team. As a key member of our data engineering leadership team, you'll be responsible for designing, delivering, and implementing data solutions within our IT estate.Job Purpose:The AWS Lead Data Engineer will serve as the technical...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom ZipRecruiter Full time

    Senior Lead Data Engineer - Cloud ProfessionalJob Title: Senior Lead Data Engineer - Cloud ProfessionalLocation: LondonDuration: 6 months (potential to extend)Day Rate: £600 per day - INSIDE IR35Requirements:Excellent Python, SQL, and Jinja skillsExperience with cloud platforms, ideally AWSExperience with orchestration tools, ideally AirflowExperience in...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom ZipRecruiter Full time

    Senior Lead Data Engineer - Cloud ProfessionalJob Title: Senior Lead Data Engineer - Cloud ProfessionalLocation: LondonDuration: 6 months (potential to extend)Day Rate: £600 per day - INSIDE IR35Requirements:Excellent Python, SQL, and Jinja skillsExperience with cloud platforms, ideally AWSExperience with orchestration tools, ideally AirflowExperience in...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Endeavour Recruitment Solutions Full time

    Lead Data Engineer - AWSWe are seeking an experienced Lead Data Engineer to join our client in London.This is a hybrid contract role, with 2 days onsite and 3 days remote.The ideal candidate will have a strong background in Azure data services, including ADF, API, Databricks, and Python.Key responsibilities will include:Designing and implementing data...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom RED Global Full time

    RED Global is seeking a highly skilled AWS Lead Data Engineer to join our team in London. This contract opportunity requires a hybrid work arrangement, with a minimum of 2-3 days spent in the office per week.Key Responsibilities:Design and implement data integration solutions using ETL/ELT platformsDevelop and maintain PySpark applicationsMentor and manage...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Xpertise Recruitment Full time

    Xpertise Recruitment is seeking a highly skilled AWS Lead Data Engineer to join our team. As a key member of our data engineering function, you will be responsible for leading a team of engineers and working closely with analytics and business teams to ensure seamless data flow across the organisation.Key Responsibilities:Lead the Data Engineering Function:...

  • AWS Data Engineer Lead

    3 weeks ago

    London, Greater London, United Kingdom Two Circles Full time

    About Two Circles:We are a data-driven sports marketing agency, working with top sports organisations worldwide. Our team of over 600 professionals operates from eight global offices, delivering innovative data solutions for clients.About the Role:We are seeking a talented Lead Data Engineer (AWS) to join our growing team and contribute to designing,...

  • AWS Lead Data Engineer

    1 month ago

    London, Greater London, United Kingdom RED Global Full time

    RED Global is seeking a highly skilled AWS Lead Data Engineer to join our team in London. This is a contract opportunity that requires a hybrid work arrangement, with a minimum of 2-3 days spent in the office per week.Key Responsibilities:Design and implement data integration solutions using ETL/ELT platformsDevelop and maintain PySpark applicationsMentor...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Ogury Ltd Full time

    About the RoleWe are seeking a highly skilled AWS Lead Data Engineer to join our team at Ogury Ltd. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining our large-scale data platform.The ideal candidate will have a strong background in cloud data platforms, with experience in building and leading the...

  • AWS Lead Data Engineer

    4 weeks ago

    London, Greater London, United Kingdom Charlotte Tilbury Beauty Ltd Full time

    About the RoleWe are seeking a highly skilled AWS Lead Data Engineer to join our team at Charlotte Tilbury Beauty Ltd. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data pipelines, systems, and architectures that drive business growth and innovation.Key ResponsibilitiesLead the design and...

  • AWS Lead Data Engineer

    1 month ago

    London, Greater London, United Kingdom Curveanalytics Full time

    About the RoleCurveanalytics is a next-gen insights, analytics, and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Our team is passionate about developing industry-first data, AI, and analytics capabilities.Key ResponsibilitiesLead technical delivery of strategic...