Data Engineering Team Lead

2 weeks ago


London, Greater London, United Kingdom Cornwallis Elt Full time

We are seeking a highly experienced Data Engineering Team Lead to run our expanding data engineering team in our London office.

Cornwallis Elt is a leading workplace pensions provider, and we have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.).

As a Data Engineering Team Lead, you will be responsible for overseeing a small team of Data Engineers, setting and driving best practices and standards, ensuring project delivery is kept on track and regularly engaging with stakeholders up to C-suite for feedback/updates.

This role involves working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning. You will also be responsible for designing, building and implementing robust ETL pipelines for effective integration with the wider business.

The ideal candidate will have 7-8 years' experience in Python programming, particularly around data analysis, automation and the building of data pipelines (as well as an understanding of data warehousing concepts). Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing), are also required.

You should have experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions etc.) and usage of PowerBI for data visualization. Experience of both Dremio and Data Mesh Architecture is essential, as well as prior experience of leading software engineering teams (including line management) and clear, confident communications with previous experience of working directly with business users.

Based on market conditions, the estimated salary for this position is approximately £120,000 - £150,000 per annum, depending on your experience and qualifications.



  • London, Greater London, United Kingdom Data Science Festival Full time

    We are looking for a highly skilled Senior Data Engineer to join our team at the Data Science Festival. This role involves supporting the delivery of data transformation and collaborating with the wider data teams.Job DescriptionThe ideal candidate will have extensive experience with data pipelines, data warehousing, and driving high standards across the...


  • London, Greater London, United Kingdom Data Idols Full time

    Data Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...


  • London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...


  • London, Greater London, United Kingdom Data Science Festival Full time

    We are seeking a highly skilled Data Engineering Manager to support the delivery of data transformation during an exciting time at Data Science Festival.As a key member of the Data Engineering team, you will work closely with cross-functional teams to implement data strategy and deliver value across the organization.The ideal candidate will have extensive...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...


  • London, Greater London, United Kingdom Data Science Festival Full time

    Data Engineering Manager OpportunityWe are seeking an experienced Data Engineering Manager to lead our team in implementing data strategy and delivering value throughout the company.The RoleThe successful candidate will have extensive experience in managing teams, stakeholder management, and implementing data strategy. They will work closely with the teams...


  • London, Greater London, United Kingdom Data Science Festival Full time

    **Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...


  • London, Greater London, United Kingdom Future Engineering Full time

    Job Title: Associate DirectorCompany: Future EngineeringIndustry: Data Centre and Mission Critical engineeringThis is an exciting opportunity to lead and inspire teams on cutting-edge projects in London. As an Associate Director, you will oversee complex, large-scale Data Centre projects that are set to define the future of mission-critical facilities. With...


  • London, Greater London, United Kingdom Data Science Festival Full time

    About Our ClientOur client is a renowned software company dedicated to providing innovative data solutions to the public sector. With a strong focus on collaboration and customer satisfaction, they strive to make a positive impact on society.They are now seeking a talented Full-stack Data Engineer to join their team for an initial three-month contract. This...

  • Data Systems Engineer

    4 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About the Role:We are seeking a skilled Data Systems Engineer to join our team at Houseful.Key Responsibilities:Design and implement data warehousing solutions using AWS technologies.Collaborate with senior engineers to ensure data accuracy and implement validation checks.Develop and maintain ETL/ELT pipelines, ensuring alignment with business...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Data Privacy Full time

    About UsHouseful is a leading property technology company known for its innovative approach to the property market. With brands like Zoopla, Alto, Hometrack, Calcasa, Mojo, and Prime location, we leverage software, data, and insights to drive progress in the industry.Company OverviewWe're committed to helping everyone make informed decisions about their...

  • Data Engineer

    1 month ago


    London, Greater London, United Kingdom Data Idols Full time £400 - £500

    Role OverviewData Idols is seeking a skilled Data Engineer to assist in modernising data pipelines, data standards and data reports for a national software company.Key ResponsibilitiesImprove data structures, pipelines and reportingCollaborate with the CTO to review reports and implement necessary changes or improvementsWhat You'll GainUp to £500 a...


  • London, Greater London, United Kingdom Data Science Festival Full time

    At Data Science Festival, we're seeking a highly skilled Senior Data Platform Engineer to shape the data landscape and drive digital transformation. As a key member of our team, you'll play a pivotal role in designing, implementing, and maintaining scalable data infrastructure using cutting-edge cloud-based technologies.Key ResponsibilitiesDesign and...


  • London, Greater London, United Kingdom NTT DATA Full time

    NTT DATA seeks a seasoned professional to spearhead its data architecture efforts.Job OverviewA unique opportunity has arisen for an experienced Data Solutions Architect Lead to join our dynamic team in a remote-first environment. This role entails designing and delivering cloud-based data solutions utilizing best-in-class RDBMS, ETL/ELT, and Cloud platforms...


  • London, Greater London, United Kingdom Data Idols Full time £90,000 - £95,000

    The OpportunityData Idols is seeking a Data Engineering Manager to support the delivery of data transformation during an exciting time within the company. This individual will work with the teams to implement data strategy and deliver value throughout the company.The ideal candidate will have extensive experience in managing teams, stakeholder management,...


  • London, Greater London, United Kingdom NextWave Consulting Limited Full time

    NextWave Consulting LimitedA leading digital acceleration consultancy for financial services, NextWave Consulting Limited is seeking a skilled Data Engineering Team Lead to drive the success of our data engineering team.About Us:We are an award-winning consultancy with a focus on rapidly driving business outcomes and modernising Financial Institutions...


  • London, Greater London, United Kingdom Xcede Full time £80,000 - £90,000

    Xcede is seeking a talented Senior Engineer, Data Engineering to take on a leadership role within our team. As a Senior Data Engineer - Cloud Expertise, you will be responsible for delivering complex Data Engineering projects at scale using Python, SQL, and Azure, while leading and mentoring junior team members.Key Responsibilities:Lead and mentor junior...


  • London, Greater London, United Kingdom Experis UK Full time

    Job Title: Head of Data EngineeringDescription:Experis UK is seeking an experienced Head of Data Engineering to lead our data engineering team. As a key member of our IT Services team, you will be responsible for defining and executing a data infrastructure roadmap, championing modern data practices and tools, and architecting high-performance data...


  • London, Greater London, United Kingdom LNRS Data Services Ltd Company Full time

    About LNRS Data Services Ltd CompanyWe are currently seeking a highly experienced Software Engineering Manager to lead our software engineering team. This role will involve providing leadership, direction, and vision to engineers and offshore contractors.Key Responsibilities:Lead the development of technical standards and ensure they are followed by the...


  • London, Greater London, United Kingdom NextWave Consulting Limited Full time

    About the Role:We are seeking a highly skilled Technical Lead to join our Data Engineering team at NextWave Consulting Limited.The ideal candidate will have a strong background in data engineering, with experience in leading teams and developing production-level data processing systems.Key Responsibilities:Lead and mentor a team of data engineers, ensuring...