Data Engineering Team Lead

1 month ago


Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

About the Role

We are seeking a highly skilled Data Engineering Team Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data science/ML platform.

This role presents a fantastic opportunity for an experienced data engineer – helping setup the core engineering team (who consist of data engineers, testers, and data modellers), defining reusable frameworks, patterns, and standards, guiding the data modellers in the definition and extension of the silver layer data model, and managing Agile Engineering boards/backlogs.

Key Responsibilities

  • Design and implement Extract, Transform, and Load (ETL) processes across a Data Lakehouse to ensure efficient data movement with appropriate transformations. Define and publish data engineering and ETL standards for the data platform.
  • Analyse and communicate complex data engineering problems to senior audiences. Work with both structured and unstructured data to support downstream business outcomes. Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
  • Work with Databricks, Lakehouse, ETL, and data pipelines.
  • Provide technical leadership, responsible for mid and lower-level designs, patterns, and standards. Produce artifacts for architecture and design authorities to make informed decisions.

About You

  • Extensive technical design and development experience in specialism for the platform. Expected to be a code contributor in specialism.
  • Experience with Azure Databricks, Azure Data Factory.
  • Proficiency in SQL, Python, and PySpark.
  • Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
  • Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
  • A broad understanding of BI and analytics tools, such as PowerBI, and optimizing consumption against engineered data layers.
  • Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.

About Royal London

We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings and asset management products and services.

Our People Promise to our colleagues is that we will all work somewhere inclusive, responsible, enjoyable and fulfilling. This is underpinned by our Spirit of Royal London values; Empowered, Trustworthy, Collaborate, Achieve.

We've always been proud to reward employees by offering great workplace benefits such as 28 days annual leave in addition to bank holidays, an up to 14% employer matching pension scheme and private medical insurance. You can see all our benefits here - Our Benefits

Inclusion, diversity and belonging.

We're an Inclusive employer. We celebrate and value different backgrounds and cultures across Royal London. Our diverse people and perspectives give us a range of skills which are recognised and respected – whatever their background.



  • Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000

    Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a Data Engineering Team Lead, you will be responsible for managing a small team of Data Engineers and overseeing the development of world-class products and services.The CompanyCathcart Technology is a globally known software...


  • Edinburgh, Edinburgh, United Kingdom Best Buy Health Full time

    About the Role:We are seeking a highly experienced and skilled Senior Manager – Analytics Engineering to lead our data & analytics engineering team. As part of a broader data organization, you will work collaboratively with cross-functional teams to enable innovative data solutions that improve quality and efficiency of care delivery in hospital-level care...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    The company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...

  • Data Engineering Lead

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...

  • Data Engineering Lead

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...


  • Edinburgh, Edinburgh, United Kingdom Change Digital – Digital & Tech Recruitment Full time

    We are seeking a highly skilled Data Engineering Manager to lead our team of up to 12 professionals.The successful candidate will be responsible for overseeing the design and development of scalable systems using cloud technology.A key aspect of this role will be managing high-level design and code reviews, ensuring that our data engineering solutions meet...

  • Data Engineering Lead

    1 month ago


    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About the RoleWe're seeking a highly skilled Data Engineering Lead to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.Design...


  • Edinburgh, Edinburgh, United Kingdom Addepar Full time

    Job Title: Software Engineering Team LeadAbout the Role:We are seeking an experienced and highly motivated Engineering Manager to lead the Reference Data Team in the UK, a critical component of the Addepar Platform team. The Addepar Platform is a comprehensive data fabric that provides a single source of truth for our product set, encompassing a centralized...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Careers Full time

    ​About the RoleCathcart Technology Careers is seeking a Senior Data Engineering Team Leader to join our team in Edinburgh. As a key member of our data engineering department, you will be responsible for managing a predominantly Agile and small team of 6 to 12 data engineers of varying levels.About the CompanyCathcart Technology Careers is a globally known...

  • Data Architect Lead

    2 days ago


    Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full time

    Job Description**Build a Rocket Boy** is seeking a highly skilled Data Architect Lead to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing large-scale data systems that drive business insights and inform our game development processes.About the RoleWe are offering a competitive salary of...

  • Data Science Lead

    2 days ago


    Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Job DescriptionSenior Data Engineer OpportunityBright Purple is working with a leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions. The role requires expertise in designing and developing internal platforms and data solutions. The ideal...

  • Lead Data Scientist

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Build A Rocket Boy Full time

    About Build A Rocket BoyWe are a leading game development studio, headquartered in Edinburgh, Scotland, with operations in Budapest, Hungary, the Netherlands, France, and California, USA. Our team includes hundreds of talented developers working together to create innovative entertainment experiences.Job Title: Data Engineering LeadWe are seeking an...

  • Senior Data Engineer

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Bright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...


  • Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About Smart Data FoundryAt Smart Data Foundry, our mission is to empower financial innovation by unlocking the full potential of data.We achieve this by providing research-ready real financial data, enabling the research ecosystem to flourish.Data-Driven InsightsOur team creates actionable insights based on real financial data, identifying areas for policy...


  • Edinburgh, Edinburgh, United Kingdom Lloyds Banking Group Full time

    We are seeking a highly skilled Data Analytics Team Lead to join our Investments team at Lloyds Banking Group. This is an exciting opportunity to lead our data and analytics team, providing a single source of truth for the Investments team.As a key member of our Chief Investments Office, you will be responsible for ensuring end-to-end data delivery within...


  • Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleJob Title: Senior Data Architecture LeadLocation: UK-wideWorking style: Hybrid 50% home/office basedContract Type: PermanentAt Royal London Group, we're seeking a Senior Data Architecture Lead to spearhead the development of our Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    About the Role: We are seeking a highly skilled Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development and maintenance of our data infrastructure. The ideal candidate will have a strong background in data engineering, experience in...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Associates Group Ltd Full time

    Data Engineering ManagerCathcart Associates Group Ltd is seeking a highly skilled Data Engineering Manager to lead their team of Data Engineers. The ideal candidate will have a strong background in Data Engineering and experience in managing small and Agile teams.Key Responsibilities:Manage a team of 6-12 Data EngineersLead the development of the team and...


  • Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000

    Be-IT is looking for a Data Engineering Director to lead its Data Engineering team. This is a great opportunity to drive impactful projects with a clear impact on customer experience and company revenue.As Data Engineering Director, you will lead a talented group of data engineers, leveraging a variety of technologies to support the company's advertising...