Data Engineering Lead

1 month ago


Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time
About the Role

We're seeking a highly skilled Data Engineering Lead to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.

  • Design and implement Extract, Transform, and Load (ETL) processes across the Data Lakehouse to ensure efficient data movement with appropriate transformations.
  • Analyse and communicate complex data engineering problems to senior audiences, working with both structured and unstructured data to support downstream business outcomes.
  • Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
  • Work with Databricks, Lakehouse, ETL, and data pipelines.
  • Experience with Azure Databricks, Azure Data Factory.
  • Proficiency in SQL, Python, and PySpark.
  • Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
  • Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
  • Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.
About Royal London

We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings, and asset management products and services. We're proud to reward employees with great workplace benefits, including 28 days annual leave, an up to 14% employer matching pension scheme, and private medical insurance.

Inclusion, Diversity and Belonging

We're an Inclusive employer, committed to creating a workplace where everyone feels valued and respected.


  • Data Engineering Lead

    3 weeks ago


    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...

  • Data Engineering Lead

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...


  • Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000

    Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a Data Engineering Team Lead, you will be responsible for managing a small team of Data Engineers and overseeing the development of world-class products and services.The CompanyCathcart Technology is a globally known software...


  • Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Team Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...


  • Edinburgh, Edinburgh, United Kingdom Best Buy Health Full time

    About the Role:We are seeking a highly experienced and skilled Senior Manager – Analytics Engineering to lead our data & analytics engineering team. As part of a broader data organization, you will work collaboratively with cross-functional teams to enable innovative data solutions that improve quality and efficiency of care delivery in hospital-level care...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    The company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...

  • Data Architect Lead

    2 days ago


    Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full time

    Job Description**Build a Rocket Boy** is seeking a highly skilled Data Architect Lead to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing large-scale data systems that drive business insights and inform our game development processes.About the RoleWe are offering a competitive salary of...

  • Data Science Lead

    2 days ago


    Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Job DescriptionSenior Data Engineer OpportunityBright Purple is working with a leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions. The role requires expertise in designing and developing internal platforms and data solutions. The ideal...

  • Senior Data Engineer

    2 weeks ago


    Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Bright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...

  • Lead Data Scientist

    4 weeks ago


    Edinburgh, Edinburgh, United Kingdom Build A Rocket Boy Full time

    About Build A Rocket BoyWe are a leading game development studio, headquartered in Edinburgh, Scotland, with operations in Budapest, Hungary, the Netherlands, France, and California, USA. Our team includes hundreds of talented developers working together to create innovative entertainment experiences.Job Title: Data Engineering LeadWe are seeking an...


  • Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full time

    About Smart Data FoundryAt Smart Data Foundry, our mission is to empower financial innovation by unlocking the full potential of data.We achieve this by providing research-ready real financial data, enabling the research ecosystem to flourish.Data-Driven InsightsOur team creates actionable insights based on real financial data, identifying areas for policy...


  • Edinburgh, Edinburgh, United Kingdom Change Digital – Digital & Tech Recruitment Full time

    We are seeking a highly skilled Data Engineering Manager to lead our team of up to 12 professionals.The successful candidate will be responsible for overseeing the design and development of scalable systems using cloud technology.A key aspect of this role will be managing high-level design and code reviews, ensuring that our data engineering solutions meet...


  • Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleJob Title: Senior Data Architecture LeadLocation: UK-wideWorking style: Hybrid 50% home/office basedContract Type: PermanentAt Royal London Group, we're seeking a Senior Data Architecture Lead to spearhead the development of our Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    About the Role: We are seeking a highly skilled Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development and maintenance of our data infrastructure. The ideal candidate will have a strong background in data engineering, experience in...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Associates Group Ltd Full time

    Data Engineering ManagerCathcart Associates Group Ltd is seeking a highly skilled Data Engineering Manager to lead their team of Data Engineers. The ideal candidate will have a strong background in Data Engineering and experience in managing small and Agile teams.Key Responsibilities:Manage a team of 6-12 Data EngineersLead the development of the team and...


  • Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000

    Be-IT is looking for a Data Engineering Director to lead its Data Engineering team. This is a great opportunity to drive impactful projects with a clear impact on customer experience and company revenue.As Data Engineering Director, you will lead a talented group of data engineers, leveraging a variety of technologies to support the company's advertising...


  • Edinburgh, Edinburgh, United Kingdom BBC Full time

    About the RoleThe BBC is seeking a skilled Data Analytics Lead Developer to join its Product Data Domain team. The successful candidate will be responsible for designing, implementing, and maintaining dimensional data models that promote a self-service approach to data consumption.Main ResponsibilitiesLeading on the design, implementation, and maintenance of...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    About the Role:Cathcart Technology is seeking a highly skilled Data Engineering Manager to join their team. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development of world-class products and services.The ideal candidate will have a strong background in Data Engineering, experience in managing...


  • Edinburgh, Edinburgh, United Kingdom Cathcart Technology Careers Full time

    About Cathcart Technology CareersCathcart Technology Careers is a leading software business based in Edinburgh, Scotland. We are seeking a highly skilled Data Engineering Manager to join our team.The RoleWe are looking for a Data Engineering Manager to lead our small team of Data Engineers. The ideal candidate will have a strong background in Data...