Data Engineering Lead

4 weeks ago

Edinburgh, Edinburgh, United Kingdom Royal London Mutual Insurance Society Full time
About the Role

We're seeking a highly skilled Principal Data Engineer to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.

  • Design and implement efficient ETL processes across the Data Lakehouse, ensuring seamless data movement with appropriate transformations. Define and publish data engineering and ETL standards for the data platform.
  • Analyse and communicate complex data engineering problems to senior audiences. Work with both structured and unstructured data to support downstream business outcomes. Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
  • Collaborate with Databricks, Lakehouse, ETL, and data pipelines to drive innovation and efficiency.
  • Experience with Azure Databricks, Azure Data Factory, and proficiency in SQL, Python, and PySpark.
  • Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
  • Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
  • A broad understanding of BI and analytics tools, such as PowerBI, and optimizing consumption against engineered data layers.
  • Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.
About Royal London

We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings, and asset management products and services. We're proud to reward employees with great workplace benefits, including 28 days annual leave, an up to 14% employer matching pension scheme, and private medical insurance.

Inclusion, diversity, and belonging

We're committed to creating an inclusive and diverse work environment where everyone feels valued and respected. We believe that a diverse workforce is essential to driving innovation and success.

  • Data Engineering Lead

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...

  • Data Engineering Lead

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...

  • Data Engineer Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineer Lead to join our team at Royal London Group. As a key member of our Core Engineering team, you will be responsible for designing and implementing Extract, Transform, and Load (ETL) processes across our Data Lakehouse to ensure efficient data movement with appropriate transformations.You will define...

  • Data Engineer Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineer Lead to join our team at Royal London Group. As a key member of our Core Engineering team, you will be responsible for designing and implementing Extract, Transform, and Load (ETL) processes across our Data Lakehouse to ensure efficient data movement with appropriate transformations.You will define...

  • Data Engineering Lead

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Royal London Group. As a key member of our Core Engineering team, you will be responsible for designing and implementing Extract, Transform, and Load (ETL) processes across our Data Lakehouse to ensure efficient data movement with appropriate transformations.You will...

  • Data Engineering Lead

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full time

    About the RoleWe're seeking a highly skilled Data Engineering Lead to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.Design...

  • Data Engineering Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Mutual Insurance Society Full time

    About the RoleWe're seeking a highly skilled Principal Data Engineer to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.Design...

  • Data Engineering Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Mutual Insurance Society Full time

    About the RoleWe're seeking a highly skilled Principal Data Engineer to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.Design...

  • Data Engineering Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    Job Title: Principal Data EngineerContract Type: PermanentHybrid 50% home/office basedRoyal London Group is seeking a Principal Data Engineer to lead the development of the Enterprise Data Platform (EDP), a modern Data Lakehouse implementation on Azure Databricks. The EDP is central to the Group's data strategy and consists of a core structured data...

  • Data Engineering Lead

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    Job Title: Principal Data EngineerContract Type: PermanentHybrid 50% home/office basedRoyal London Group is seeking a Principal Data Engineer to lead the development of the Enterprise Data Platform (EDP), a modern Data Lakehouse implementation on Azure Databricks. The EDP is central to the Group's data strategy and consists of a core structured data...

  • Data Engineering Lead

    2 months ago

    Edinburgh, Edinburgh, United Kingdom Haystack Full time

    About the RoleWe are seeking an experienced Senior Engineer to join our Data Engineering team. As a key member of our team, you will be responsible for designing and developing complex data pipelines and solutions in an agile environment.Key ResponsibilitiesLead the design of complex end-to-end data pipelines, solutions, and data models.Provide oversight,...

  • Data Engineering Lead

    2 months ago

    Edinburgh, Edinburgh, United Kingdom Haystack Full time

    About the RoleWe are seeking an experienced Senior Engineer to join our Data Engineering team. As a key member of our team, you will be responsible for designing and developing complex data pipelines and solutions in an agile environment.Key ResponsibilitiesLead the design of complex end-to-end data pipelines, solutions, and data models.Provide oversight,...

  • Data Engineering Team Lead

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a key member of our Data Engineering team, you will be responsible for leading a small team of Data Engineers in the development of world-class products and services.The CompanyCathcart Technology is a globally known software...

  • Data Engineering Team Lead

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000

    Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...

  • Data Engineering Team Lead

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    Data Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a Data Engineering Team Lead, you will be responsible for managing a small team of Data Engineers and overseeing the development of world-class products and services.The CompanyCathcart Technology is a globally known software...

  • Data Engineering Team Lead

    3 weeks ago

    Edinburgh, Edinburgh, United Kingdom Royal London Group Full time

    About the RoleWe are seeking a highly skilled Data Engineering Team Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...

  • Data Engineering Team Lead

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full time

    The company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...

  • Lead Data Scientist

    2 weeks ago

    Edinburgh, Edinburgh, United Kingdom Build A Rocket Boy Full time

    About Build A Rocket BoyWe are a leading game development studio, headquartered in Edinburgh, Scotland, with operations in Budapest, Hungary, the Netherlands, France, and California, USA. Our team includes hundreds of talented developers working together to create innovative entertainment experiences.Job Title: Data Engineering LeadWe are seeking an...

  • Senior Data Engineer

    2 days ago

    Edinburgh, Edinburgh, United Kingdom Bright Purple Full time

    Bright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...

  • Data Engineer

    4 weeks ago

    Edinburgh, Edinburgh, United Kingdom BJSS Full time

    About UsBJSS is a leading tech consultancy that has been delivering innovative solutions to top organisations for over 30 years. We pride ourselves on our collaborative culture and commitment to world-class delivery.We're a team of creative problem solvers who use software engineering best practices to build scalable and reusable data solutions. Our clients...