Data Engineering Lead
1 month ago
We're seeking a highly skilled Data Engineering Lead to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.
- Design and implement Extract, Transform, and Load (ETL) processes across the Data Lakehouse to ensure efficient data movement with appropriate transformations.
- Analyse and communicate complex data engineering problems to senior audiences, working with both structured and unstructured data to support downstream business outcomes.
- Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
- Work with Databricks, Lakehouse, ETL, and data pipelines.
- Experience with Azure Databricks, Azure Data Factory.
- Proficiency in SQL, Python, and PySpark.
- Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
- Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
- Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.
We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings, and asset management products and services. We're proud to reward employees with great workplace benefits, including 28 days annual leave, an up to 14% employer matching pension scheme, and private medical insurance.
Inclusion, Diversity and BelongingWe're an Inclusive employer, committed to creating a workplace where everyone feels valued and respected.
-
Data Engineering Lead
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeData Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...
-
Data Engineering Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...
-
Data Engineering Team Lead
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...
-
Data Engineering Team Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeData Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a Data Engineering Team Lead, you will be responsible for managing a small team of Data Engineers and overseeing the development of world-class products and services.The CompanyCathcart Technology is a globally known software...
-
Data Engineering Team Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Team Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...
-
Data Engineering Team Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Best Buy Health Full timeAbout the Role:We are seeking a highly experienced and skilled Senior Manager – Analytics Engineering to lead our data & analytics engineering team. As part of a broader data organization, you will work collaboratively with cross-functional teams to enable innovative data solutions that improve quality and efficiency of care delivery in hospital-level care...
-
Data Engineering Team Lead
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeThe company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...
-
Data Architect Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full timeJob Description**Build a Rocket Boy** is seeking a highly skilled Data Architect Lead to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing large-scale data systems that drive business insights and inform our game development processes.About the RoleWe are offering a competitive salary of...
-
Data Science Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeJob DescriptionSenior Data Engineer OpportunityBright Purple is working with a leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions. The role requires expertise in designing and developing internal platforms and data solutions. The ideal...
-
Senior Data Engineer
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeBright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...
-
Lead Data Scientist
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Build A Rocket Boy Full timeAbout Build A Rocket BoyWe are a leading game development studio, headquartered in Edinburgh, Scotland, with operations in Budapest, Hungary, the Netherlands, France, and California, USA. Our team includes hundreds of talented developers working together to create innovative entertainment experiences.Job Title: Data Engineering LeadWe are seeking an...
-
Data Insights Specialist
2 days ago
Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full timeAbout Smart Data FoundryAt Smart Data Foundry, our mission is to empower financial innovation by unlocking the full potential of data.We achieve this by providing research-ready real financial data, enabling the research ecosystem to flourish.Data-Driven InsightsOur team creates actionable insights based on real financial data, identifying areas for policy...
-
Edinburgh, Edinburgh, United Kingdom Change Digital – Digital & Tech Recruitment Full timeWe are seeking a highly skilled Data Engineering Manager to lead our team of up to 12 professionals.The successful candidate will be responsible for overseeing the design and development of scalable systems using cloud technology.A key aspect of this role will be managing high-level design and code reviews, ensuring that our data engineering solutions meet...
-
Senior Data Architecture Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleJob Title: Senior Data Architecture LeadLocation: UK-wideWorking style: Hybrid 50% home/office basedContract Type: PermanentAt Royal London Group, we're seeking a Senior Data Architecture Lead to spearhead the development of our Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeAbout the Role: We are seeking a highly skilled Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development and maintenance of our data infrastructure. The ideal candidate will have a strong background in data engineering, experience in...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Associates Group Ltd Full timeData Engineering ManagerCathcart Associates Group Ltd is seeking a highly skilled Data Engineering Manager to lead their team of Data Engineers. The ideal candidate will have a strong background in Data Engineering and experience in managing small and Agile teams.Key Responsibilities:Manage a team of 6-12 Data EngineersLead the development of the team and...
-
Data Engineering Director
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Be-IT is looking for a Data Engineering Director to lead its Data Engineering team. This is a great opportunity to drive impactful projects with a clear impact on customer experience and company revenue.As Data Engineering Director, you will lead a talented group of data engineers, leveraging a variety of technologies to support the company's advertising...
-
Data Analytics Lead Developer
3 weeks ago
Edinburgh, Edinburgh, United Kingdom BBC Full timeAbout the RoleThe BBC is seeking a skilled Data Analytics Lead Developer to join its Product Data Domain team. The successful candidate will be responsible for designing, implementing, and maintaining dimensional data models that promote a self-service approach to data consumption.Main ResponsibilitiesLeading on the design, implementation, and maintenance of...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeAbout the Role:Cathcart Technology is seeking a highly skilled Data Engineering Manager to join their team. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development of world-class products and services.The ideal candidate will have a strong background in Data Engineering, experience in managing...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Careers Full timeAbout Cathcart Technology CareersCathcart Technology Careers is a leading software business based in Edinburgh, Scotland. We are seeking a highly skilled Data Engineering Manager to join our team.The RoleWe are looking for a Data Engineering Manager to lead our small team of Data Engineers. The ideal candidate will have a strong background in Data...