Data Engineering Team Lead
1 month ago
About the Role
We are seeking a highly skilled Data Engineering Team Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data science/ML platform.
This role presents a fantastic opportunity for an experienced data engineer – helping setup the core engineering team (who consist of data engineers, testers, and data modellers), defining reusable frameworks, patterns, and standards, guiding the data modellers in the definition and extension of the silver layer data model, and managing Agile Engineering boards/backlogs.
Key Responsibilities
- Design and implement Extract, Transform, and Load (ETL) processes across a Data Lakehouse to ensure efficient data movement with appropriate transformations. Define and publish data engineering and ETL standards for the data platform.
- Analyse and communicate complex data engineering problems to senior audiences. Work with both structured and unstructured data to support downstream business outcomes. Oversee data movement across platforms, including designing controls and technical checks for monitoring data pipelines.
- Work with Databricks, Lakehouse, ETL, and data pipelines.
- Provide technical leadership, responsible for mid and lower-level designs, patterns, and standards. Produce artifacts for architecture and design authorities to make informed decisions.
About You
- Extensive technical design and development experience in specialism for the platform. Expected to be a code contributor in specialism.
- Experience with Azure Databricks, Azure Data Factory.
- Proficiency in SQL, Python, and PySpark.
- Knowledge of Azure data lake, ADLS Gen 2 storage, and Azure services.
- Extensive experience with Data Warehousing, ETL concepts, and data structure designs, including data pipelines and data marts (Inmon & Kimball approaches).
- A broad understanding of BI and analytics tools, such as PowerBI, and optimizing consumption against engineered data layers.
- Broad knowledge within wider and adjacent data domains, for example, ML/AI, Master Data Management (MDM), data analysis, and data modeling.
About Royal London
We're the UK's largest mutual life, pensions, and investment company, offering protection, long-term savings and asset management products and services.
Our People Promise to our colleagues is that we will all work somewhere inclusive, responsible, enjoyable and fulfilling. This is underpinned by our Spirit of Royal London values; Empowered, Trustworthy, Collaborate, Achieve.
We've always been proud to reward employees by offering great workplace benefits such as 28 days annual leave in addition to bank holidays, an up to 14% employer matching pension scheme and private medical insurance. You can see all our benefits here - Our Benefits
Inclusion, diversity and belonging.
We're an Inclusive employer. We celebrate and value different backgrounds and cultures across Royal London. Our diverse people and perspectives give us a range of skills which are recognised and respected – whatever their background.
-
Data Engineering Team Lead
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Lead the Way in Data EngineeringBe-IT is seeking an experienced Data Engineering Manager to lead its Data Engineering team in driving impactful projects that optimize advertising and marketing strategies. As a key member of the company's leadership team, you will leverage your technical expertise to enable data-driven decision making and strengthen...
-
Data Engineering Team Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeData Engineering Team LeadCathcart Technology is seeking a highly skilled Data Engineering Team Lead to join our team in Edinburgh. As a Data Engineering Team Lead, you will be responsible for managing a small team of Data Engineers and overseeing the development of world-class products and services.The CompanyCathcart Technology is a globally known software...
-
Data Engineering Team Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Best Buy Health Full timeAbout the Role:We are seeking a highly experienced and skilled Senior Manager – Analytics Engineering to lead our data & analytics engineering team. As part of a broader data organization, you will work collaboratively with cross-functional teams to enable innovative data solutions that improve quality and efficiency of care delivery in hospital-level care...
-
Data Engineering Team Lead
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeThe company Cathcart Technology is seeking a Data Engineering Manager to lead their predominantly Agile team of Data Engineers. The team is responsible for developing world-class products and services in a globally innovative environment.About the RoleAs a Data Engineering Manager at Cathcart Technology, you will be responsible for managing a small team of 6...
-
Data Engineering Lead
3 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeData Engineering LeadCathcart Technology is seeking an experienced Data Engineering Lead to join their team in Edinburgh. As a Data Engineering Lead, you will be responsible for managing a team of Data Engineers and overseeing the development of world-class products and services.The company is a globally known software business with a strong focus on...
-
Data Engineering Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleWe are seeking a highly skilled Data Engineering Lead to lead our Core Engineering team responsible for the build out of the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks and is central to our data strategy and consists of a core structured data warehouse area plus an attached data...
-
Edinburgh, Edinburgh, United Kingdom Change Digital – Digital & Tech Recruitment Full timeWe are seeking a highly skilled Data Engineering Manager to lead our team of up to 12 professionals.The successful candidate will be responsible for overseeing the design and development of scalable systems using cloud technology.A key aspect of this role will be managing high-level design and code reviews, ensuring that our data engineering solutions meet...
-
Data Engineering Lead
1 month ago
Edinburgh, Edinburgh, United Kingdom newscientist - Jobboard Full timeAbout the RoleWe're seeking a highly skilled Data Engineering Lead to lead our Core Engineering team in building out the Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our data strategy and consisting of a core structured data warehouse area plus an attached data science/ML platform.Design...
-
Software Engineering Team Lead
1 month ago
Edinburgh, Edinburgh, United Kingdom Addepar Full timeJob Title: Software Engineering Team LeadAbout the Role:We are seeking an experienced and highly motivated Engineering Manager to lead the Reference Data Team in the UK, a critical component of the Addepar Platform team. The Addepar Platform is a comprehensive data fabric that provides a single source of truth for our product set, encompassing a centralized...
-
Senior Data Engineering Team Leader
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Careers Full timeAbout the RoleCathcart Technology Careers is seeking a Senior Data Engineering Team Leader to join our team in Edinburgh. As a key member of our data engineering department, you will be responsible for managing a predominantly Agile and small team of 6 to 12 data engineers of varying levels.About the CompanyCathcart Technology Careers is a globally known...
-
Data Architect Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Build a Rocket Boy Full timeJob Description**Build a Rocket Boy** is seeking a highly skilled Data Architect Lead to join our team. As a key member of our data engineering department, you will be responsible for designing and implementing large-scale data systems that drive business insights and inform our game development processes.About the RoleWe are offering a competitive salary of...
-
Data Science Lead
2 days ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeJob DescriptionSenior Data Engineer OpportunityBright Purple is working with a leading tech company in Edinburgh to hire a new Senior Data Engineer as a hands-on lead overseeing the design and development of internal platforms and data solutions. The role requires expertise in designing and developing internal platforms and data solutions. The ideal...
-
Lead Data Scientist
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Build A Rocket Boy Full timeAbout Build A Rocket BoyWe are a leading game development studio, headquartered in Edinburgh, Scotland, with operations in Budapest, Hungary, the Netherlands, France, and California, USA. Our team includes hundreds of talented developers working together to create innovative entertainment experiences.Job Title: Data Engineering LeadWe are seeking an...
-
Senior Data Engineer
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Bright Purple Full timeBright Purple is currently seeking a Senior Data Engineer to lead the design and development of internal platforms and data solutions for a leading tech company in Edinburgh.As a Senior Data Engineer, you will oversee the development of cloud-hosted data pipelines and work with a passion-driven team to implement innovative solutions.Key responsibilities...
-
Data Insights Specialist
2 days ago
Edinburgh, Edinburgh, United Kingdom Smart Data Foundry Full timeAbout Smart Data FoundryAt Smart Data Foundry, our mission is to empower financial innovation by unlocking the full potential of data.We achieve this by providing research-ready real financial data, enabling the research ecosystem to flourish.Data-Driven InsightsOur team creates actionable insights based on real financial data, identifying areas for policy...
-
Data Analytics Team Lead
6 days ago
Edinburgh, Edinburgh, United Kingdom Lloyds Banking Group Full timeWe are seeking a highly skilled Data Analytics Team Lead to join our Investments team at Lloyds Banking Group. This is an exciting opportunity to lead our data and analytics team, providing a single source of truth for the Investments team.As a key member of our Chief Investments Office, you will be responsible for ensuring end-to-end data delivery within...
-
Senior Data Architecture Lead
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Royal London Group Full timeAbout the RoleJob Title: Senior Data Architecture LeadLocation: UK-wideWorking style: Hybrid 50% home/office basedContract Type: PermanentAt Royal London Group, we're seeking a Senior Data Architecture Lead to spearhead the development of our Enterprise Data Platform (EDP). The EDP is a modern Data Lakehouse implementation on Azure Databricks, central to our...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Technology Full timeAbout the Role: We are seeking a highly skilled Data Engineering Manager to join our team at Cathcart Technology. As a Data Engineering Manager, you will be responsible for leading a small team of Data Engineers in the development and maintenance of our data infrastructure. The ideal candidate will have a strong background in data engineering, experience in...
-
Data Engineering Manager
4 weeks ago
Edinburgh, Edinburgh, United Kingdom Cathcart Associates Group Ltd Full timeData Engineering ManagerCathcart Associates Group Ltd is seeking a highly skilled Data Engineering Manager to lead their team of Data Engineers. The ideal candidate will have a strong background in Data Engineering and experience in managing small and Agile teams.Key Responsibilities:Manage a team of 6-12 Data EngineersLead the development of the team and...
-
Data Engineering Director
2 weeks ago
Edinburgh, Edinburgh, United Kingdom Be-IT Full time £80,000 - £90,000Be-IT is looking for a Data Engineering Director to lead its Data Engineering team. This is a great opportunity to drive impactful projects with a clear impact on customer experience and company revenue.As Data Engineering Director, you will lead a talented group of data engineers, leveraging a variety of technologies to support the company's advertising...