Lead Data Engineer
3 months ago
Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London
A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.).
With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business.
As a Lead Engineer, you will also be responsible for overseeing a small team of Data Engineers, setting and driving best practises and standards, ensuring project delivery is kept on track and regularly engaging with stakeholders up to C-suite for feedback/updates.
This will also involve working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning.
If you demonstrate the following skillset, please do apply
- 7/8 years’ experience in Python programming, particularly around data analysis, automation and the building of data pipelines (as well as an understanding of data warehousing concepts)
- Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing)
- Experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions etc.)
- Usage of PowerBI for data visualization
- Experience of both Dremio and Data Mesh Architecture
- Prior experience of leading software engineering teams (including line management)
- Clear, confident communications with previous experience of working directly with business users
-
Lead Engineer/Data Engineer
1 month ago
London, United Kingdom Data Idols Full time €90,000 - €110,000Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Lead Engineer/Data Engineer
1 month ago
London, United Kingdom Data Idols Full time €90,000 - €110,000Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Lead Engineer/Data Engineer
1 month ago
London, United Kingdom Data Idols Full timeLead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Data Engineering Team Lead
2 weeks ago
London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000Job DescriptionWe are currently looking for a Lead Data Engineer to join our team. As a key member of our data engineering function, you will be responsible for designing, building, and maintaining robust ETL processes and data infrastructure. You will also write custom code to enhance data extraction, transformation, and loading processes.
-
Senior Data Engineer Lead
1 month ago
London, Greater London, United Kingdom Data Idols Full timeThe OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...
-
Lead Data Engineer
19 hours ago
London, United Kingdom Harnham - Data & Analytics Recruitment Full time**LEAD DATA ENGINEER** **LONDON BASED** **£70,000-80,000 PER ANNUM** This AI-Powered logistics company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and SQL. You will also be responsible for building a new Dataplatform in AWS. **THE...
-
Data Engineering Manager Lead
2 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeData Engineering Manager£90,000 - £99,000 per annum is the estimated salary for this role.This position is based in London – hybrid and requires a team player who can support the delivery of data transformation.We are working with one of the best-known retail brands in the UK. As a Data Engineering Manager, you will collaborate with teams to implement...
-
Data Centre Infrastructure Lead
7 days ago
London Area, United Kingdom Colt Data Centre Services Full timeAre you a skilled Mechanical Services Expert looking for a new challenge? Look no further than Colt Data Centre Services!We're seeking an experienced professional to lead our team of engineers in designing, deploying, and commissioning critical power systems in data centres. As part of this role, you'll collaborate with internal and external stakeholders,...
-
Lead Data Engineer in Retail Excellence
7 days ago
London, Greater London, United Kingdom Data Idols Full timeAbout Data IdolsWe're a leading retail brand in the UK, and we're seeking an exceptional Staff Data Engineer to drive our data transformation journey. This is a unique opportunity for someone with experience in data pipelines to contribute to our success.The RoleIn this critical position, you will support the delivery of data transformation, collaborating...
-
Data Engineering Lead
2 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeIn this exciting role as a Staff Data Engineer at Data Science Festival, you will have the opportunity to design, develop, and deploy cutting-edge data solutions using Azure, Spark, and Python. Our team is dedicated to delivering high-quality data products that drive business value, and we're looking for someone to join us in this mission.Your Key...
-
Data Engineering Lead
2 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeAbout the RoleAs a Staff Data Engineer, you'll be responsible for building and maintaining complex data pipelines, collaborating with our wider data teams to deliver insights that drive business growth.The ideal candidate will have extensive experience with data pipelines, data warehousing, and cloud-based technologies such as Azure.
-
Data Engineer
7 days ago
London, Greater London, United Kingdom Data Idols Full timeAbout the RoleWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. This is an exciting opportunity for someone with extensive experience in building and maintaining data pipelines, as well as collaborating with wider data teams.
-
Cloud Data Engineering Lead
2 weeks ago
London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000About the RoleWe are currently seeking a Senior Data Platform Engineer to join our team at Data Idols, a renowned retailer in the digital-first era. This is an exciting opportunity to contribute to the design, implementation, and maintenance of a robust data platform essential to our ongoing digital transformation.Your Key Responsibilities:Design and...
-
Big Data Engineering Lead
1 month ago
London, Greater London, United Kingdom Data Science Festival Full time**Job Overview**Data Science Festival is seeking an experienced Big Data Engineering Lead to join their team in London – hybrid. This is a fantastic opportunity for a skilled professional to drive data transformation and deliver value throughout the company.This hands-off role requires someone with extensive experience in managing teams, stakeholder...
-
Cloud Data Architect Lead
8 hours ago
London, Greater London, United Kingdom Data Intellect Full timeLead Data Engineer & ArchitectWe are looking for a highly skilled Cloud Data Architect Lead to lead our Databricks practice and drive innovation in data-driven solutions. This role requires experience in designing and deploying large-scale data pipelines, ETL processes, and data lakes using Databricks.The successful candidate will have a solid understanding...
-
Data Engineering Manager
9 hours ago
London, Greater London, United Kingdom Data Intellect Full timeAbout the RoleWe are seeking an experienced Data Engineering Manager to lead our Databricks practice and drive innovation in data-driven solutions. This is a unique opportunity for someone who wants to shape the future of data engineering within a fast-growing, forward-thinking company.The ideal candidate has a deep understanding of cloud-based data...
-
Data Engineering Lead
1 week ago
London Area, United Kingdom Manning Global AG Full timeData Engineering Lead Job Summary:Manning Global AG is seeking an experienced Data Engineering Lead to join their team in the UK. The successful candidate will be responsible for leading the design and implementation of scalable data engineering solutions using Microsoft Azure.Key Responsibilities:Lead the design and implementation of scalable data...
-
Lead Data Engineer
3 months ago
London Area, United Kingdom Cornwallis Elt Full timeLead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake...
-
Lead Data Engineer
3 weeks ago
London Area, United Kingdom Mastek Full timeLead Data Engineer Permanent Opportunity Location: London, UK – 2 days travel to office Overview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The...
-
Lead Data Engineer
2 months ago
London Area, United Kingdom Mastek Full timeLead Data EngineerPermanent OpportunityLocation: London, UK – 2 days travel to officeOverview: We are seeking a highly skilled Lead Data Engineer to join our team for a critical project with NHS England. The project involves migrating Privacy Enhancement Technology (PET) from the existing Privitar system to IQVIA across multiple data platforms. The ideal...