Lead Engineer/Data Engineer
3 months ago
Lead Data Engineer – Python, SQL, dbt, AWS, Dremio, Data Mesh, ETL, Data Pipelines, Data Warehousing, DWH, S3, Glue, Data Lake, Automation, London
A Lead Data Engineer is sought after by a leading workplace pensions provider, to run their expanding data engineering team in their London City office. The team have recently built out a next-gen data lake hosted in AWS which makes use of Dremio, Data Mesh architecture and a wide range of AWS tools (S3, Glue, Step Functions etc.).
With the infrastructure of this new Data Lake in place, there is now a focus on enhancing the data stored within (via monitoring, cleaning and, as well as a requirement to design, build and implement robust ETL pipelines for effective integration with the wider business.
As a Lead Engineer, you will also be responsible for overseeing a small team of Data Engineers, setting and driving best practises and standards, ensuring project delivery is kept on track and regularly engaging with stakeholders up to C-suite for feedback/updates.
This will also involve working directly alongside the Head of Data Platforms to ensure ongoing engineering work is aligned to overall architecture and roadmap, as well as future project planning.
7/8 years’ experience in Python programming, particularly around data analysis, automation and the building of data pipelines (as well as an understanding of data warehousing concepts)
~ Strong SQL skills, especially in relation to ETL processes and data management (querying, cleaning, storing)
~ Experience working with and deploying to AWS cloud (having worked with any/all of S3, Glue, Lambda, Step Functions etc.)
~ Usage of PowerBI for data visualization
~ Experience of both Dremio and Data Mesh Architecture
~ Prior experience of leading software engineering teams (including line management)
~
-
Lead Engineer/Data Engineer
2 weeks ago
London, United Kingdom Data Idols Full time €90,000 - €110,000Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Lead Engineer/Data Engineer
2 weeks ago
London, United Kingdom Data Idols Full time €90,000 - €110,000Lead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Lead Engineer/Data Engineer
2 weeks ago
London, United Kingdom Data Idols Full timeLead Data Engineer Location: London - Hybrid We are currently looking for a Lead Data Engineer to join our dynamic and forward-thinking team at a prominent British Insurance Company. This role is integral to our operations as it involves both maintenance of existing systems and the development of new projects. As a Lead Data Engineer, you will report...
-
Chief Data Engineering Lead
3 weeks ago
London, Greater London, United Kingdom Data Idols Full timeData Idols is looking for a Chief Data Engineering Lead to support the delivery of data transformation.As a key member of the team, you will collaborate with the wider data teams and drive high standards across the data function. The role involves building pipelines to deliver insights enabling the company to be more data driven in their decision making.Key...
-
Senior Data Engineer Lead
3 weeks ago
London, Greater London, United Kingdom Data Idols Full timeThe OpportunityWe are looking for a skilled Data Engineering Manager who has extensive experience in managing teams, implementing data strategy, and working with Azure. As a hands-off role, you will have the autonomy to lead the team and drive results.Your key responsibilities include:Implementing data strategy to drive business valueManaging and mentoring...
-
Plumbing and Heating Engineer
2 weeks ago
London, United Kingdom Field Engineer Services Full timeHeating Engineer - Plumbing & Boilers We have great opportunities for the right, fully qualified gas engineers within our domestic department. Field Engineer Services is a successful service & maintenance company that covers London & Surrounding Counties Current self employed engineers and plumbers working on a profit share model with us earn between 80k...
-
Plumbing and Heating Engineer
1 week ago
London, United Kingdom Field Engineer Services Full timeHeating Engineer - Plumbing & BoilersWe have great opportunities for the right, fully qualified gas engineers within our domestic department. Field Engineer Services is a successful service & maintenance company that covers London & Surrounding CountiesCurrent self employed engineers and plumbers working on a profit share model with us earn between 80k -...
-
Plumbing and Heating Engineer
2 weeks ago
London, United Kingdom Field Engineer Services Full timeHeating Engineer - Plumbing & BoilersWe have great opportunities for the right, fully qualified gas engineers within our domestic department. Field Engineer Services is a successful service & maintenance company that covers London & Surrounding CountiesCurrent self employed engineers and plumbers working on a profit share model with us earn between 80k -...
-
Senior Data Engineering Lead
4 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeWe are seeking a highly skilled Data Engineering Manager to support the delivery of data transformation during an exciting time at Data Science Festival.As a key member of the Data Engineering team, you will work closely with cross-functional teams to implement data strategy and deliver value across the organization.The ideal candidate will have extensive...
-
Energy & Chemicals Risk Engineer
3 days ago
London, United Kingdom The Chemical Engineer Full time €80,000 - €110,000London / Hybrid Our client is a major player in the insurance risk sector where it is involved in the provision of cover for major high hazard sites and assets, including refineries, petrochemical, LNG and oil & gas plants, marine facilities, shipping, and so on. The organisation’s London office is enjoying exceptional levels of growth supporting EMEA...
-
Data Engineer
2 months ago
London, United Kingdom Data Idols Full timeData Engineer Salary: £400 - £500 a day Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. ...
-
Data Engineer
2 months ago
London, United Kingdom Data Idols Full timeData Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...
-
Data Engineering Manager
1 month ago
London, Greater London, United Kingdom Data Science Festival Full timeData Engineering Manager OpportunityWe are seeking an experienced Data Engineering Manager to lead our team in implementing data strategy and delivering value throughout the company.The RoleThe successful candidate will have extensive experience in managing teams, stakeholder management, and implementing data strategy. They will work closely with the teams...
-
Data Engineering Manager
3 weeks ago
London, Greater London, United Kingdom Data Science Festival Full timeData Engineering Manager Role OverviewAt the forefront of our company's innovative landscape, we seek a seasoned Data Engineering Manager to spearhead data transformation initiatives. With an exciting tenure at one of the UK's most renowned retail brands, this pivotal role requires expertise in implementing data strategy and delivering value across the...
-
Data Engineer
2 months ago
London, United Kingdom Data Idols Full timeData Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...
-
Data Engineer
1 month ago
London, United Kingdom Data Idols Full timeData Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...
-
Data Engineer
2 months ago
London, United Kingdom Data Idols Full timeData Engineer Salary: £400 - £500 a dayLocation: London, HybridData Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports.The...
-
Senior Engineer, Data Engineering
2 months ago
London, United Kingdom Data Idols Full timeData Engineer Location: London, Hybrid Data Idols are working with a national software company that helps the public sector build better data solutions. They are looking for a Full-stack Data Engineer contractor to join them for an initial three months to assist in modernising data pipelines, data standards and data reports. As a Full-stack Engineer,...
-
Senior Engineer, Data Engineering
3 months ago
London, United Kingdom Data Idols Full time €75,000 - €95,000Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...
-
Senior Engineer, Data Engineering
3 months ago
London, United Kingdom Data Idols Full time €75,000 - €95,000Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...