Lead Engineer/Data Engineer

1 month ago


United Kingdom Cornwallis Elt Full time

Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k
Hybrid model – 3 days in the office per week.

There is NO sponsorship on offer for this role, so you must be eligible to work in the UK

My clients newly formed Data & Analytics team is playing a pivotal role in driving our data-driven transformation. They are a diverse group of passionate individuals with expertise across various data and analytics domains. Currently transitioning from a program-based structure to a steady-state operation, and we're excited to embrace Agile methodologies to optimize our efficiency and effectiveness.

We are seeking a highly motivated and skilled Lead Data Engineer to join our growing Data & Analytics team. In this role, you will play a pivotal role in supporting the ambition to fully realise the benefits of a Lakehouse platform deployed within Azure. You will own, manage, and implement the data engineering pipelines within Azure Databricks to ingest, enrich, and curate our; structured, semi-structured and unstructured data from our global business.

Experience working as a principal/lead Data Engineer.
Experience working with large datasets and proficiency in SQL, Python and PySpark.
Experience manging a team of engineers with varying levels of experience within data engineering.
Experience deploying pipelines within Azure Databricks in line with the medallion architecture framework.
Experience using SQL, Python and PySpark to build data engineering pipelines.
Understanding of how to define best practices in relation to documentation standards as well as code standards.
Understanding of data modelling approaches and standards
Understanding of semantic modelling techniques and how data is consumed from a Lakehouse to support them.
Experience building Azure DevOps Pipelines.
Excellent communication and problem-solving skills.
Experience working within an agile environment.

Desired skills and experience:
Experience in the London Insurance Market, particularly Lloyd's
Experience building and deploying machine learning pipelines into data engineering pipelines.
Experience building Azure DevOps Pipelines.
Experience of using metadata driven data engineering approaches for ingestion and transformations within data pipelines.


  • Lead Systems Engineer

    3 weeks ago


    United Kingdom The Engineer Full time €63,000

    MBDA is a leading defence organisation. Bonus of up to 21.25% (based on company performance and will vary year to year) Pension of maximum total (employer and employee) contribution of up to 14% Annual salary review 25 days annual leave (plus holiday purchase) Fantastic site facilities, including subsidised meals, free car parking and gym on site (gym...

  • Lead Systems Engineer

    2 weeks ago


    United Kingdom The Engineer Full time

    MBDA is a leading defence organisation. Bonus of up to 21.25% (based on company performance and will vary year to year) Pension of maximum total (employer and employee) contribution of up to 14% Annual salary review 25 days annual leave (plus holiday purchase) Fantastic site facilities, including subsidised meals, free car parking and gym on site (gym...


  • United Kingdom The Engineer Full time €2,500

    Embedded Design Team Lead - Electronic Engineering As the Embedded Design Team Lead, you will have the opportunity to guide our team of skilled engineers and contribute to the development of advanced defence technology. Job Title: Embedded Design Team Lead – Electronic Engineering Stevenage (We may be able to offer a relocation package for this role) ...

  • New Business Lead

    4 weeks ago


    United Kingdom The Engineer Full time €63,000

    MBDA is a leading defence organisation. We are proud of the role we play in supporting the armed forces who protect our nations. We partner with our governments to work together towards a common goal, defending our freedom. Salary: up to £63,000 dependent on experience Some of what to expect: Bonus of up to 21.25% (based on company performance and will...

  • New Business Lead

    3 weeks ago


    United Kingdom The Engineer Full time €63,000

    MBDA is a leading defence organisation. We are proud of the role we play in supporting the armed forces who protect our nations. We partner with our governments to work together towards a common goal, defending our freedom. Salary: up to £63,000 dependent on experience Some of what to expect: Bonus of up to 21.25% (based on company performance and will...


  • United Kingdom The Chemical Engineer Full time

    60 to £80,000k PA, 1-Year Fixed Term Materials and Technology Start-Up (Hydrogen Storage Test Rig) Our client is a leading advanced materials start up, developing hydrogen storage technologies based in both Australia and the UK. Dedicated to building a mission-driven team, our client is committed to accelerating decarbonisation using nanoporous...


  • United Kingdom The Chemical Engineer Full time

    60 to £80,000k PA, 1-Year Fixed Term Materials and Technology Start-Up (Hydrogen Storage Test Rig) Our client is a leading advanced materials start up, developing hydrogen storage technologies based in both Australia and the UK. Dedicated to building a mission-driven team, our client is committed to accelerating decarbonisation using nanoporous...


  • United Kingdom The Engineer Full time €2,500

    Embedded Design Team Lead - Electronic Engineering As the Embedded Design Team Lead, you will have the opportunity to guide our team of skilled engineers and contribute to the development of advanced defence technology. This role is ideal for an ambitious individual who excels in a fast-paced and dynamic environment.   Job Title: Embedded Design Team Lead...

  • Senior Engineering

    4 weeks ago


    United Kingdom The Engineer Full time €75,000

    Head of Future Engineering & International Co-ordination - FCAS Join us in crafting and delivering the Future Combat Air Programme (FCAS) for the RAF in record time! As the Senior Engineering representative leading a multifunctional team of experts, you will hold a significant position within the Programme. Reporting into the Chief Engineer and with...

  • Mechanical Engineer

    4 weeks ago


    United Kingdom The Engineer Full time

    Job Title: Mechanical Engineer Location: Rosyth, Hybrid Arrangements Compensation: Competitive + Benefits Role Type: Full time / Permanent Role ID: SF56568 At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as a Mechanical Engineer at Babcock LGE in Rosyth. Through expert engineering,...


  • United Kingdom The Engineer Full time €55,000

    MBDA is a leading defence organisation. Circa £55,000 depending on experience Company bonus of up to £2,500 (based on company performance and will vary year to year) ~ Pension of maximum total (employer and employee) contribution of up to 14% ~ Paid overtime ~25 days annual leave (plus holiday purchase) ~ Up to 15 additional days flexi leave ~ Our...


  • United Kingdom The Chemical Engineer Full time

    £60 to £80,000k PA, 1-Year Fixed Term Materials and Technology Start-Up (Hydrogen Storage Test Rig) Our client is a leading advanced materials start up, developing hydrogen storage technologies based in both Australia and the UK. Dedicated to building a mission-driven team, our client is committed to accelerating decarbonisation using nanoporous...


  • United Kingdom The Chemical Engineer Full time

    £60 to £80,000k PA, 1-Year Fixed Term Materials and Technology Start-Up (Hydrogen Storage Test Rig) Our client is a leading advanced materials start up, developing hydrogen storage technologies based in both Australia and the UK. Dedicated to building a mission-driven team, our client is committed to accelerating decarbonisation using nanoporous...


  • United Kingdom The Chemical Engineer Full time

    £60 to £80,000k PA, 1-Year Fixed Term Materials and Technology Start-Up (Hydrogen Storage Test Rig) Our client is a leading advanced materials start up, developing hydrogen storage technologies based in both Australia and the UK. Dedicated to building a mission-driven team, our client is committed to accelerating decarbonisation using nanoporous...


  • United Kingdom The Engineer Full time €42,245

    Job Title: Combat Systems Analysis Engineer Stoke Gifford, Bristol + Hybrid Working Arrangements Compensation: £42,245 + Benefits Role Type: Full time / Permanent As a Combat Systems Analysis Engineer, you'll have a role that's out of the ordinary. Babcock submarine support engineering mission systems within naval nuclear is focussed on support to...

  • Mechanical Engineer

    4 weeks ago


    United Kingdom The Engineer Full time

    Job Title: Mechanical Engineer Location: Rosyth, Hybrid Arrangements Compensation: Competitive + Benefits Role Type: Full time / Permanent Role ID: SF56568 At Babcock we're working to create a safe and secure world, together, and if you join us, you can play your part as a Mechanical Engineer at Babcock LGE in Rosyth. Through expert engineering,...


  • United Kingdom The Chemical Engineer Full time

    Our client is a world leading developer, engineer and fabricator of large-scale air emission control technology used on a variety of power, petrochemical, refinery and oil and gas plants around the globe. Project values can reach £15M. The business is currently looking for an experienced designer to lead the process engineering activities for studies,...


  • United Kingdom The Engineer Full time

    Compensation: Competitive plus Additional Benefits Role Type: Full time / Permanent You'll perform all Control, Instrumentation & Electrical (CI&E) tasks in support of winning and delivering large scale process-engineering themed projects for our key customers, ensuring that the business maintains its position as the world leader in the delivery of...


  • United Kingdom The Engineer Full time

    Compensation: Competitive plus Additional Benefits Role Type: Full time / Permanent You'll perform all Control, Instrumentation & Electrical (CI&E) tasks in support of winning and delivering large scale process-engineering themed projects for our key customers, ensuring that the business maintains its position as the world leader in the delivery of...


  • United Kingdom The Engineer Full time

    Compensation: Competitive plus Additional Benefits Role Type: Full time / Permanent You'll perform all Control, Instrumentation & Electrical (CI&E) tasks in support of winning and delivering large scale process-engineering themed projects for our key customers, ensuring that the business maintains its position as the world leader in the delivery of...