Lead Data Engineer

3 weeks ago


London Area, United Kingdom Cornwallis Elt Full time

Lead Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London


A fast-growing global Insurance broker situated in the City of London is searching for a Lead Data Engineer to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.


The Lead Data Engineer will be tasked with creating a Lakehouse platform in Azure by owning, managing, and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business. Furthermore, you will be responsible for managing a small team of engineers to help grow their careers and enable them to succeed.


Skills Required


  • It is imperative to have worked as a Principal or Lead Data Engineer in a previous business and can manage your own deliverables.
  • Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
  • Experience of managing a team of Engineers with varying degrees of experience.
  • Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.
  • It would be highly beneficial to understand the London Insurance Market, with a particular preference given to Lloyds.


This is an excellent opportunity to join a well-respected fast-growing Insurance business as they look to double their size in the next three years.



  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    2 months ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • Lead Data Engineer

    1 month ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER** **LONDON BASED** **£70,000-80,000 PER ANNUM** This AI-Powered logistics company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and SQL. You will also be responsible for building a new Dataplatform in AWS. **THE...

  • Lead Data Engineer

    14 minutes ago


    City of London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Lead Data Engineer Location: London **Salary**: Up to £100K + 10 % - 20 % **Job Description**: We are seeking a highly motivated and experienced Lead Data Engineer to join a data-centric insurance company. As the Lead Data Engineer, you will be responsible for managing the development, deployment, and maintenance of our data infrastructure....

  • Data Engineer

    4 weeks ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...

  • Data Engineer

    1 month ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a growing veterinary business who are extremely data driven and have a great mission to use data to improve the welfare of animals. They have a revolutionary data team who want to be recognised as the UK's leadingveterinary group and are home to some of the best clinicians world-wide; would you like...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    4 days ago


    London Area, United Kingdom Tiro Partners Limited Full time

    Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data EngineerLead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization.Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data...

  • Lead Data Engineer

    4 days ago


    London Area, United Kingdom Tiro Partners Limited Full time

    Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data EngineerLead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization.Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data...

  • Lead Data Engineer

    4 days ago


    London Area, United Kingdom Tiro Partners Limited Full time

    Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client is a world renowned leading Non-profit organization. Lead Data Engineer / Data Lead / Senior Data Engineer / Lead Data...


  • London Area, United Kingdom Xcede Full time

    Data Engineering LeadLondon x3-4 days per week in officeUp to £95,000 Salary + BonusOVERVIEWMulti-billion-pound property company are hiring for a Data Engineering Lead/ Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great...


  • London Area, United Kingdom Xcede Full time

    Data Engineering LeadLondon x3-4 days per week in officeUp to £95,000 Salary + BonusOVERVIEWMulti-billion-pound property company are hiring for a Data Engineering Lead/ Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great...

  • Lead Data Engineer

    2 hours ago


    London Area, United Kingdom Xcede Full time

    Lead Data EngineerLondon x3-4 days per week in officeUp to £95,000 Salary + BonusOVERVIEWMulti-billion-pound property company are hiring for a Data Engineering Lead/ Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope...


  • London Area, United Kingdom Xcede Full time

    Data Engineering Lead London x3-4 days per week in office Up to £95,000 Salary + Bonus OVERVIEW Multi-billion-pound property company are hiring for a Data Engineering Lead/ Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects!...

  • Lead Data Engineer

    4 days ago


    London Area, United Kingdom Xcede Full time

    Lead Data Engineer London x3-4 days per week in office Up to £95,000 Salary + Bonus OVERVIEW Multi-billion-pound property company are hiring for a Data Engineering Lead/ Lead Data Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    1 month ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...