Lead Data Engineer

4 weeks ago


London, United Kingdom Cornwallis Elt Ltd Full time

Lead Data Engineer – SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent – London

A fast-growing global Insurance broker situated in the City of London is searching for a Lead Data Engineer to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they’re looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.

The Lead Data Engineer will be tasked with creating a Lakehouse platform in Azure by owning, managing, and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business. Furthermore, you will be responsible for managing a small team of engineers to help grow their careers and enable them to succeed.

Skills Required
  • It is imperative to have worked as a Principal or Lead Data Engineer in a previous business and can manage your own deliverables.
  • Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
  • Experience of managing a team of Engineers with varying degrees of experience.
  • Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.
  • It would be highly beneficial to understand the London Insurance Market, with a particular preference given to Lloyds.
This is an excellent opportunity to join a well-respected fast-growing Insurance business as they look to double their size in the next three years.

Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports. #J-18808-Ljbffr
  • Lead Data Engineer

    2 months ago


    City of London, United Kingdom Data Idols Full time

    **Lead Data Engineer** Data Idols are proud to be working with an iconic UK brand to assist them in hiring a Lead Data Engineer as they undertake a digital and data-driven journey that will transform the business. Data is at the heart of the organisation and forms a key part oftheir future plans. **Skills and Experience**: - Awareness and understanding of...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom Abs Data Full time

    Lead Data Engineer Do you enjoy creating valuable insights with data? Do you want to play a key role in transforming our firm into an agile organization? Being agile will make us more responsive, more adaptable, and ultimately more innovative. We’re looking for a Data Engineer to: ~ transform data into valuable insights that inform business...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    1 month ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property Company Location: London (flexible working available) **Salary**: Competitive We are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...


  • London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    2 months ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER £70,000 - £75,000 + BENEFITS HYBRID - LONDON OR MAIDENHEAD** Are you a Senior Data Engineer looking for an exciting new role working within a team of likeminded individuals? Do you want to become an integral part of a team working within a betting company? If this is the role you have been searching for read on! **THE...

  • Lead Data Engineer

    2 months ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER** **LONDON BASED** **£70,000-80,000 PER ANNUM** This AI-Powered logistics company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and SQL. You will also be responsible for building a new Dataplatform in AWS. **THE...

  • Lead Data Engineer

    10 hours ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **LEAD DATA ENGINEER** **£100,000 - £110,000 + EQUITY** **LONDON - HYBRID** This role is with a rapidly growing FinTech Scale up who are looking to build out their data engineering team. They are looking to hire a Lead Data Engineer to work closely with the Engineering Manager and Architects to take their data platform & capabilityto the next...

  • Lead Data Engineer

    2 weeks ago


    City of London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Job Title: Lead Data Engineer Location: London **Salary**: Up to £100K + 10 % - 20 % **Job Description**: We are seeking a highly motivated and experienced Lead Data Engineer to join a data-centric insurance company. As the Lead Data Engineer, you will be responsible for managing the development, deployment, and maintenance of our data infrastructure....

  • Lead Data Engineer

    2 weeks ago


    London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER - SENIOR MANAGER** **UP TO £95,000 + BENEFITS** **LONDON, CURRENTLY FLEXIBLE / REMOTE / HOME WORKING** I am currently recruiting for a Data Engineer Lead with a very exciting airline company looking to build out its legacy system into Data Bricks. This is a role that will offer opportunities to work with operations, corporate, and the data...


  • London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **TECH LEAD/ LEAD DATA ENGINEER** **LONDON BASED** **£105,000-115,000 PER ANNUM** This UK-based Fintech are searching for a new Tech Lead/ Lead Data Engineer to help architect and build a new data platform in AWS. You will also be responsible for liaising with stakeholders and influencing future business decisions. **THE COMPANY** This growing UK-based...

  • Data Engineer

    1 month ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a leading technology and engineering consultancy who have been running for decades globally. They work with a variety of clients across different industries on their biggest challenges. Would you like to work alongsidethis company, where you get the chance to work across a wide range of tools, tech,...

  • Data Engineer

    2 months ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a growing veterinary business who are extremely data driven and have a great mission to use data to improve the welfare of animals. They have a revolutionary data team who want to be recognised as the UK's leadingveterinary group and are home to some of the best clinicians world-wide; would you like...

  • Data Engineering Lead

    2 weeks ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Lead Data Engineer

    2 months ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer.As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineering Lead

    1 month ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineering Lead

    2 weeks ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...

  • Data Engineering Lead

    2 weeks ago


    London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Databricks professional to join our client, a growing startup consultancy, as a Lead Data Engineer. As Lead Data Engineer, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales, strong technical acumen, consulting skills, and effective team...