Data Engineer, Azure, DataBricks

3 weeks ago


City, United Kingdom ARC IT Recruitment Full time

Data Engineer, Azure, DataBricks
London/hybrid
£Competitive + bonus and benefits


SQL, DataBricks, Azure Data Factory (ADF), Data Lakehouse

Data Engineer with extensive experience in Data Lakehousing practices, using SQL, DataBricks, and Azure Data Factory (ADF) is required to join a vibrant and growing insurance organisation with offices in the heart of the city. This is a pivotal role that will see you working collaboratively with stakeholders and wider data teams to develop key data platforms including a new Data Lakehouse.

This is a fantastic opportunity to join a forward-thinking, people-centric organisation with excellent scope for long term career development.

Key Responsibilities:

  • Develop and enhance the Group Data Lakehouse and other data platforms.
  • Collaborate with key business, data and tech teams to understand data requirements and deliver solutions.
  • Set and enforce data management standards, ensuring best practices across the organisation.
  • Conduct solution reviews and designs, providing assurance on development approaches.
  • Manage multiple project deliveries simultaneously with outstanding attention to detail.
  • Provide guidance and support to wider data teams as required

Key Skills and Experience:
  • Extensive experience in Data Lakehousing practices, particularly using SQL, DataBricks, and Azure Data Factory (ADF).
  • Strong data management background with hands-on experience.
  • Proven ability to manage multiple projects in a fast-paced, agile, and dynamic working environment.
  • Excellent attention to detail and ability to maintain high standards.
  • Strong problem-solving skills and ability to provide technical guidance and support.
  • Excellent communication skills, both written and verbal, with the ability to influence stakeholders.
  • Experience working within an MGA (Managing General Agent) or (re)insurance carrier is highly desirable.

For a full consultation, please send your CV to Arc IT Recruitment.



  • City Of London, United Kingdom Pioneer Search Full time

    Job Title: Senior Data Engineer - Azure, Databricks, Python, SynapseJob Summary:Pioneer Search is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and developing cloud data offerings using Azure, Databricks, and Synapse. You will work closely with our data engineers, solutions...

  • Azure Data Engineer

    4 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, SnowflakePioneer Search is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in building and maintaining our cloud-based data infrastructure, leveraging your expertise in SQL, Python, and Azure.Key Responsibilities:Design and...

  • Azure Data Engineer

    4 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, SnowflakePioneer Search is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in building and maintaining our cloud-based data infrastructure, leveraging your expertise in SQL, Python, and Azure.Key Responsibilities:Design and...

  • Azure Data Engineer

    4 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...

  • Azure Data Engineer

    4 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...

  • Azure Data Engineer

    4 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...


  • City of London, United Kingdom VIQU Limited Full time

    Azure Data Engineering Lead OpportunityWe are seeking an experienced Azure Data Engineering Lead to join our team at VIQU Limited. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure...


  • City of London, United Kingdom VIQU Limited Full time

    Azure Data Engineering Lead OpportunityWe are seeking an experienced Azure Data Engineering Lead to join our team at VIQU Limited. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure...


  • City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...


  • City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...

  • Azure Data Engineer

    4 weeks ago


    City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...

  • Azure Data Engineer

    3 weeks ago


    City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform...


  • City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - Cloud NativePioneer Search is seeking a highly skilled Data Engineer to join our team in a cloud native environment. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures using Azure platform services.Key Responsibilities:Design and implement ETL/ELT data pipelines...


  • City of London, Greater London, United Kingdom Pioneer Search Full time

    Data Engineer - Cloud NativePioneer Search is seeking a highly skilled Data Engineer to join our team in a cloud native environment. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures using Azure platform services.Key Responsibilities:Design and implement ETL/ELT data pipelines...

  • Azure Data Engineer

    4 weeks ago


    City of London, United Kingdom Pioneer Search Full time

    Data Engineer - Cloud Native ExpertPioneer Search is seeking a highly skilled Data Engineer to join our team. As a cloud native expert, you will be responsible for designing and implementing data solutions and applications that drive business growth and innovation.Key Responsibilities:Design and develop data pipelines and architectures that meet business...

  • Azure Data Engineer

    4 weeks ago


    City of London, United Kingdom Pioneer Search Full time

    Data Engineer - Cloud Native ExpertPioneer Search is seeking a highly skilled Data Engineer to join our team. As a cloud native expert, you will be responsible for designing and implementing data solutions and applications that drive business growth and innovation.Key Responsibilities:Design and develop data pipelines and architectures that meet business...

  • Data Support Engineer

    2 weeks ago


    City of London, United Kingdom Pioneer Search Full time

    Data Support Engineer: Data, Azure, Databricks, Python, Linux, Insurance Data Support Engineer required to join the Data Operations function for a leading Insurance organisation. Working on the Azure Cloud platform, you will support critical data applications such as Databricks &Phinsys and support the rollout of their brand new MDM tool. You will have...

  • Data Support Engineer

    2 weeks ago


    City Of London, United Kingdom Pioneer Search Full time

    Data Support Engineer: Data, Azure, Databricks, Python, Linux, InsuranceData Support Engineer required to join the Data Operations function for a leading Insurance organisation. Working on the Azure Cloud platform, you will support critical data applications such as Databricks &Phinsys and support the rollout of their brand new MDM tool. You will have...

  • Senior Data Engineer

    2 months ago


    City Of London, United Kingdom Pioneer Search Full time

    Senior Data Engineer - Azure, Databricks, Python, Synapse, Azure Data Factory, Eclipse Hands on Azure Data Engineer required for a leading Lloyd's / London Market insurance organisation. You will work in a specialist data platform team in order to implement brand new Azure capabilities. The division's data lake is in its nascency at bronze level so are...

  • Senior Data Engineer

    2 months ago


    City Of London, United Kingdom Pioneer Search Full time

    Senior Data Engineer - Azure, Databricks, Python, Synapse, Azure Data Factory, Eclipse Hands on Azure Data Engineer required for a leading Lloyd's / London Market insurance organisation. You will work in a specialist data platform team in order to implement brand new Azure capabilities. The division's data lake is in its nascency at bronze level so are...