Senior Data Engineer

6 days ago

London, Greater London, United Kingdom Datahead Full time £60,000 - £100,000 per year
About the job

Only apply if you have Insurance background

We are looking for a Senior Data Engineer to spearhead the migration of underwriting data from various systems into a robust Azure Cloud Lakehouse. This is a hands-on role, leveraging Azure Synapse Analytics and PySpark, where you'll play a key part in delivering transformative data engineering solutions.

About the Role

As a Senior Data Engineer, you will:

  • Lead the migration of underwriting data from multiple systems into an Azure Cloud Lakehouse environment.
  • Utilise PySpark within Azure Synapse Analytics to develop scalable data pipelines and processing frameworks.
  • Design and implement robust data engineering solutions, creating a single version of truth for data analytics and reporting.
  • Develop self-service reporting capabilities using Power BI, enabling business users to access actionable insights.
  • Establish and uphold global standards for data engineering design and delivery within the Microsoft ecosystem.

Key Responsibilities

  • Build, optimise, and maintain data pipelines in Azure Synapse.
  • Collaborate with cross-functional teams to ensure seamless integration and transformation of underwriting data.
  • Lead the creation of intuitive Power BI reports and dashboards, selecting visualisations that support decision-making.
  • Drive the adoption of a data-driven culture across the organisation, enabling data accessibility for all users.

Required Skills & Experience

  • Extensive experience with the Microsoft tech stack, particularly Azure Synapse Analytics, Data Factory, and Databricks.
  • Strong programming skills in PySpark, SQL, and familiarity with DAX.
  • Proven track record of leading data migration projects, ideally within a lakehouse environment.
  • Experience with data visualisation and report development using Power BI.
  • Excellent communication, stakeholder management, and problem-solving skills.

Please apply

  • Senior Data Engineer

    2 days ago

    London, Greater London, United Kingdom Data Idols Full time £70,000 - £75,000 per year

    Senior Data EngineerSalary: £70,00 - £75,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Senior Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Senior Data Analyst

    6 days ago

    London, Greater London, United Kingdom Data Idols Full time £65,000 - £75,000 per year

    Senior Data AnalystSalary:£65,000 - £75,000Location:Fully RemoteWe are currently looking for an Senior Data Analyst to join a fast-growing,innovative,and data-driven tech team within a global cybersecurity education company. You'll play a pivotal role in shaping data strategy and delivering insights that drive smarter decisions across the business.As an...

  • Senior Data Architect

    1 week ago

    London, Greater London, United Kingdom LEIT DATA Full time £60,000 - £120,000 per year

    Work With UsWhether you are looking for your next career move in data or looking to become an associate working alongside a leading consultancy, then look no further. At LEIT DATA we are passionate about data and have created a culture which fosters innovation, personal development and career growth opportunities.We believe that every colleague plays an...

  • Senior Software Engineer

    59 minutes ago

    London, Greater London, United Kingdom Soda Data Full time €80,000 - €150,000 per year

    Soda - creators of the Soda Core - are looking for a Senior Software Engineer (Data and Backend) to help improve our Open Source and Cloud products. We're moving in an exciting new direction, and we need your help. If you're a software engineer who thrives on tackling large-scale challenges and wants to build the future of Fully Automated Data Quality, we'd...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Northern Data Full time £60,000 - £120,000 per year

    Job DescriptionThe Data Engineer is responsible for overseeing the collection, management, and analysis of organizational data to ensure accuracy, consistency, and security. This role bridges technical data management and business strategy — ensuring that data assets are properly maintained, integrated, and leveraged to drive insights and informed...

  • Senior Systems Engineer

    4 days ago

    London, Greater London, United Kingdom VAST Data Full time £80,000 - £120,000 per year

    *Description*VAST Data is looking to hire a Senior Systems EngineerThis is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence."VAST's data management vision is the future of the market."- ForbesVAST...

  • Data Engineer Contractor

    3 days ago

    London, Greater London, United Kingdom Data Intellect Full time £60,000 - £100,000 per year

    Company Description We are looking for a highly motivated Data Engineer to join our dynamic team working with a tier 1 multinational investment bank. This role is ideal for someone who thrives in fast-paced environments, enjoys working on both BAU and project-based initiatives, and has a strong background in Python ideally within the FX domain. Please note,...

  • Senior Data Engineer

    2 days ago

    London, Greater London, United Kingdom Spinwell Global Full time £70,000 - £120,000 per year

    Role: Senior Data Engineer Contract Length: 6 months extendableLocation: Hybrid/London – 3 days per week in officeIR35: InsidePay Rate to Intermediary: Market RateSecurity Clearance: SC requestedSpinwell is recruiting for a Senior Data Engineer for an excellent opportunity within the public sector.RESPONSIBILITIES OF THE SENIOR DATA ENGINEERThe client is...

  • Senior DevOps Engineer

    6 days ago

    London, Greater London, United Kingdom Data Idols Full time £75,000 - £85,000 per year

    Senior DevOps EngineerSalary: £75,000 - £85,000Location: Remote - offices in London if office work preferredWe are currently looking for a Senior DevOps Engineer to join our client's fast-paced, highly collaborative tech team. In this role, you'll work closely with cross-functional engineering squads and report directly to the Head of Engineering. As a...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Natobotics Full time £60,000 - £100,000 per year

    Role: Senior Data EngineerDuration:FulltimeLocation :London, UK (Hybrid)We are looking for an experienced Senior Data Engineer to join our team that's responsible for engineering solutions for distributing and making data available across the whole of the organisation. Your core interests should include data modelling and data warehouse work and you should...