Data Engineer

2 months ago


London, UK, United Kingdom Vallum Associates Full time

Data Engineer - London - Hybrid - Up to £100,000


I am currently working with a Leading Lloyd's Syndicate who are looking for a Data Engineer to build and run the core components of an effective Azure Data, Integration and Analytics/AI Platform. This position is paying up to £100,000 and would be based in the office 2/3 days per week.


Duties and Responsibilities

  • Leading and actively participating in hands-on design, development, and code review sessions, providing technical guidance to junior team members.
  • Creating and maintaining documentation of data developments, best practices, and technical solutions.
  • Designing, developing, and supporting core data engineering services such as data orchestration, data pipelines, ETL/ELT processes, data lakes, data warehouses, semantic models, and code deployment.
  • Conducting impact assessments for changes to live systems and processes.
  • Ensuring minimal technical debt and identifying opportunities for continuous improvement.
  • Delivering high-quality work, including testing of data products, with a focus on automation where possible.
  • Collaborating closely with the IT team and broader organization to govern and protect data, ensuring that all new developments align with best practices, technological standards, and agreed-upon designs.
  • Keeping up-to-date with technological trends, state-of-the-art platforms, and industry advancements to provide input on the organization's strategic roadmap.
  • Promoting innovation by rapidly building proofs of concept to validate new ideas and concepts.


Skills and Experience

  • Strong Azure data engineering expertise, contributing to platform growth while building deep technical knowledge of systems over time.
  • Proven experience with Microsoft Data and Analytics components.
  • Extensive experience in designing and building data platforms, including data warehouses and lakes.
  • Comprehensive experience with the full data development lifecycle, including coding, testing, and managing code repositories using standard branching strategies and automated deployment methods.
  • Familiarity with deployment activities such as release management, environment controls, CICD orchestration, DevOps, and ML Ops pipelines.
  • Advanced skills in Structured Query Language (SQL) and a solid understanding of database administration.
  • A commitment to developing world-class, reliable data solutions for critical business processes.
  • The ability to quickly assimilate new and complex data sources, technologies, and concepts.
  • Experience in the insurance industry is an advantage.


If you would be interested in discussing this opportunity please apply now


  • Staff Data Engineer

    3 days ago


    London, UK, UK, United Kingdom Data Idols Full time

    Staff Data Engineer Joining one of the best-known retail brands in the UK as a Staff Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams.The Opportunity For this role...


  • London, UK, UK, United Kingdom Data Idols Full time

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams.The Opportunity For this...


  • London, UK, UK, United Kingdom Data Idols Full time

    Senior Data Platform Engineer Salary: £80,000 - 90,000 + Bonus and benefitsLocation: London - HybridWe are currently seeking a Senior Data Platform Engineer to join a prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you'll be pivotal to shaping the data landscape and will work alongside a talented,...

  • Data Scientist

    3 days ago


    London, UK, UK, United Kingdom Data Idols Full time

    Data ScientistSalary: £60k - £80k plus bonus and benefits Location: London - HybridData Idols are proud to partner with a renowned tech giant as they continue to push the boundaries of innovation. We are assisting them in expanding their data capabilities by hiring an experienced and driven Data Scientist. This is a fantastic opportunity to join a...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Gravitas Recruitment Group Ltd Full time

    Data Engineer Are you passionate about data engineering and eager to make a real impact in the insurance industry? Join our client's dynamic team as an Azure Data Engineer and help shape their data engineering roadmap to align with critical business priorities. This is your chance to thrive in a growing team, enhance your expertise, and be immersed in...


  • London, UK, UK, United Kingdom Data Idols Full time

    Machine Learning Engineer Salary: £65,000 - £80,0000Location: Central London - 1 day per week in the officeWe are currently recruiting a Machine Learning Engineer to join a global publishing company. Producing high-quality educational resources, they are publishing impactful research that has the power to improve society and empower policy makersThe...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Swoop Recruitment Full time

    An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department.Location: Chiswick (West London)Work Type: 3 days in office, 2 day from homeSalary: £60k - £70k dependent on experienceFull time permanent positionThe successful candidate will be responsible for creating the pipelines that...

  • Controls Engineer

    2 months ago


    London,, UK, United Kingdom Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading wholesale data center provider in North America with campuses in six strategic markets: Silicon Valley; Northern Virginia; Phoenix, Arizona; Quincy, Washington; Montreal and Quebec City, Canada. Founded in 2010, Vantage has an unceasing commitment to provide major hyperscale, cloud and enterprise...

  • Data Engineer

    11 hours ago


    London,, UK, United Kingdom Eden Smith Group Full time

    Data EngineerLondon/hybridSalary up to £75,000 per annumAn exciting opportunity has arisen to join a well known organisation within the media/entertainment space. This company are recognised for their exciting work, superb culture and work/life balance.They are looking for a new Data Engineer (or Senior Data Engineer) with strong experience with AWS, who...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Oakwell Hampton Full time

    We are looking for a talented Data Engineer with a strong Python development background to help build an innovative AI-driven accounting product. This role offers the flexibility of freelance work with the potential for a permanent position. Hybrid role with some time in London is preferred.Key Responsibilities:Build, optimize, and maintain scalable data...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom KDR Talent Solutions Full time

    GCP Data Engineer | £60,000 basic + package | Remote-first | LondonAbout the ClientThis is a chance to join a global business on the ground floor of a brand-new R&D function focused on the cutting edge of Synthetic Data Generation. Be one of the first on board and help shape the future of this exciting initiative!About the RoleWe're looking for a...

  • Data Engineer

    2 months ago


    London,, UK, United Kingdom Opus Recruitment Solutions Full time

    Data Engineer£40-55KI am currently looking for an entry level Data Engineer to hit the ground running with a leader in the UK's digital and software services landscape, where your work in cutting-edge technology will empower customers to manage, share, and exploit data more effectively.We’re seeking a Senior Data Engineer to lead the delivery of...

  • Data Engineer

    3 days ago


    London,, UK, United Kingdom Movement8 Full time

    Data Engineer - SQL | Snowflake | DBT | Power BIThis is a fantastic opportunity to join an industry leader in the Property Sector as they continue to evolve their Data Engineering division.This is a permanent position, paying up to £65k + bens and offered on a hybrid working basis – 3 days onsite in one of their London offices (Liverpool St, Hammersmith...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Penna Full time

    Job Title: Data EngineerSalary: £700 Umbrella (6 Months)We are looking for a forward thinking Data Engineer to build a robust Vault 2.0 architecture on Snowflake, to better serve and deliver valuable data products to our customers (internal and end-client).Key Responsibilities:1. Data Vault 2.0 Implementation:o Design and implement Data Vault 2.0...

  • Data Engineer

    2 weeks ago


    London, UK, United Kingdom Macquarie Group Full time

    Our Data Engineering team is at the cutting edge of data management and analytics. By joining us, you will become an integral part of a dynamic team dedicated to innovating and transforming how data is utilised across Macquarie. We focus on designing, implementing, and maintaining scalable data platforms that support our mission-critical analytics and...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Harnham Full time

    Data Engineer – Music StartupSalary: £70,000Location: Central LondonWFH: 3 days a week in office About Our ClientOur client is transforming the music industry with a platform that combines music streaming and direct-to-fan engagement, creating a transparent and innovative ecosystem.Role OverviewAs a Data Engineer, you’ll design and maintain data...

  • Data Engineer

    3 days ago


    London, UK, UK, United Kingdom Harnham Full time

    DATA ENGINEERLONDON BASED£55,000-65,000 PER ANNUMThis UK-based Music company are searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible for building new data pipelines in python.THE COMPANYThe company is one of the largest in the...

  • Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Harnham Full time

    Data EngineerLocation: London (Wimbeldon)WFH: 1 day a week in office Salary: £75,000About Our ClientOur client is an innovative company revolutionizing the home insurance industry by addressing complex customer needs with cutting-edge technology and outstanding support. They value flexibility through hybrid working and a collaborative, fast-paced...

  • Data Engineer

    2 weeks ago


    London, UK, United Kingdom TwentyAI Full time

    twentyAI is partnering with a leading global insurance company, recognised for its innovative risk solutions across sectors such as marine, professional liability, and trade credit. They are seeking a talented Data Engineer to join their dynamic technology team in London. The company operates across multiple international markets, leveraging cutting-edge...

  • Data Engineer

    3 days ago


    London, UK, UK, United Kingdom Harnham Full time

    Data EngineerLondon office RemoteTHE COMPANYOur client is a leading provider of Travel Insurance products, specializing in innovative solutions for the over-50 market and those with pre-existing medical conditions. With a strong emphasis on leveraging cutting-edge technology and fostering a customer-first approach, they are shaping the future of the...