Data Pipeline Architect

3 weeks ago


London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time
Job Description

We are seeking a highly skilled Data Engineer to join our team in London. As part of our data migration project, you will be responsible for designing and managing ETL processes to support seamless data integration from new acquisitions.

About the Project

We are working with a high-growth insurance brokerage to migrate their data to a modern Azure platform. As a key member of the project team, you will play a critical role in building and optimizing ETL pipelines, enabling the migration of data.

Your Responsibilities

  • Design and manage ETL processes to support data integration from new acquisitions.
  • Work with a Medallion architecture, managing bronze, silver, and gold data layers for streamlined data access.
  • Develop pipelines to enable migration from on-prem to Azure, preparing for advanced ML/AI capabilities in the future.

Your Qualifications

  • 2+ years of experience in data engineering, ideally from a tech start-up or fast-growth environment.
  • Proficient in Python, SQL, and cloud technologies.
  • Knowledge of coding fundamentals and software best practices.
  • Background in transactional data, insurance, broking, or financial services is a plus.

Salary and Benefits

Up to £70k + benefits, including a comprehensive package of salary, bonuses, and perks.



  • London, Greater London, United Kingdom Northern Data Group Full time

    About the TeamNorthern Data Group is a leading provider of High-Performance Computing (HPC) solutions. Our team is dedicated to delivering innovative data-driven solutions to our clients.Main Responsibilities:Design, build, and maintain data pipelines and infrastructure to support data analysis and reporting.Collaborate with business stakeholders to...


  • London, Greater London, United Kingdom HCLTech Full time

    Job SummaryWe are seeking a highly skilled Data Pipeline Architect to join our team at HCLTech. This is a challenging opportunity to design and implement new data pipelines and optimize existing data flows using the Azure cloud stack.The successful candidate will have a strong background in cloud computing, particularly in Azure, and experience working with...


  • London, Greater London, United Kingdom Harnham Full time £90,000 - £100,000

    About UsHarnham is a leading recruitment agency specialising in technology and data jobs. We have an exciting opportunity for a Data Pipeline Architect to join our growing team.Your Role:You will be responsible for building new data pipelines using Python and SQL.You will work closely with our Data and Analytics team to develop and maintain our cloud...


  • London, Greater London, United Kingdom GHGSAT Full time

    We are excited to announce a new opportunity for a Data Pipeline Architect to join our team at GHGSat. As a pioneer in greenhouse gas emissions monitoring using satellite technology, we offer a unique chance to work with cutting-edge technologies and make a meaningful impact on the environment.About the PositionIn this role, you will design and implement...


  • London, Greater London, United Kingdom Velocity Tech Full time

    About UsVelocity Tech is a leading innovator in the wind energy industry, committed to driving impact through cutting-edge technology. We are seeking an experienced Data Pipeline Architect to join our team and contribute to our mission of transforming the global energy landscape.


  • London, Greater London, United Kingdom Data Idols Full time

    Your Future Role:As a Staff Data Engineer at Data Idols, you will be responsible for designing, developing, and maintaining data pipelines that deliver high-quality insights. You will work closely with the wider data teams to ensure seamless data flow and implement best practices to drive continuous improvement in data quality and delivery. This is an...


  • London, Greater London, United Kingdom ISR Recruitment Full time

    About the OpportunityISR Recruitment is seeking an experienced Data Pipeline Architect to join a major central government project. As a key member of our team, you will be responsible for designing and implementing robust data pipelines, analytics, and visualisation tools that integrate multiple infrastructure datasets across various sectors.This role...


  • London, Greater London, United Kingdom ISR Recruitment Full time

    Job Description:The Opportunity: We are seeking a seasoned Data Pipeline Solutions Architect to join our team at ISR Recruitment. As a key member of our consulting practice, you will provide technical leadership and guidance on designing and implementing robust data pipelines, analytics, and visualization tools that support the integration of multiple...


  • London, Greater London, United Kingdom Data Intellect Full time

    Lead Data Engineer & ArchitectWe are looking for a highly skilled Cloud Data Architect Lead to lead our Databricks practice and drive innovation in data-driven solutions. This role requires experience in designing and deploying large-scale data pipelines, ETL processes, and data lakes using Databricks.The successful candidate will have a solid understanding...

  • Cloud Data Architect

    3 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    **Cloud Data Architect Role at Data Idols**We are looking for a highly skilled Cloud Data Architect to join our team and drive the design and implementation of our cloud-based data architecture. As a key member of the team, you will be responsible for building pipelines to deliver insights that enable informed decision-making.In this role, you will...


  • London, Greater London, United Kingdom Jobs via eFinancialCareers Full time

    We are seeking a talented Data Pipeline Architect and Developer to join our dynamic team in London, where you will play a crucial role in shaping our Macquarie Asset Management Real Assets Data Strategy. Working closely with business stakeholders, you will leverage cutting-edge technology and cloud services to implement ambitious data initiatives.Key...


  • London, Greater London, United Kingdom Northern Data Group Full time

    Job Title: Cloud Data Solutions ArchitectAbout the Role:We are seeking an experienced Cloud Data Solutions Architect to join our team. As a Cloud Data Solutions Architect, you will be responsible for designing, building, and maintaining our cloud-based data infrastructure. This role is perfect for someone who wants to advance their career in cloud data...


  • London, Greater London, United Kingdom Data Idols Full time £85,000 - £95,000

    About the Role: Lead Data Pipeline DeveloperWe are seeking an experienced lead developer to join our data team as a Lead Data Pipeline Developer. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines that deliver business-critical insights. The ideal candidate will have experience in data warehousing, data...


  • London, Greater London, United Kingdom Kpler group Full time

    We are seeking an experienced Data Engineer to join our Market Data team. In this role, you will be responsible for designing and implementing robust data pipelines that ensure the smooth flow of information throughout our organisation.With at least 8 years of experience in software engineering and data engineering, you will utilise your expertise in Kafka...


  • London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Cloud Data Specialist Job DescriptionThis is an exciting opportunity for a Cloud Data Specialist to join our team in London. The successful candidate will design, develop, and deploy scalable ETL pipelines, migrate data platforms to cloud environments, and collaborate with the migration analyst to ensure data integration. If you're interested in this...


  • London, Greater London, United Kingdom Principle Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team at Principle. As a high-impact Data Engineer, you will design robust data pipelines and collaborate with cross-functional teams to drive critical insights.Salary and BenefitsThe salary for this role is estimated to be £75,000 - £84,000 per year, paid on a weekly basis. This position also...


  • London, Greater London, United Kingdom Xcede Full time

    OverviewWe are seeking an experienced Data Engineer to join our team at Xcede. As a Data Engineer, you will play a key role in optimising our data architecture and building reliable and scalable data pipelines for the application of advanced analytics and machine learning.About the Role:The successful candidate will be responsible for designing, building and...


  • London, Greater London, United Kingdom Northern Data Group Full time

    OverviewNorthern Data Group is a cutting-edge company that's changing the face of High-Performance Computing. With a strong focus on innovation and sustainability, we're shaping the future of data centers worldwide.Job SummaryWe're seeking a highly skilled Senior Data Engineer to join our team. As a key member of our Data Team, you will play a crucial role...


  • London, Greater London, United Kingdom StackAdapt Full time

    StackAdapt: A Hub of InnovationWe are seeking a highly skilled Senior/Staff Big Data Engineer to join our data science team at StackAdapt, a self-serve advertising platform that specializes in multi-channel solutions. Our company is dedicated to empowering hundreds of digitally-focused companies to deliver exceptional campaign performance.The ideal candidate...


  • London, Greater London, United Kingdom Airswift Full time

    Airswift is currently recruiting for a Data Engineer to join a leading organization on a 1-year contract. This Inside IR35 role requires 3 days onsite per week at their Central London office, with the remaining time remote.About the JobIn this position, you'll work closely with the team to design, develop, and maintain data pipelines using Azure Data Factory...