Data Pipeline Engineer

17 hours ago

London, Greater London, United Kingdom Hexegic Full time £25,000 - £50,000 per year


Data Pipeline Engineer

What will you be doing?

The Data team is the backbone of the businesses data driven operations. Architects of the data
infrastructure to implement and measure the impact of strategy projects and inform how the next
generation of the data platform is developed.

You will provide remote technical expertise to client data pipelines into a premium data analytics
tool. You are the first to respond to data health failures on key pipelines.

You are technical, with passion for systems and technical teams. You're comfortable with reading
and writing code to identify fixes, making changes and develop systems.
Your insights into the product and process will form an essential part of development with the
product engineering team.

Key Responsibilities:

  • Build and maintain schedules so that pipelines run effectively
  • Setting up and maintaining health checks on different pipelines
  • Identify, respond, triage, and debug the pipeline when it is broken
  • Reading code and writing code changes and/or modifying the monitoring set-up where
    necessary
  • Communicate insights in a way that resonates with partners, wider team, and
    leadership – turn theory into action.
  • Communicating outages with the end users of a pipeline
  • Contributing to improvements wider systems and monitoring tooling
  • On call pager model to cover weekends – with time off if weekend covered

The ideal candidate will

  • Be comfortable with code for ETL in Python.
  • Have a basic understanding of Spark and familiar/interested in learning the basics of
    tuning Spark jobs.
  • Have experience developing and supporting data integration technologies
  • Have strong written and verbal communication skills with the ability to skilfully engage
    with customers on complex topics

Essential:

  • Data Analytics knowledge
  • Technical ability
  • Strong communications and problem-solving skills
  • Comfortable with code for ETL in Python

Benefits

Exceptional training and benefits package we offer a £5,000 a year training budget to
help you grow and develop professionally. 

  • Senior Data Engineer

    3 days ago

    London, Greater London, United Kingdom Data Idols Full time £70,000 - £75,000 per year

    Senior Data EngineerSalary: £70,00 - £75,000Location: Hybrid - London - 1 day per weekWe are currently looking for a Senior Data Engineer to join our client's forward-thinking, collaborative, and technology-driven team. In this role, you'll take the lead in shaping and delivering modern cloud data solutions, working closely with a highly skilled Data & BI...

  • Data Engineer Contractor

    4 days ago

    London, Greater London, United Kingdom Data Intellect Full time £60,000 - £100,000 per year

    Company Description We are looking for a highly motivated Data Engineer to join our dynamic team working with a tier 1 multinational investment bank. This role is ideal for someone who thrives in fast-paced environments, enjoys working on both BAU and project-based initiatives, and has a strong background in Python ideally within the FX domain. Please note,...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Northern Data Full time £60,000 - £120,000 per year

    Job DescriptionThe Data Engineer is responsible for overseeing the collection, management, and analysis of organizational data to ensure accuracy, consistency, and security. This role bridges technical data management and business strategy — ensuring that data assets are properly maintained, integrated, and leveraged to drive insights and informed...

  • Pipeline Engineer

    16 hours ago

    London, Greater London, United Kingdom Evolve Technical Recruitment Full time £100,000 - £120,000 per year

    Job DescriptionOur client is looking to recruit a Lead Pipeline Engineer role for a FEED gas transmission pipelines/networks. The client's offices are based in central London and they operate a hybrid working patter on 1-2 days in the office. Project duration is 9-12 months and the role will be Outside IR35.Job Description:The candidate will be responsible...

  • Analytics Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £45,000 - £55,000 per year

    Analytics EngineerContract - £450 - £550pd Location: London - 2 days per weekWe are currently looking for an Analytics Engineer to join our fast-paced, data-driven tech team within a global digital media environment. You'll play a crucial role in shaping how the business collects, models, and activates data across multiple commercial and editorial...

  • Principal Data Analyst

    5 days ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £108,000 per year

    Principal Data AnalystSalary: £80-90k + bonusLocation: UK – RemoteFully RemoteWe are currently looking for an Principal Data Analyst to join our client's fast-growing, collaborative, and mission-driven tech team. In this role, you'll take ownership of their end-to-end analytics strategy, turning complex data into actionable insights that fuel smarter...

  • Lead Data Analyst

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time £80,000 - £90,000 per year

    Lead Data AnalystSalary: £80-90k + bonusLocation: London – RemoteFully RemoteWe are currently looking for an Lead Data Analyst to join our client's fast-growing, collaborative, and mission-driven tech team. In this role, you'll take ownership of their end-to-end analytics strategy, turning complex data into actionable insights that fuel smarter decisions...

  • Senior Data Analyst

    7 days ago

    London, Greater London, United Kingdom Data Idols Full time £65,000 - £75,000 per year

    Senior Data AnalystSalary:£65,000 - £75,000Location:Fully RemoteWe are currently looking for an Senior Data Analyst to join a fast-growing,innovative,and data-driven tech team within a global cybersecurity education company. You'll play a pivotal role in shaping data strategy and delivering insights that drive smarter decisions across the business.As an...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom WTW Full time £60,000 - £100,000 per year

    DescriptionAt WTW, we are a leading global advisory, broking, and solutions company. We work with clients across a wide range of industries, helping them manage risk, optimise benefits, and improve performance. As a Fabric Data Engineer, you will play a key role in leveraging Microsoft Fabric, Azure, and Python to design and build advanced data solutions in...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Intelance Full time £60,000 - £90,000 per year

    Intelance is a specialist architecture and AI consultancy working with clients in regulated, high-trust environments (healthcare, pharma, life sciences, financial services). We are assembling a lean senior team to deliver an AI-assisted clinical report marking tool for a UK-based, UKAS-accredited organisation in human genetic testing.We are looking for a...