Data Pipeline Engineer

2 weeks ago


United Kingdom Hexegic Full time

The Role

The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes.

Core Responsibilities

  • Maintain build schedules so that pipelines run effectively.
  • Setting up and maintaining health checks on different data pipelines
  • Respond, Triage, and debug the data pipeline when broken.
  • Reading code and writing code changes and/or modifying the monitoring set-up
  • Knowing and understanding how to navigate the data pipelines and documentation.
  • Following Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time.
  • Communicating outages with the end users of a data pipeline

What We Value

  • Comfortable reading and writing code in Python, Pyspark and Java.
  • Basic understanding of Spark and interested in learning the basics of tuning Spark jobs.
  • Data pipeline monitoring team members should be able to use and navigate pipeline development tools.
  • Experience supporting data integration technologies.

What we offer

  • Competitive salary £50,000 to £60,000
  • 25 days annual leave
  • Professional development program £5,000 per employee per year 


  • United Kingdom Abs Data Full time

    Big Data Integration Engineer Saint-Gobain Position description Are you someone who is passionate about data and transformation? At Saint-Gobain Digital, we are looking for a Big Data Integration Engineer to work remotely to create customer and business value as part of a digital transformation. This Data Engineer will be a part of our enthusiastic...

  • Pipeline Engineer

    1 week ago


    United Kingdom Airswift Full time

    Project: PapuaLNG Location: London Start: June 2025 (1 year renewable contract) Positions I have available: Onshore Pipeline Lead Offshore Pipeline Lead Shore Crossing Engineer Pipeline Integrity Engineer The Service holder perimeter includes all the activities related to the development of Papua LNG (PLNG) Onshore Pipelines System, interfacing...

  • Pipeline Engineer

    1 week ago


    United Kingdom Airswift Full time

    Project: PapuaLNG Location: London Start: June 2025 (1 year renewable contract) Positions I have available: Onshore Pipeline Lead Offshore Pipeline Lead Shore Crossing Engineer Pipeline Integrity Engineer The Service holder perimeter includes all the activities related to the development of Papua LNG (PLNG) Onshore Pipelines System, interfacing...

  • Pipeline Engineer

    2 weeks ago


    United Kingdom oilandgas.org.uk Full time

    JOB DESCRIPTION What we can offer Meaningful and interesting projects delivered to leaders of industry across the energy transition, emerging and conventional energy sectors A caring team culture; we support each other professionally and personally, encouraging knowledge sharing across all areas of the business Energy Transition Academy; ...


  • United Kingdom oilandgas.org.uk Full time

    JOB DESCRIPTION Wood is currently recruiting for a Principal/Lead Subsea Pipeline Engineer on a staff basis, based in Reading/Staines, UK. As Principal Engineer, you will be a part of a small, high profile team to produce novel technical solutions to client's problems and provide clients with execution and economic plans to enable them to make...


  • United Kingdom Cornerstone Full time

    We're looking for talented people to join our team. Salary: £34.8k - £43k per annum (Dependent on skills & qualifications) Reference: REQ3787 Do you want to be a part of an innovative and supportive team? We are recruiting for Pipeline Data Support within the Pipelines Maintenance team, reporting to a Pipeline Engineer. The role will play an...


  • United Kingdom oilandgas.org.uk Full time

    Wood is recruiting for Lead Onshore Pipeline Engineers to join our onshore linear assets team to support onshore pipeline and associated facilities projects within our Technical Consulting Division on a staff or contract basis. This role will primarily be based in our Staines office with some hybrid working available. As a Lead Onshore Pipelines Engineer...


  • United Kingdom oilandgas.org.uk Full time

    JOB DESCRIPTION Wood is currently recruiting for a Principal/Lead Subsea Pipeline Engineer on a staff basis, based in Reading/Staines, UK. As Principal Engineer, you will be a part of a small, high profile team to produce novel technical solutions to client's problems and provide clients with execution and economic plans to enable them to make strategic...


  • United Kingdom oilandgas.org.uk Full time

    JOB DESCRIPTION Wood is recruiting for Lead Onshore Pipeline Engineers to join our onshore linear assets team to support onshore pipeline and associated facilities projects within our Technical Consulting Division on a staff or contract basis. This role will primarily be based in our Staines office with some hybrid working available. Join a culture of...


  • United Kingdom Subsea Oil and Gas Directory Full time

    This is a list of worldwide Pipeline Engineer jobs in the oil and gas industry. The Pipeline Engineer position is categorised as Engineering jobs, vacancies and careers. There are currently jobs available in Houston, USA, Scotland, Aberdeen, Norway, Stavanger, Australia, Perth, UK, London, China, Beijing, India, Chennai, Indonesia, Jakarta, Brazil, Rio,...


  • United Kingdom Jee Ltd Full time

    Jee is a leading independent multi-discipline subsea engineering and training company operating in the global oil, gas and renewables industries. Our oil and gas engineering services cover the whole life-of-field, from front end appraise and select studies, through FEED and detailed design, through to integrity management, operations support and...


  • United Kingdom oilandgas.org.uk Full time

    JOB DESCRIPTION The preferred partner for delivering digitally enabled capital investments with low carbon solutions. Wood's Projects business unit specialises in delivering predictable and consistent results in high complexity projects that include new technology, challenging construction logistics and, or sheer scale. Just like the nature and...


  • United Kingdom First Recruitment Group - IT Full time

    Senior Pipeline Draftsperson Engineer (GIS Specialist) Initial 12 Month Contract Outside IR35 Fully remote working As the GIS Specialist, you will be able to work on a fully remote contract basis. A GIS Specialist is required to support the development of new onshore and offshore projects worldwide. As the Senior Pipeline Draftsperson Engineer (GIS...


  • United Kingdom oilandgas.org.uk Full time

    Wood's Projects business unit specialises in delivering predictable and consistent results in high complexity projects that include new technology, challenging construction logistics and, or sheer scale. Just like the nature and expansiveness of our sectors, so is our Projects business, in its solutions, abilities and global track record. Across any major...


  • United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k Hybrid model – 3 days in the office per week. There is NO sponsorship on offer for this role, so you must be eligible to work in the UK My clients newly formed Data & Analytics team is playing a pivotal role in driving our data-driven transformation. They are a diverse group of...


  • United Kingdom Cornwallis Elt Full time

    Lead Data Engineer – Lloyd’s Insurance – Permanent - £90-110k Hybrid model – 3 days in the office per week. There is NO sponsorship on offer for this role, so you must be eligible to work in the UK My clients newly formed Data & Analytics team is playing a pivotal role in driving our data-driven transformation. They are a diverse group of...


  • United Kingdom Subsea Oil and Gas Directory Full time

    This is a list of worldwide Pipeline Integrity Engineering jobs in the oil and gas industry. The Pipeline Integrity Engineering position is categorised as Engineering jobs, vacancies and careers. There are currently jobs available in Houston, USA, Scotland, Aberdeen, Norway, Stavanger, Australia, Perth, UK, London, China, Beijing, India, Chennai, Indonesia,...


  • United Kingdom Aldwych Consulting Full time

    Pipeline Civil Engineer Are you interesting in becoming a Pipeline Civil Engineer for a company with amazing benefits and career progression? This world-leading firm is currently hiring a Pipeline Civil Engineer to join their expanding water engineering team. The team works on some of the most diverse and fascinating water projects in the world. As a...


  • United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...


  • United Kingdom Clearwater People Solutions Ltd Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and...