Current jobs related to Data Pipeline Engineer - London, Greater London - Hexegic

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the team in building pipelines to deliver insights that enable data-driven decision making.Key ResponsibilitiesDesign and develop data pipelines...

  • Data Engineer

    1 week ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the team in building pipelines to deliver insights that enable data-driven decision making.Key ResponsibilitiesDesign and develop data pipelines...

  • Data Engineer

    9 hours ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    6 hours ago


    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    4 days ago


    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Staff Data Engineer and contribute to the company's data transformation journey during an exciting period of growth.We're seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.As a Staff...

  • Data Engineer

    4 days ago


    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Staff Data Engineer and contribute to the company's data transformation journey during an exciting period of growth.We're seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.As a Staff...


  • London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...


  • London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...

  • Data Engineering Lead

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Idols is seeking a Senior Data Engineer to support the delivery of data transformation during an exciting time within the company. As a Senior Data Engineer, you will collaborate with the wider data teams to build and maintain data pipelines. Your extensive experience with data pipelines, data warehousing, and driving high standards across the data...

  • Data Engineering Lead

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time £75,000 - £95,000

    Data Idols is seeking a Senior Data Engineer to support the delivery of data transformation during an exciting time within the company. As a Senior Data Engineer, you will collaborate with the wider data teams to build and maintain data pipelines. Your extensive experience with data pipelines, data warehousing, and driving high standards across the data...


  • London, Greater London, United Kingdom oilandgas Full time

    Unlock the Power of AI with Our TeamWe're on a mission to make advanced AI technologies more accessible, and we're looking for talented individuals to join our dynamic team. As a Data Pipeline Engineer, you'll play a crucial role in building the next generation of AI models, driving innovation in AI, and ensuring that our solutions are transparent,...


  • London, Greater London, United Kingdom oilandgas Full time

    Unlock the Power of AI with Our TeamWe're on a mission to make advanced AI technologies more accessible, and we're looking for talented individuals to join our dynamic team. As a Data Pipeline Engineer, you'll play a crucial role in building the next generation of AI models, driving innovation in AI, and ensuring that our solutions are transparent,...

  • Data Engineer

    19 hours ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    21 hours ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    4 days ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols.The successful candidate will play a key role in driving high standards across the data function, supporting the delivery of data transformation and collaborating with the wider data teams.The OpportunityAs a Staff Data Engineer, you will have the opportunity to...

  • Data Engineer

    4 days ago


    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols.The successful candidate will play a key role in driving high standards across the data function, supporting the delivery of data transformation and collaborating with the wider data teams.The OpportunityAs a Staff Data Engineer, you will have the opportunity to...

  • Data Engineer

    2 days ago


    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the best-known retail brands in the UK, as a Staff Data Engineer and support the delivery of data transformation during an exciting time within the company. We are looking for someone with experience in building and maintaining data pipelines and collaborating with the wider data teams.The OpportunityFor this role...

  • Data Engineer

    2 days ago


    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the best-known retail brands in the UK, as a Staff Data Engineer and support the delivery of data transformation during an exciting time within the company. We are looking for someone with experience in building and maintaining data pipelines and collaborating with the wider data teams.The OpportunityFor this role...

Data Pipeline Engineer

3 months ago


London, Greater London, United Kingdom Hexegic Full time

Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.

The Role

The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes.

Core Responsibilities

  • build schedules so that pipelines run effectively.
  • up and maintaining health checks on different data pipelines
  • Triage, and debug the data pipeline when broken.
  • code and writing code changes and/or modifying the monitoring set-up
  • and understanding how to navigate the data pipelines and documentation.
  • Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time.
  • outages with the end users of a data pipeline

What We Value

  • reading and writing code in Python, Pyspark and Java.
  • understanding of Spark and interested in learning the basics of tuning Spark jobs.
  • pipeline monitoring team members should be able to use and navigate pipeline development tools.
  • supporting data integration technologies.

What we offer

  • salary £50,000 to £60,000
  • days annual leave
  • development program £5,000 per employee per year