Data Pipeline Engineer

4 days ago

london, United Kingdom Hexegic Full time
Job Description

Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.


The Role

The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes.


Core Responsibilities

  • Maintain build schedules so that pipelines run effectively.
  • Set up and maintaining health checks on different data pipelines
  • Respond, Triage, and debug the data pipeline when broken.
  • Reading code and writing code changes and/or modifying the monitoring set-up
  • Knowing and understanding how to navigate the data pipelines and documentation.
  • FollowingStandard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time.
  • Communicating outages with the end users of a data pipeline


What We Value

  • Comfortable reading and writing code in Python, Pyspark and Java.
  • Basic understanding of Spark and interested in learning the basics of tuning Spark jobs.
  • Data pipeline monitoring team members should be able to use and navigate pipeline development tools.
  • Experience supporting data integration technologies.


What we offer

  • salary £50,000 to £60,000
  • 25 days annual leave
  • Personal development program £5,000 per employee per year

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    Job OpportunityAs a Staff Data Engineer at Data Idols, you will play a key role in driving high standards across the data function. You will support the team in building pipelines to deliver insights enabling the company to be more data-driven with their decision-making.The ideal candidate will have extensive experience with data pipelines, data warehousing,...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the team in building pipelines to deliver insights that enable data-driven decision making.Key ResponsibilitiesDesign and develop data pipelines...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the team in building pipelines to deliver insights that enable data-driven decision making.Key ResponsibilitiesDesign and develop data pipelines...

  • Data Engineer

    10 hours ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    8 hours ago

    London, Greater London, United Kingdom Data Idols Full time

    The OpportunityWe are seeking a highly skilled Staff Data Engineer to join our team at Data Idols. As a Staff Data Engineer, you will play a key role in driving high standards across the data function and supporting the delivery of data transformation during an exciting time within the company.You will collaborate with the wider data teams to build and...

  • Data Engineer

    4 days ago

    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Staff Data Engineer and contribute to the company's data transformation journey during an exciting period of growth.We're seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.As a Staff...

  • Data Engineer

    4 days ago

    London, Greater London, United Kingdom Data Idols Full time £90,000 - £110,000

    Staff Data EngineerJoin Data Idols, one of the UK's most renowned retail brands, as a Staff Data Engineer and contribute to the company's data transformation journey during an exciting period of growth.We're seeking an experienced professional with a strong background in building and maintaining data pipelines to collaborate with our data teams.As a Staff...

  • Data Pipeline Engineer

    2 weeks ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...

  • Data Pipeline Engineer

    2 weeks ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time €5,000

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time €5,000

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    5 days ago

    london, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    4 months ago

    London,, UK, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.If you think you are the right match for the following opportunity, apply after reading the complete...

  • Data Pipeline Engineer

    4 months ago

    London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.If you think you are the right match for the following opportunity, apply after reading the complete...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, United Kingdom Data Idols Full time €75,000 - €95,000

    Senior Data Engineer Joining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams. For this role as...