Data Pipeline Specialist

1 week ago

London, Greater London, United Kingdom Hexegic Full time

Job Summary

Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organizations. We offer exciting, engaging, and rewarding projects for those keen to develop and build a successful career.

The Role

The Data Pipeline Engineers ensure that our customers work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes.

Core Responsibilities

  • Maintain build schedules so that pipelines run effectively.
  • Set up and maintain health checks on different data pipelines.
  • Respond, triage, and debug the data pipeline when broken.
  • Read code and write code changes and/or modify the monitoring setup.
  • Know and understand how to navigate the data pipelines and documentation.
  • Follow Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time.
  • Communicate outages with the end users of a data pipeline.

What We Value

  • Comfortable reading and writing code in Python, PySpark, and Java.
  • Basic understanding of Spark and interested in learning the basics of tuning Spark jobs.
  • Data pipeline monitoring team members should be able to use and navigate pipeline development tools.
  • Experience supporting data integration technologies.

What We Offer

  • Salary £50,000 to £60,000.
  • 25 days annual leave.
  • Personal development program £5,000 per employee per year.

  • Data Pipeline Specialist

    6 days ago

    London, Greater London, United Kingdom Hexegic Full time

    Job SummaryHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organizations. The company promises exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineers ensure that our customer works with updated and correct data in our data...

  • Data Pipeline Specialist

    6 days ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organisations. The company promises exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Specialist

    1 week ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organisations. The company promises exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...

  • Data Pipeline Specialist

    1 week ago

    London, Greater London, United Kingdom Hexegic Full time

    Job SummaryHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organizations. The company promises exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineers ensure that our customer works with updated and correct data in our data...

  • Data Pipeline Specialist

    5 days ago

    London, Greater London, United Kingdom Hexegic Full time £5,000

    Job OverviewHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organizations. We offer exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics...

  • Data Pipeline Specialist

    5 days ago

    London, Greater London, United Kingdom Hexegic Full time £5,000

    Job OverviewHexegic is a leading technical consultancy providing agile multi-disciplinary teams to high-performing organizations. We offer exciting, engaging, and rewarding projects for those keen to develop and build a successful career.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics...

  • Data Pipeline Specialist

    1 week ago

    London, Greater London, United Kingdom House of Kelly Consulting Full time

    Job Title: Kafka EngineerJob Summary:House of Kelly Consulting is seeking a highly skilled Kafka Engineer to join our team. As a key member of our technical team, you will be responsible for designing, implementing, and maintaining scalable and efficient data pipelines using Apache Kafka.Key Responsibilities:Strategic Planning: Collaborate with product...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Canada Life Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Canada Life. As a Data Engineer, you will play a crucial part in driving data-driven decision-making across the organization, ensuring data availability, quality, and accessibility for various business needs.Key ResponsibilitiesData Pipeline DevelopmentDesign, model, develop, and...

  • Cloud Data Pipeline Specialist

    1 week ago

    London, Greater London, United Kingdom Source Technology Full time

    Job Description**Quantitative Software Engineer - Python**£80,000 - £125,000 + bonus and benefits**About the Role**We are seeking a skilled Python developer to join our team at Source Technology, a leading provider of innovative software solutions. As a Quantitative Software Engineer, you will play a key role in developing and maintaining our cloud-based...

  • Data Engineer

    1 week ago

    London, Greater London, United Kingdom Unreal Gigs Full time

    About the Role:We are seeking a talented Data Engineer to join our team at Unreal Gigs. As a Data Engineer, you will be responsible for designing and implementing data pipelines, developing Extract, Transform, Load (ETL) processes, and working with large volumes of data to support our business intelligence and data-driven initiatives.Key...

  • Data Engineer

    6 days ago

    London, Greater London, United Kingdom Unreal Gigs Full time

    About the Role:We are seeking a talented Data Engineer to join our team at Unreal Gigs. As a Data Engineer, you will be responsible for designing and implementing data pipelines, developing Extract, Transform, Load (ETL) processes, and working with large volumes of data to support our business intelligence and data-driven initiatives.Key...

  • Data Pipeline Engineer

    6 days ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...

  • Data Pipeline Engineer

    6 days ago

    London, Greater London, United Kingdom Hexegic Full time

    About HexegicHexegic is a leading technical consultancy that provides agile multi-disciplinary teams to high-performing organizations.The RoleThe Data Pipeline Engineer ensures that our customers work with updated and correct data in our data analytics tool.Key ResponsibilitiesMaintain build schedules to ensure pipelines run effectively.Set up and maintain...

  • Azure Data Pipeline Architect

    1 week ago

    London, Greater London, United Kingdom Movement8 Full time

    Job Title: Data Engineer - Cloud Solutions SpecialistAbout the Role:We are seeking an experienced Data Engineer to join our team at Movement8. As a Data Engineer, you will play a key role in designing and implementing data pipelines using Azure Data Factory and Databricks.Key Responsibilities:Design and implement data pipelines using Azure Data Factory and...

  • Data Pipeline Architect

    6 days ago

    London, Greater London, United Kingdom oilandgas Full time

    About the RoleWe are seeking a highly skilled Data Pipeline Engineer to join our team at Oil and Gas. As a Data Pipeline Engineer, you will play a critical role in designing, building, and maintaining efficient, reusable, and reliable data pipelines to support our business operations.Key ResponsibilitiesDesign and Development: Design and develop efficient...

  • Data Pipeline Architect

    6 days ago

    London, Greater London, United Kingdom oilandgas Full time

    About the RoleWe are seeking a highly skilled Data Pipeline Engineer to join our team at Oil and Gas. As a Data Pipeline Engineer, you will play a critical role in designing, building, and maintaining efficient, reusable, and reliable data pipelines to support our business operations.Key ResponsibilitiesDesign and Development: Design and develop efficient...

  • ELK Engineer

    3 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: ELK Engineer - Data Pipeline SpecialistJob Summary:N Consulting Ltd is seeking an experienced ELK Engineer to lead and support the design, construction, and maintenance of ELK stacks for our clients' security management work-streams. The ideal candidate will have hands-on working knowledge of all ELK components, including Search, Logstash, and...

  • ELK Engineer

    3 days ago

    London, Greater London, United Kingdom N Consulting Ltd Full time

    Job Title: ELK Engineer - Data Pipeline SpecialistJob Summary:N Consulting Ltd is seeking an experienced ELK Engineer to lead and support the design, construction, and maintenance of ELK stacks for our clients' security management work-streams. The ideal candidate will have hands-on working knowledge of all ELK components, including Search, Logstash, and...

  • Senior Data Engineer

    1 week ago

    London, Greater London, United Kingdom Butterworths Limited Company Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our DataOps Team at Butterworths Limited Company. As a key member of our team, you will be responsible for designing, building, and maintaining efficient, reliable, and scalable data pipelines, based on both batch and streaming processing.Key ResponsibilitiesData Pipeline Development: Design...

  • Senior Data Engineer

    7 days ago

    London, Greater London, United Kingdom Butterworths Limited Company Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our DataOps Team at Butterworths Limited Company. As a key member of our team, you will be responsible for designing, building, and maintaining efficient, reliable, and scalable data pipelines, based on both batch and streaming processing.Key ResponsibilitiesData Pipeline Development: Design...