Data Pipelines Engineer

2 weeks ago


London, Greater London, United Kingdom Hexegic Full time £5,000
About Hexegic:
At Hexegic, we are a top technical consultancy that provides agile multidisciplinary teams to top-performing companies. Our goal is to offer exciting and rewarding projects for individuals who are eager to advance their careers.

Data Pipeline Engineer Role:
The Data Pipeline Engineers play a crucial role in ensuring that our clients have access to accurate and updated data in our data analytics tool. They are responsible for promptly addressing any data health issues that may arise within key pipelines.

Responsibilities:
- Creating schedules to optimize pipeline operation.
- Establishing and managing health checks for various data pipelines.
- Troubleshooting and fixing any issues with data pipelines.
- Making necessary code changes and updates to monitoring systems.
- Adhering to Standard Operating Procedures to rectify data discrepancies or delays.
- Resolving outages affecting users of data pipelines.

Skills We Look For:
We highly value individuals with proficiency in coding in languages like Python, Pyspark, and Java. Familiarity with Spark and a willingness to learn about tuning Spark jobs are crucial. Team members should also be skilled in using pipeline development tools and supporting data integration technologies.

Benefits:
Salary Range: £50,000 to £60,000
Annual Leave: 25 days

Development Program:
£5,000 allocated per employee annually

  • London, Greater London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data...


  • London, Greater London, United Kingdom Hexegic Full time

    Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.Read all the information about this opportunity carefully, then use the application button below to send your CV...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Your Role: Apollo is establishing a set of truly innovative data services to propel the business to the next level. We are capturing, transforming, and analysing a vast variety of data through a modern data platform to produce fabulously rich insight for our business. You are the enthusiastic, skilful, and creative Data Engineer we need to make this...

  • Lead Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer - Residential Property CompanyLocation: London (flexible working available)Salary: CompetitiveWe are a leading residential property company looking to hire a Lead Data Engineer to join our growing data-focused team. You will be responsible for leading a team of data engineers and playing a key role in the development and maintenance of our...

  • gcp data engineer

    2 weeks ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...

  • Aws Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    AWS Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an oil and gas company is an expanding team. You will join the business as an AWS Data Engineer playing a major role in a migration project that is ongoing, helping push it through to completion....

  • gcp data engineer

    2 weeks ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP DATA ENGINEER, 6-MONTH CONTRACT LONDON (FULLY REMOTE) £600-£700 PER DAY This position as a GCP Engineer allows you to work within a dynamic Telecoms company located in the heart of London. You will be developing a new GCP data environment and migrating data into the new environment. THE COMPANY This Telecoms company has been very well established...

  • Gcp Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    GCP Data Engineer£ a day, Inside IR35.Hybrid role, 2 days a week on-site. London office.6-Month Contract, potential to keep rollingFantastic opportunity to join an energy company is an expanding team. You will join the business as a GCP Data Engineer playing a major role in a migration project that is about to kick-off. This migration is from their legacy...


  • London, Greater London, United Kingdom First Recruitment Group Full time

    Kingston upon Thames, Surrey – 3 days per week in the office, 2 days per week working from home Oil & Gas/ Offshore Wind sector 2 Senior Pipeline Engineers are required to work on an initial 12 month contract basis based in Kingston upon Thames, Surrey that will offer a hybrid working set up of 3 days per week in the office and 2 days per week working from...


  • London, Greater London, United Kingdom Kintec Global Recruitment Full time

    Pipeline Integrity Engineer - Permanent - £40k - £50k - Remote You will be responsible for managing the integrity owned and operated pipelines to allow the safe, reliable and efficient delivery of products to our customersThe role requires the highest standards of visible SHEQ leadership to ensure that suitable engineering standards are applied and...


  • London, Greater London, United Kingdom Airswift Full time

    Project: PapuaLNG Location: LondonStart: June year renewable contract)Positions I have available:Onshore Pipeline LeadOffshore Pipeline LeadShore Crossing EngineerPipeline Integrity EngineerThe Service holder perimeter includes all the activities related to the development of Papua LNG (PLNG)Onshore Pipelines System, interfacing with the other systems of...


  • London, Greater London, United Kingdom Data Idols Full time £85,000

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Opus Recruitment Solutions Ltd Full time

    Data EngineerEnergyHybrid - 1 day a week on sitePermanent£60,000 - £75, % Bonus + PackageMy client are one of the fastest growing Energy companies in the UK and they are currently on the hunt for a Data Engineer. They are looking for someone who enjoys building data pipelines and the engineering that goes along with them. They are building a dataanalytics...


  • London, Greater London, United Kingdom ARM Full time £50 - £60

    SENIOR PIPELINE ENGINEER (WATER) - NATIONWIDE - 12 MONTH CONTRACT - £50 - £60 PER HOUR ARM are working with a major global infrastructure client and we are currently recruiting for a Senior Pipeline Engineer within the water sector for a 12 month contract. You will be a Chartered Civil Engineer with a focus on pipeline engineering within the water sector....

  • Senior Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Data Idols Full time

    Senior Data EngineerIncrease your chances of reaching the interview stage by reading the complete job description and applying promptly.Salary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Validis Full time

    Role: Mid-Level Data EngineerBusiness Area: Engineering/TechnologyReporting to: Head of DataLocation: Hybrid/RemoteAbout ValidisValidis is a dynamic fintech company with a leading software platform specialized in extracting and standardizing accounting data. Operating in the UK, US, and Australia, Validis caters to audit firms and financial institutions,...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom Mastek Full time

    Job DescriptionJob Description: Data EngineerLocation: [UK]SC Cleared: RequiredJob Type: Full-TimeExperience: 12-14 yearsJob description:We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support...


  • London, Greater London, United Kingdom First Recruitment Group Full time

    Job Title: GIS Specialist at First Recruitment GroupLocation: UKSector: Oil & GasJob Type: ContractSalary: Market relatedRoleInitial 12 Month ContractFully remote workingAs the GIS Specialist, you will support the development of onshore and offshore projects globally. Your responsibilities will include providing GIS support in setting up GIS Models,...

  • Data Engineer

    2 weeks ago


    London, Greater London, United Kingdom The Consultancy Group Full time

    Key Responsibilities: Design, build, and maintain the data pipeline and storage systems Assemble large, complex data sets that meet business requirements Analysis and organisation of raw data Collaborate with data scientists and analysts to understand data needs and requirements Ensure data is accurate and reliable Monitor data pipeline for errors and take...