Data Engineering Lead

5 days ago


North East, United Kingdom NHS Full time
Job Overview

We are seeking a highly skilled Data Engineering Lead to join our team at NHS North Of England Commissioning Support Unit. This is a key role in ensuring that we can fulfil our purpose in planning and delivering the best services for patients.

About the Role

The successful candidate will lead the data development processes at all stages from conceptualisation to designing, developing, building and testing data pipelines for production using agile methodologies. They will be responsible for designing and developing data feeds to integrate products and services via APIs or similar, as well as developing pipelines in code and following standard modern code development practices such as CI/CD using Python and Spark.

Main Responsibilities
  • Leading the data development processes at all stages from conceptualisation to designing, developing, building and testing data pipelines for production using agile methodologies.
  • Designing and developing data feeds to integrate products and services via APIs or similar.
  • Developing pipelines in code and following standard modern code development practices such as CI/CD using Python and Spark.
  • Integrating pipelines with other aspects of our data processing environment including data catalogues, data lineage, and logging and monitoring.
  • Developing aggregate data views for use by internal and external teams.
  • Developing data transformation routines from both complex technical specifications and natural language agreements.
  • Developing logical data models and schema to support consistent analysis across the NHS and social care.
  • Implementing reports and dashboards within platforms (where supported), collaborating closely alongside other specialists if complex modelling and machine learning is required.
Requirements

The ideal candidate will have significant experience in manipulation of complex data, data processes, products and platforms. They should also have extensive experience in automating data processing routines through specialist software, scripting and bespoke development tools. Additionally, they should have experience of operating within a formal and structured data environment utilising formal change control arrangements.

Skills and Qualifications
  • Highly developed analytical skills to interpret complex data specifications and requirements.
  • Skilled and experienced in a relevant programming language (e.g., .net, python, R) and experienced in data modelling methods.
  • Knowledge and experience in creating data quality and testing tools.
Salary and Benefits

We offer a competitive salary of £70,000 - £90,000 per annum, depending on experience. The successful candidate will also receive a range of benefits, including a generous pension scheme, annual leave entitlement and opportunities for professional development.



  • North East, United Kingdom alphanumeric Full time

    Job DetailsData Engineering Product ManagerAlphanumeric is seeking a skilled Product Manager to lead the development and execution of our Data Engineering products. The ideal candidate will have a strong understanding of data engineering tools and cloud computing environments, as well as experience working in agile software development environments.The...


  • North East, United Kingdom alphanumeric Full time

    Job Title: Data Engineering Product ManagerWe are seeking a skilled and experienced Product Manager for our Data Engineering products. In this role, you will be responsible for developing and executing the product strategy of our Data Engineering products to meet customer needs.Job ResponsibilitiesDevelop and execute the product strategy for Data Engineering...

  • Azure Data Engineer

    4 weeks ago


    North East, United Kingdom Anglian Water Business (National) Limited Full time

    Job Summary:We are seeking an experienced Azure Data Engineer to join our team at Anglian Water Business (National) Limited. As a key member of our data engineering function, you will be responsible for designing and developing scalable ETL pipelines using Azure Data Factory and other Azure services.Key Responsibilities:Design and develop scalable ETL...


  • East London, United Kingdom Future Engineering Full time

    Shift Engineer OpportunityWe are seeking a skilled Shift Engineer to join our team at Future Engineering, a leading company in the Data Centre industry. As a Shift Engineer, you will play a crucial role in the installation, preparation, splicing, and testing of single mode and multimode optic fibre.Key Responsibilities:Installation and testing of fibre optic...


  • East London, United Kingdom Future Engineering Full time

    Shift Engineer OpportunityWe are seeking a skilled Shift Engineer to join our team at Future Engineering, a leading company in the Data Centre industry. As a Shift Engineer, you will play a crucial role in the installation, preparation, splicing, and testing of single mode and multimode optic fibre.Key Responsibilities:Installation and testing of fibre optic...


  • East London, United Kingdom Future Engineering Full time

    Role OverviewFuture Engineering is seeking a skilled Data Centre Cabling Specialist to join our team in East London. As a Shift Engineer, you will be responsible for the installation, preparation, splicing, and testing of single mode and multimode optic fibre.Key ResponsibilitiesInstallation, preparation, splicing, and testing of single mode and multimode...


  • East London, United Kingdom Future Engineering Full time

    Role OverviewFuture Engineering is seeking a skilled Data Centre Cabling Specialist to join our team in East London. As a Shift Engineer, you will be responsible for the installation, preparation, splicing, and testing of single mode and multimode optic fibre.Key ResponsibilitiesInstallation, preparation, splicing, and testing of single mode and multimode...


  • East London, United Kingdom Future Engineering Full time

    About the RoleFuture Engineering is seeking a skilled Data Cabling Engineer to join our team. As a Data Cabling Engineer, you will be responsible for installing, maintaining, and testing internal cabling systems in data centres. Your expertise will be crucial in creating reliable network infrastructures for our clients.Your ResponsibilitiesExperience in...


  • East London, United Kingdom Future Engineering Full time

    Role OverviewFuture Engineering is seeking a skilled Data Centre Cabling Specialist to join our team in East London. As a Shift Engineer, you will be responsible for the installation, preparation, splicing, and testing of single mode and multimode optic fibre.Key ResponsibilitiesInstallation, preparation, splicing, and testing of single mode and multimode...

  • Project Coordinator

    3 weeks ago


    East London, United Kingdom Future Engineering Full time

    Project Coordinator RoleWe are seeking a highly skilled Project Coordinator to join our team at Future Engineering, a leading company in the Data Centre industry. As a Project Coordinator, you will play a key role in supporting our project management team and contract administration.Your Key ResponsibilitiesWork closely with the project team to establish...

  • Project Coordinator

    4 weeks ago


    East London, United Kingdom Future Engineering Full time

    Project Coordinator - Data Centre SpecialistFuture Engineering is seeking a highly skilled Project Coordinator to join our team in London. As a Project Coordinator, you will play a key role in supporting the project management team and contract administration.Your Key Responsibilities:Assist with document administration and ensure smooth communication...

  • Lead M&E Engineer

    4 weeks ago


    North East, United Kingdom PRS Full time

    Job Title: Lead M&E EngineerWe are seeking a highly skilled and experienced Lead M&E Engineer to join our team at PRS, a leading specialist recruitment and search & selection consultancy within the Building Services, FM and Support Sectors.About the RoleThe successful candidate will be responsible for leading and managing large-scale engineering projects...

  • Lead M&E Engineer

    2 months ago


    North East, United Kingdom PRS Full time

    Job Title: Lead M&E EngineerWe are seeking a highly skilled and experienced Lead M&E Engineer to join our team at PRS, a leading specialist recruitment and search & selection consultancy within the Building Services, FM and Support Sectors.About the RoleThe successful candidate will be responsible for supporting the Business Development and Commercial team...

  • Lead M&E Engineer

    2 months ago


    North East, United Kingdom PRS Full time

    Job Title: Lead M&E EngineerWe are seeking a highly skilled and experienced Lead M&E Engineer to join our team at PRS, a leading specialist recruitment and search & selection consultancy within the Building Services, FM and Support Sectors.About the RoleThe successful candidate will be responsible for supporting the Business Development and Commercial team...

  • Project Coordinator

    3 weeks ago


    East London, United Kingdom Future Engineering Full time

    Project Coordinator RoleFuture Engineering is seeking a skilled Project Coordinator to join our team in London. As a Project Coordinator, you will play a key role in supporting the project management team and contract administration.Your Key ResponsibilitiesWork closely with the project team to establish strong relationships with key stakeholdersAssist with...


  • North East, United Kingdom PragmatIC Semiconductor Full time

    Job OverviewWe are seeking a highly skilled Manufacturing Intelligence Expert to join our thriving Manufacturing Intelligence team at Pragmatic Semiconductor.This role will play a crucial part in implementing and deploying end-to-end Manufacturing solutions, including third-party applications, ETL build, analysis, reporting, API maintenance, and development,...


  • East London, United Kingdom Future Engineering Full time

    Job Title: Data Centre Project CoordinatorLocation: East LondonSalary: £35,000 + Bonus + Travel Allowance + Training + Holidays + Technical Progression + Data Centre Industry + Progression + Healthcare + Pension + Permanent RoleAbout the Role:Future Engineering is seeking an experienced Data Centre Project Coordinator to join our team in London. As a key...


  • North East, United Kingdom alphanumeric Full time

    Unlock Your Potential with AlphanumericAlphanumeric is seeking a seasoned Product Manager II to lead our Search Platform & Products, a critical component of our Data and Knowledge Platform. As a key member of our Onyx Product Management team, you will collaborate closely with stakeholders across the organization to develop a strategic roadmap for...


  • North East, United Kingdom Sacco Mann Full time

    This Newcastle Upon Tyne based manufacturing business with a global presence, is seeking a Compliance and Data Protection Lead to join their team.A great opportunity to lead on corporate compliance with a major household name brand.In this exciting new role, you will be working across all things compliance including taking on the role of the DPO, and so...


  • North East, United Kingdom MTrec Ltd Technical Full time

    About the RoleWe are seeking an experienced Commissioning Lead Engineer to join our team at MTrec Ltd Technical. As a key member of our engineering and manufacturing client's team, you will be responsible for coordinating field-based installation and commissioning activities.Key ResponsibilitiesDevelop and implement commissioning procedures and best...