Data Engineering Lead

1 month ago


North East, United Kingdom NHS Full time
Job Overview

We are seeking a highly skilled Data Engineering Lead to join our team at NHS North Of England Commissioning Support Unit. This is a key role in ensuring that we can fulfil our purpose in planning and delivering the best services for patients.

About the Role

The successful candidate will lead the data development processes at all stages from conceptualisation to designing, developing, building and testing data pipelines for production using agile methodologies. They will be responsible for designing and developing data feeds to integrate products and services via APIs or similar, as well as developing pipelines in code and following standard modern code development practices such as CI/CD using Python and Spark.

Main Responsibilities
  • Leading the data development processes at all stages from conceptualisation to designing, developing, building and testing data pipelines for production using agile methodologies.
  • Designing and developing data feeds to integrate products and services via APIs or similar.
  • Developing pipelines in code and following standard modern code development practices such as CI/CD using Python and Spark.
  • Integrating pipelines with other aspects of our data processing environment including data catalogues, data lineage, and logging and monitoring.
  • Developing aggregate data views for use by internal and external teams.
  • Developing data transformation routines from both complex technical specifications and natural language agreements.
  • Developing logical data models and schema to support consistent analysis across the NHS and social care.
  • Implementing reports and dashboards within platforms (where supported), collaborating closely alongside other specialists if complex modelling and machine learning is required.
Requirements

The ideal candidate will have significant experience in manipulation of complex data, data processes, products and platforms. They should also have extensive experience in automating data processing routines through specialist software, scripting and bespoke development tools. Additionally, they should have experience of operating within a formal and structured data environment utilising formal change control arrangements.

Skills and Qualifications
  • Highly developed analytical skills to interpret complex data specifications and requirements.
  • Skilled and experienced in a relevant programming language (e.g., .net, python, R) and experienced in data modelling methods.
  • Knowledge and experience in creating data quality and testing tools.
Salary and Benefits

We offer a competitive salary of £70,000 - £90,000 per annum, depending on experience. The successful candidate will also receive a range of benefits, including a generous pension scheme, annual leave entitlement and opportunities for professional development.



  • North East, United Kingdom NHS Full time

    About the RoleWe are seeking a highly skilled Data Engineering Specialist to join our team at NHS North Of England Commissioning Support Unit. As an Associate Data Engineer, you will play a crucial role in supporting the development and delivery of our secondary care data service within our data management service.Job OverviewThe successful candidate will...


  • North East, United Kingdom Jacobs Engineering Group Inc. Full time

    We are seeking skilled engineers with a Civil Engineering background to join our team at Jacobs Engineering Group Inc.About the RoleThis is an exciting opportunity for experienced professionals to work on technically interesting projects that focus on sustainability, protecting the environment, reducing flood risk, improving water supplies, and adding value...

  • Data Strategist

    4 weeks ago


    North East, United Kingdom Atom bank Full time

    As a Business Intelligence Lead at Atom bank, you will play a key role in shaping the company's data-driven culture. This involves reinforcing a business-wide data culture, curating and enhancing business intelligence reporting, promoting self-service, and ensuring the quality of BI and reporting for a rapidly growing business.You will support our Lead Data...

  • Lead Engineer

    3 weeks ago


    Northwich, North West, United Kingdom Jenrick Engineering Full time

    Are you a Lead Engineer who is electrically biased Looking for an exciting new opportunity. If your skills, experience, and qualifications match those in this job overview, do not delay your application.The purpose of the role is to ensure delivery of the Engineering support to the Northwich site across 24/7 enabling the Engineering team to provide the...

  • Data Management Lead

    2 weeks ago


    North East, United Kingdom Marks & Spencer Plc Full time

    Job OverviewWe are seeking a highly skilled Data Management Lead to join our team in Galashiels. As a key member of our operations team, you will be responsible for driving profitability and sales through the delivery of the Retail Plan and Store KPIs.Main Responsibilities:Support the growth and profitability of the store by implementing the retail plan and...


  • East Meon, United Kingdom Engineeringuk Full time

    You will need to login before you can apply for a job.Employer: MarsLocation: London, United KingdomSalary: CompetitiveClosing date: 1 Jan 2025Sector: Data ScienceRole: ManagerContract Type: PermanentHours: Full TimeJob Description:Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works?...


  • East Meon, United Kingdom Engineeringuk Full time

    You will need to login before you can apply for a job.Employer: Mars Location: London, United Kingdom Salary: Competitive Closing date: 1 Jan 2025 Sector: Data Science Role: Manager Contract Type: Permanent Hours: Full Time Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an...


  • East Hampshire, United Kingdom ENGINEERINGUK Full time

    You will need to login before you can apply for a job. Employer: Mars Location: London, United Kingdom Salary: Competitive Closing date: 1 Jan 2025 Sector: Data Science Role: Manager Contract Type: Permanent Hours: Full Time Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform...


  • East Hampshire, United Kingdom ENGINEERINGUK Full time

    We are seeking an experienced Data Engineer to lead our team in developing and maintaining robust data pipelines and storage solutions to support data analytics and machine learning initiatives. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and experience with cloud-based data services.About the RoleThis...


  • North East, United Kingdom PragmatIC Semiconductor Full time

    Job OverviewWe are seeking a highly skilled Manufacturing Intelligence Expert to join our thriving Manufacturing Intelligence team at Pragmatic Semiconductor.This role will play a crucial part in implementing and deploying end-to-end Manufacturing solutions, including third-party applications, ETL build, analysis, reporting, API maintenance, and development,...


  • North East, United Kingdom PragmatIC Semiconductor Full time

    Job Title: Engineering Team Lead for Semiconductor ManufacturingWe are seeking an experienced Engineering Team Lead for Semiconductor Manufacturing to join our team at PragmatIC Semiconductor. This role will involve leading a team of engineers and technicians in the development of back-end wafer fabrication processes, particularly die singulation and laser...


  • North East, United Kingdom Future Engineering Recruitment Ltd Full time

    Future Engineering Recruitment Ltd is seeking a skilled Maintenance Engineer to carry out maintenance and repairs on production machinery.The ideal candidate will have a strong background in electrical or multi-skilled maintenance engineering, with knowledge of industrial electrics and experience working in an industrial environment.Responsibilities:Carry...


  • North East, United Kingdom oilandgas Full time

    Company OverviewSchneider Electric is a leading global provider of energy management and automation solutions. We empower businesses to make the most of their energy resources and create sustainable futures.About the RoleWe are seeking an experienced Electrical Commissioning Expert to join our team in the North East region. As a key member of our data centre...


  • East London, United Kingdom Future Engineering Full time

    Company Overview:FUTURE ENGINEERING is a multinational leading data centre seeking to train up the next generation of project managers. As a company, we pride ourselves on being at the forefront of innovation and technology.About The Role:We are currently seeking a Data Centre Project Coordinator Trainee to join our dynamic team in London. This role offers...


  • North East, United Kingdom The Sirius Group Full time

    About the RoleThis Environmental Engineer Lead position is an exciting opportunity to join our team at The Sirius Group in Durham. As a key member of our geoenvironmental consultancy team, you will be responsible for leading projects, managing site investigations, and providing technical advice to clients.The salary for this role is £70,000 - £85,000 per...


  • North East, Glasgow, United Kingdom Morrison Data Services Full time

    About The Role We are hiring across the following locations : Aberdeen, Dundee and Fife (AB/DD/KY postcodes) We are proud to be recruiting on behalf of several providers, some of which are the bigger energy companies and we have the perfect opening for people who are looking for a role which offers a genuine flexible working approach. As one of our...


  • East Midlands, United Kingdom dcoded Full time €90,000 - €110,000

    Head of Data | Northwest, UK - Hybrid working £Due to continuous growth and expansion, one of our SaaS clients will be looking for a Head of Data Engineering in 2025. This is for a pioneering HealthTech company committed to transforming healthcare through cutting-edge technology and data-driven solutions. As the Head of Data Engineering, you will be...

  • Smart Meter Engineer

    1 month ago


    North East, Glasgow, United Kingdom Morrison Data Services Full time

    We are proud to be recruiting on behalf of several providers, some of which are the bigger energy companies and we have the perfect opening for people who are looking for a role which offers a genuine flexible working approach. It is also expected that you may be required to complete the safe installation and removal of smart meters (SMETS2) in domestic...


  • North East, United Kingdom Atom bank Full time

    We're looking for a talented Junior BI Engineer to join our Business Intelligence team at Atom bank. As a key member, you'll play a vital role in developing our business-wide data culture, creating high-quality business intelligence reporting, and promoting self-service analytics.About the TeamOur team is passionate about leveraging data to drive business...


  • East Liverpool, Ohio, United Kingdom Hays Engineering Full time

    About the JobHays Engineering has an exciting opportunity for a skilled Project Engineer to join our team. As a key member of our production planning department, you will play a crucial role in overseeing engineering projects from conception to completion.Your Key ResponsibilitiesDevelop and implement project plans to ensure efficient use of resources and...