Senior Data Engineer

2 weeks ago

London, Greater London, United Kingdom Midlands and Lancashire Commissioning Support Unit Full time

Job summary

Join a passionate NHS team helping to shape the future of healthcare.

The Health Economics Unit is looking for a Senior Data Engineer to provide vital data and insights, as we support health and care providers in making impactful decisions to improve population health.

As a passionate member of our outstanding team, you will have a range of responsibilities, including:

Data extraction and integration Data workflow management Data processing and transformation Data storage and management Quality assurance and governance Data analysis Collaboration and development

The Senior Data Engineer will sit within the Data and Analytics team, led by the Chief Analyst and reporting to the Lead Data Engineer, and working closely across HEU team, with data scientists, analysts, project managers, and health economists.

You will also engage with our clients, partners and stakeholders throughout projects, understanding their needs and communicating your work.

The Health Economics Unit (HEU) is part of the Midlands and Lancashire Commissioning Support Unit (ML). We deliver impactful insights that power the future development of health and care delivery. Our experts support health system and industry leaders to make the best possible decisions and design the highest quality, most efficient and most innovative services to improve the health of communities across the country.

Main duties of the job

The Senior Data Engineer provides vital data and insights to inform decisions, driving improvements in healthcare and impacting millions of people. Working in a collaborative environment, with data scientists, economists, data engineers and other healthcare professionals, you will be extracting, transforming, and cleaning data ready for analytical projects.

NHS ML is committed to our process of redeployment at risk members of our existing workforce to new roles. As such, all job adverts are subject to this policy and we reserve the right to close, delay or remove adverts while this process is completed. If you do experience a delay in the shortlisting stage of the recruitment cycle, please bear with us while this process is completed, and contact the named contact if you have any questions.

About us

The NHS is the biggest employer in Europe. It's a world-renowned institution and an exciting place to work, full of challenges and opportunities.

NHS Midlands and Lancashire Commissioning Support Unit (MLCSU) is one of the biggest and best-performing commissioning support units in the country, with among the highest levels of staff and customer satisfaction. We work together as a team of over 1,600 expert staff based across the Midlands and North West to make a difference - for our customers, patients and communities.

Offering a full range of professional services to hospital trusts, local authorities, integrated care systems (ICSs) and other public bodies across the country, our NHS values underpin everything we do.

At the HEU we embrace a flexible and agile working style that balances the needs of you as an individual, theteam and our services. Our office is located in Canary Wharf, London. Depending on the working pattern that suits you, you can choose between working in the office two days a week, necessary for High Cost Area Supplement (HCAS), or homeworking; in the office for key team days, meetings and when appropriate to your ways of working.

Job description

Job responsibilities

Data extraction and integration:

In this role, you will design, build, and maintain code to extract data adapting your methods based on the environment. You'll take ownership of the methodologies used for data extraction, regularly reviewing and refining them to ensure their effectiveness. Your expertise will enable you to rapidly understand and evaluate various databases, structured files and APIs, considering their structure, documentation, and contents. You'll efficiently handle complex datasets, extracting data from large-scale NHS datasets, publicly available health data, and commercial or research environments. At the HEU we regularly work with a wide range of data, examples include SUS, Fingertips, CPRD, and OpenSafely.

Data workflow management:

Managing the flow of data through pipelines involves ensuring the development and maintenance of reproducible analytical pipelines (RAPs). Your tasks will include scheduling jobs, monitoring performance, handling errors, testing, and automating complex processes. When querying large datasets, even in environments where control may be limited, you will employ techniques that continue to ensure efficiency.

Data processing and transformation:

Planning, developing, and evaluating methods and processes for transforming and cleaning data is vital to producing valuable insights. Collaborating closely with colleagues, youll appreciate their data requirements, allowing you to direct the processing and transformation of raw data into formats ready for analysis. As part of this process, youll produce flexible and replicable code to ensure efficiency, effectiveness, and security.

Data storage and management:

Your responsibilities also extend to efficiently storing and managing large volumes of data. This involves selecting appropriate storage solutions for performance and developing comprehensive documentation for assets and analyses. You will also support with ensuring datasets are held in an appropriately secure environment and destroyed when appropriate.

Quality assurance and governance:

You will always maintain security and the confidentiality of personal and commercially sensitive data in line with the relevant information governance (IG), standards and policies. Additionally, you will investigate data quality issues, understanding how inconsistencies could affect ability to analyse the data you extract. You will provide work arounds when possible and articulate inconsistencies and solutions to the team and clients. You will support the team to implement techniques to ensure efficient queries; advising on queries across the entire team.

Data analysis:

You'll also engage in data analysis tasks from time to time. Collaborating closely with the Data Scientists in our team, you will use creative approaches to extract valuable information to provide clear insights to decision-makers.

Collaboration and development:

Collaborative coding approaches through version control and peer review will enable our work to be of the highest quality. You will ensure client requirements are met by supporting project managers with required documentation and delivering on time and within budget. You will instill a culture of learning and knowledge sharing; you will develop and maintain your specialist knowledge whilst providing educational opportunities to enhance colleagues skills in your areas of expertise.

Person Specification

Experience

Essential

Considerable experience of extracting data, manipulating, understanding, transforming, wrangling, cleaning, and storing health data. Ability to write well-designed code ( SQL or Python) which follows good coding standards.

Skills

Essential

Demonstrates leadership skills in approach to data engineering tasks and delivery of projects on time and within budget. Fosters a culture of learning and improvement within the team. Master's degree in a related STEM subject or equivalent level of experience of working at a similar level in a similar setting for at least 3 years.

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time £85,000

    Job Description Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Senior Data EngineerIncrease your chances of reaching the interview stage by reading the complete job description and applying promptly.Salary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand. As a Senior Data...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £85,000

    Senior Data Engineer Salary: up to £85,000 Location: London (Hybrid) Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Data Science Festival Full time £70,000 - £85,000

    Senior Data Engineer Location: London, 3/2 days in the office per week Data Idols are currently working with a company that focus on the european marketplace for transport who are looking to make the future greener Within this role as a Senior Data Engineer, you will be monitoring, designing and implementing a datawarehouse, whilst working with different...

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    Our client, a Data & AI firm in London is actively seeking a Senior Data Engineer to play a pivotal role in delivering innovative big data solutions to their end clients. This client-facing role requires a unique blend of technical prowess in Databricks/Snowflake and exceptional communication skills to understand and address clients' diverse data...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Data Idols Full time

    Data Engineer Are you a mid-level Data Engineer skilled in Azure technologies, seeking an new 'feel-good' permanent opportunity? Data Idols are proud to be supporting a HealthTech client, who use remote-first technology focusing on engagingpatients across their healthcare journey while saving hospitals time, effort, and money This opportunity provides remote...

  • Lead Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data Engineer Location: LondonSalary: £100,000 + BenefitsExciting Opportunity in LondonDo you want to work in the media sector for a top company? We are currently seeking a skilled Lead Data Engineer ready for a new challenge and eager to grow in their career.About the CompanyThis innovative media company is data-driven and is seeking a Lead Data...

  • Senior Data Scientist

    2 weeks ago

    London, Greater London, United Kingdom Data Science Talent Full time

    Senior Data Scientist - F1 Motorsports Location: The time it takes to service an entire F1 racing car at the pit stop. The data you and your team help to deliver could make or break lap time for one of the world's leading Formula 1 teams. A lap time that over 500 million people will see at the most-watched annual sporting series in the world. You'll join a...

  • Senior Data Scientist

    2 weeks ago

    London, Greater London, United Kingdom Data Science Talent Full time

    Senior Data Scientist / Data Scientist - F1 Motorsport Location: The time it takes to service an entire F1 racing car at the pit stop. The data you and your team help to deliver could make or break lap time for one of the world's leading Formula 1 teams. A lap time that over 500 million people will see at the most-watched annual sporting series in the world....

  • Senior Engineer, Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Open Data Science Conferenc Full time

    You have prior experience as a data engineer, software engineer, or data architect. You can work remotely and independently, taking ownership of your work. You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce. Experience with Java11+ for ingesting,...

  • NS - Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Abs Data Full time

    Job title: NS – Data Engineer Company: BAE Systems Job description : Location(s): [[mfield3]] BAE Systems Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses...

  • Data Science Data Science Senior Data Scientist

    2 weeks ago

    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Senior Data Scientist As a Data Scientist, you'll have the unique opportunity to shape the future of recommendation systems and make a significant impact on a dynamic startup. Are you ready to bring your Data Science experience to the next level? As the Senior Data Scientist, you will be responsible for enhancingour recommendation systems and leading the...

  • Senior Data Scientist

    2 weeks ago

    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Senior Data Scientist As a Data Scientist, you'll have the unique opportunity to shape the future of recommendation systems and make a significant impact on a dynamic startup. Are you ready to bring your Data Science experience to the next level? As the Senior Data Scientist, you will be responsible for enhancingour recommendation systems and leading the...

  • Senior Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom Uniting People Ltd Full time £200,000

    Join to apply for the Senior Data Engineer (SAS) role at Uniting People Join to apply for the Senior Data Engineer (SAS) role at Uniting People Sign in to save Senior Data Engineer (SAS) at Uniting People . Job Title: Senior Data Engineer (SAS) Rewrite existing data pipelines (SAS, Info, pearl, shell scripts) to Python and DBT transformation-based...

  • Data Engineer

    2 weeks ago

    London, Greater London, United Kingdom DATA MART Consulting GmbH Full time

    Your Role: Apollo is establishing a set of truly innovative data services to propel the business to the next level. We are capturing, transforming, and analysing a vast variety of data through a modern data platform to produce fabulously rich insight for our business. You are the enthusiastic, skilful, and creative Data Engineer we need to make this...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Role: Senior Data EngineerSkills: SQL, Data Engineer experience, Snowflake and DBT (Data build tools)£65,000 – Senior Data Engineer – Fully Remote (UK based)We are looking for a Senior Data Engineer who has experience with SQL, Data Engineer experience, Snowflake and DBT (Data build tools) on a permanent basis, based on your level of experience salaries...

  • Senior Data Engineering

    2 weeks ago

    London, Greater London, United Kingdom Xcede Full time £85,000

    Job Description Senior Data Engineer (AWS) Up to £85,000 Salary + Bonus London office 2-3 days per week. A very successful AI scale up in the creative space are hiring for a Senior Data Engineer (AWS) to join their well established Data team, spearheading some of their key Data Engineering projects in AWS and mentoring junior team members.Your...

  • Senior Data Engineer

    1 month ago

    London, Greater London, United Kingdom JR United Kingdom Full time

    Senior Data EngineerUp to £90,000 + BonusFully Remote in UKOVERVIEWMajor FTSE100 retail giant hiring for x2 Senior Data Engineers, to lead small teams of Data Engineers on key projects, directly line managing them and providing technical leadership and guidance to the team. You will be joining a well-established Data function with huge customer data to work...

  • Data Engineering Manager

    2 weeks ago

    London, Greater London, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Data Engnieering professional to join our client, a growing consultancy, as a Data Engineering Manager.As Data Engineering Manager, you will play a pivotal role in driving the success of our client's Data Engineering practice through your expertise in presales, strong technical acumen, consulting skills, and effective...