Data Engineering Lead for Complex Data Environments

5 days ago


Birmingham, Birmingham, United Kingdom Michael Page (UK) Full time

About Michael Page (UK)

Leading UK Logistics Company is seeking a Senior Data Engineer to play a pivotal role in leading the design, development, and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment.

Your expertise will ensure the availability, reliability, and scalability of their data platform, empowering the organisation with timely and accurate information to recognise the value of their data.

You will collaborate with the Data Science and Analytics teams to implement data models, create data integration pipelines, and optimise data workflows. This role requires a strong background in data engineering, with a solid understanding of data management principles and techniques.

You will support the development of junior data engineers, providing guidance and mentorship to help them build their skills.

This is a 12-month Fixed Term Contract/Fully remote position.

  • Lead the support of the Strategic Data Platform (SDP), ensuring it is robust, reliable, and cost-effective in providing high-quality data.
  • Design, develop, and uphold data integration processes, including the creation and execution of scalable and effective data pipelines for managing and transforming large datasets.
  • Optimise data storage and retrieval processes to meet performance and scalability requirements.
  • Ensure data quality and consistency by implementing data validation and cleansing techniques.
  • Collaborate with stakeholders to define requirements and integrate new data sources.
  • Monitor and troubleshoot data pipeline issues, identify and resolve bottlenecks, and implement performance optimisations.
  • Collaborate with the Business Intelligence (BI) team to define and implement data models for analysis and reporting purposes.
  • Maintain best practices, governance, and security in data projects.
  • Stay up-to-date with the latest trends and technologies in the field of data engineering, and make recommendations for improvement.
  • Provide guidance and mentorship to junior data engineers, supporting their development and skill-building;
  • Lead the technical aspects of our data strategy, ensuring alignment with organisational goals and objectives.

Estimated Salary: £70,000 - £90,000 per annum

Experience, Skills, and Attributes:

  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field (or equivalent experience).
  • Strong programming skills in Python, Java, or Scala, with proficiency in database management systems and excellent SQL skills.
  • Proven experience in designing and implementing data pipelines, ETL processes, data warehousing, and scaled data consumption patterns.
  • Knowledge of data integration, data modelling concepts, and familiarity with cloud data platforms and storage technologies, ideally within Azure.
  • Proficient in Azure data services (e.g., Synapse Analytics, SQL, Data Factory, Data Lake, Databricks, Cosmos DB) - Synapse and Databricks is essential.
  • Experience in Agile development, branch-based source control/DevOps concepts, and gathering and analysing system requirements.
  • Attention to detail and a commitment to delivering high-quality work.
  • Azure Data Engineer Associate/DP-203 certification or equivalent practical experience preferred.
  • Aptitude for learning new technologies and analytical methodologies, with experience in data visualisation tools (e.g., Power BI) and familiarity with machine learning/statistical analysis techniques being a plus.


  • Birmingham, Birmingham, United Kingdom NTT Data Full time

    About the Role:We are seeking a skilled Data Analyst to join our team at NTT DATA. As a Data Analyst, you will play a key role in helping our clients navigate complex datasets, uncover critical insights, and apply tailored data solutions that drive real-world business results.Key Responsibilities:Collaborate with senior consultants to support data analysis...

  • Data Insights Analyst

    4 weeks ago


    Birmingham, Birmingham, United Kingdom NTT DATA Services Full time

    About the Role:We are seeking a highly skilled Data Insights Analyst to join our dynamic team at NTT DATA Services. As a Data Insights Analyst, you will play a pivotal role in helping our clients navigate complex datasets, uncover critical insights, and apply tailored data solutions that drive real-world business results.Key Responsibilities:Collaborate with...


  • Birmingham, Birmingham, United Kingdom NTT DATA Services Full time

    About the Job:We are seeking a highly skilled Data Analyst to join our dynamic team at NTT DATA Services. As a Data Analyst, you will play a crucial role in helping our clients navigate complex datasets, uncover critical insights, and apply tailored data solutions that drive real-world business results.Key Responsibilities:Collaborate with senior consultants...


  • Birmingham, Birmingham, United Kingdom NTT DATA Services Full time

    About the Role:We are seeking a skilled Data Analyst and Business Insights Professional to join our dynamic team. This is an exciting opportunity to leverage your analytical skills and expertise in business insights to help our clients make informed decisions.Key Responsibilities:Collaborate with senior consultants to support data analysis projects, focusing...


  • Birmingham, Birmingham, United Kingdom Data Privacy Full time

    Project Manager for Data AnalyticsWe are seeking a skilled Project Manager to join our Data Analytics team. As a Project Manager, you will be responsible for managing multiple projects simultaneously, ensuring timely delivery, and maintaining high-quality results.Key Responsibilities:Conduct process mapping to understand data flows and create data...


  • Birmingham, Birmingham, United Kingdom MSA Data Analtics Ltd Full time

    MSA Data Analytics Ltd is a forward-thinking company based in Birmingham, expanding its capabilities in data-driven decision-making. We are seeking an experienced Mathematical Modeller to join our team.About the RoleThis exciting opportunity involves developing statistical models that add significant value to commercial, operational, risk, and financial...


  • Birmingham, Birmingham, United Kingdom NTT DATA Full time

    Job OverviewWe're seeking an experienced SAP S/4HANA Finance Consultant to lead end-to-end Finance implementation projects.As an expert in SAP Finance, you will design, test, and deploy complex custom enhancements in collaboration with technical team members. You'll also work closely with Senior Stakeholders, providing optimal solutions.Developing and...


  • Birmingham, Birmingham, United Kingdom Michael Page Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to lead our team in designing, developing, and maintaining robust data pipelines and infrastructure within our Microsoft Azure environment. As a key member of our organisation, you will play a pivotal role in ensuring the availability, reliability, and scalability of our...


  • Birmingham, Birmingham, United Kingdom Annapurna Full time

    About AnnapurnaAnnapurna is a leading provider of data intelligence solutions for the insurance industry. We empower underwriters to serve insureds more effectively by delivering actionable insights from granular policy data.Role OverviewWe seek an experienced Senior Data Engineer to design, implement, and maintain data pipelines and models that ensure...

  • Senior Data Engineer

    4 weeks ago


    Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    About the Role:The Senior Data Engineer will play a key role in the design, development, and maintenance of data engineering solutions for Irwin Mitchell. This includes understanding requirements, creating technical designs, configuring applications, writing code, and conducting testing. The successful candidate will collaborate with various teams,...

  • Data Engineers

    4 weeks ago


    Birmingham, Birmingham, United Kingdom BJSS Full time

    About UsWe're a leading tech consultancy, a team of creative problem solvers. Since 1993, we've been finding better, more sustainable ways to solve complex technology problems for some of the world's leading organisations and delivered solutions that millions of people use every day.In the last 30 years, we've won several awards, including a prestigious...


  • Birmingham, Birmingham, United Kingdom Kainos Full time

    At Kainos, we're seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing data processing and data persistence software components for solutions that handle data at scale.Key Responsibilities:Design and develop data processing and data persistence software...

  • Data Engineer

    1 month ago


    Birmingham, Birmingham, United Kingdom BJSS Full time

    About UsWe're a leading tech consultancy that's been pushing the boundaries of innovation since 1993. Our team of creative problem solvers has delivered solutions that millions of people use every day.We've won several awards, including a prestigious Queen's Award for Enterprise in the Innovation category for our Enterprise Agile delivery approach.We're a...

  • Cloud Data Engineer

    6 days ago


    Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    About the RoleThis is a critical position at Irwin Mitchell where you will be responsible for designing, developing, and maintaining data engineering solutions for the company.As a Data Engineer, you will be working on creating a greenfield modern cloud data platform in Azure, which will significantly impact the way the company works and the platform it...


  • Birmingham, Birmingham, United Kingdom Mondelēz International Full time

    About This RoleThis position is a key part of our R&D data engineering team, responsible for developing and maintaining existing R&D data infrastructure while exploring and implementing new technologies to enhance efficiency.Key ResponsibilitiesPartner with R&D's Lead Data Engineer and cross-functional stakeholders to understand data needs and design robust...


  • Birmingham, Birmingham, United Kingdom 83zero Limited Full time

    Job DescriptionThe successful candidate will have a strong background in data and integration, with experience in designing and implementing data migration strategies. They will be responsible for leading complex data migration projects and providing technical guidance to junior engineers.Responsibilities:Design and implement data migration strategies.Lead...


  • Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    Irwin Mitchell is seeking a skilled Cloud Data Platform Engineer to join their team. As a key member of the organization, you will play a crucial role in designing, developing, and maintaining data engineering solutions.About the RoleThe ideal candidate will have a strong focus on SQL Server, SSIS, Visual Studio, and experience with cloud-based data...


  • Birmingham, Birmingham, United Kingdom Michael Page (UK) Full time

    Enhance your career in data science with a rewarding role at Michael Page (UK).About the OpportunityWe are seeking an experienced Data Analysis Scientist to support our operational and customer-centric projects. As a key member of our team, you will leverage your skills in statistical modeling and programming to deliver business value from organizational...

  • Senior Data Engineer

    4 weeks ago


    Birmingham, Birmingham, United Kingdom Irwin Mitchell Full time

    About the RoleThe Senior Data Engineer will play a key part in accelerating data value creation at Irwin Mitchell, unlocking data's potential, and enabling improved data-driven decisions and advanced analytics.This role will shape Irwin Mitchell's transition to the cloud, both through the creation of a modern cloud data platform and as a wider organisation....


  • Birmingham, Birmingham, United Kingdom 83zero Limited Full time

    83zero Limited, a global leader in digital services, is seeking an experienced Data Engineer to join their team.Salary: £70,000 - £110,000 per annumThe role involves creating robust pipelines to ingest, process, and transform data using AWS tools such as AWS Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, Cloudwatch, SNS, and Step Functions.Key...