Data Engineer

2 weeks ago


Birmingham, United Kingdom Experis - ManpowerGroup Full time

Data Engineer

Role purpose:

The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting and analytics delivery. The Data Engineer will contribute to enhancing our Azure-based data platform using technologies such as Azure Data Factory and Azure Databricks and will have the opportunity to work on exciting digital transformation projects.

Operating within Agile principles and methodologies, the Data Engineer collaborates with other data engineers and key stakeholders to shape and manage the portfolio of reporting and data requirements. Working alongside peers, this role contributes to refining the overall data strategy.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and workflows using Azure Data Factory and Databricks.
  • Perform data transformation and integration tasks to consolidate and enrich data from various sources into a unified format, whilst also ensuring data governance and compliance by design
  • Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements, perform UAT and deliver solutions accordingly.
  • Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing.
  • Document data pipelines, workflows, and processes to ensure knowledge sharing and maintainability.
  • Ensures the effective & timely management and closure of 2nd line data and reporting support requests, through the appropriate ticketing systems, to minimise impact on the operations of the wider business.
  • Actively participate in daily stand ups, weekly stakeholder meetings, retrospectives.

Technical / Professional Qualifications / Requirements:

  • Hands-on Experience with Azure Data Factory: Proven experience in designing, developing, and managing data pipelines using Azure Data Factory.
  • Good knowledge of Databricks for data processing and analytics
  • Experience with data modelling techniques and data warehousing concepts.
  • Proficiency in SQL for data querying and manipulation.
  • Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working
  • Problem-solving Skills: Ability to analyse complex data problems and propose effective solutions.
  • Communication and Collaboration: Good communication skills with the ability to collaborate effectively with cross-functional teams.
  • Experience with Python is highly desirable
#J-18808-Ljbffr
  • Data Engineer

    Found in: beBee S GB - 3 weeks ago


    Birmingham, United Kingdom Undisclosed Company Full time

    Data EngineerRole purpose:The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's...

  • Data Engineer

    Found in: Talent UK C2 - 2 weeks ago


    Birmingham, United Kingdom LRQA Full time

    Role Purpose The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's data...


  • Birmingham, United Kingdom Clearwater People Solutions Full time

    A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive the digital transformation initiatives and support business...


  • Birmingham, United Kingdom Clearwater People Solutions Full time

    Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to support the organisation's data processing needs and facilitate BI reporting...

  • Head of Data Engineering

    Found in: Talent UK C2 - 2 weeks ago


    Birmingham, United Kingdom LRQA Full time

    Who are LRQA? LRQA stands for dedication to clients, market firsts, and deep expertise in risk management. We’ve grown to become a leading global assurance provider, bringing together outstanding expertise in certification, customised assurance, cybersecurity, inspection and training. While we’re proud of our heritage, it’s who we are today that...


  • Birmingham, United Kingdom Experis - ManpowerGroup Full time

    Senior Data Engineer Role purpose: The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior Data Engineer leads the design, development, and maintenance of data...

  • Data Engineer New

    Found in: beBee jobs GB - 3 weeks ago


    Birmingham, Birmingham, United Kingdom Experis UK Full time

    Data EngineerRole purpose:The Data Engineer position is an integral part of the Data team within the Digital and Information function. This role entails overseeing the availability, integrity, quality, and accuracy of data. The primary responsibilities include designing, developing, and maintaining data pipelines and workflows to support the organisation's...

  • Senior Data Engineer

    Found in: beBee jobs GB - 3 weeks ago


    Birmingham, Birmingham, United Kingdom Undisclosed Company Full time

    Senior Data EngineerRole purpose:The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior Data Engineer leads the design, development, and maintenance of data...

  • Senior Data Engineer

    Found in: beBee S GB - 3 weeks ago


    Birmingham, United Kingdom Undisclosed Company Full time

    Senior Data EngineerRole purpose:The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior Data Engineer leads the design, development, and maintenance of data...

  • Senior Data Engineer

    3 weeks ago


    Birmingham, United Kingdom Experis - ManpowerGroup Full time

    Senior Data Engineer Role purpose: The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior Data Engineer leads the design, development, and maintenance of data...

  • Lead Data engineer

    3 weeks ago


    Birmingham, United Kingdom SF Technology Solutions Full time

    Job Description This exciting best in class organisation, renowned for its trailblazing innovations and technological advancements, seeks a seasoned Data Lead with a specialism in Data Engineering to lead its team. This role offers a unique opportunity to shape the future of data engineering while delivering unparalleled value for clients. As a Data Lead...

  • Senior Data Engineer

    Found in: Talent UK 2A C2 - 5 days ago


    Birmingham, United Kingdom Xcede Full time

    SENIOR DATA ENGINEER(EU Remote Opportunity)Xcede are delighted to be working with a very exciting Web3 / Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities in one space.As a Senior Data Engineer in the...


  • Birmingham, United Kingdom Lorien Full time

    Data Engineer ~ Hybrid, West- Midlands ~£56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation, testing,...

  • Senior Engineer, Data Engineering

    Found in: Jooble UK C2 - 5 days ago


    Birmingham, United Kingdom Lorien Full time

    Data Engineer ~ Hybrid, West- Midlands ~£56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation, testing,...

  • BI Developer

    6 days ago


    Birmingham, United Kingdom Reed Full time

    **BI Developer - Data Engineer - Data Warehouse Developer - Data Developer - Azure - ETL - SSIS - Power BI** **Location: Remote** **Salary** £55,000 - £80,000 (DOE) A leading employer and innovative business within their industry is looking to add a Data Engineer to their team to build analytical capabilities and assess opportunities to share and...

  • Data Engineer

    1 day ago


    Birmingham, United Kingdom Xpertise Recruitment Ltd Full time

    Xpertise is looking for a Data Engineer to join one of our top tech consultancies working on an entirely serverless platform. Please see further details below: **Day Rate**: £400.00 per day **Inside** IR35 **Location**: Remote + offices if you'd like to work on-site **Length**: 6 months **Start date**: ASAP Key skills desired: - 5+ years working in...

  • Data Engineering Manager

    Found in: Talent UK C2 - 2 weeks ago


    Birmingham, United Kingdom Arch Capital Group Full time

    With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠. Job Responsibilities Work with strategic partners to...


  • Birmingham, United Kingdom Your People Partners Ltd Full time

    Job title**:Senior/Lead Data Engineer (depending on experience)** Location**:Work from home, UK** Salary**:£50,000 - £60,000 plus an excellent package including Private Medical Insurance** **Are you looking for a new challenge with a company that is rapidly growing month by month?** **Are you wanting to be more than just a number and become the first...


  • Birmingham, United Kingdom Digital Waffle Full time

    Job Title: Data Cable Engineer Employment Type: Full-time, Permanent Digital Waffle is working with a leading provider of telecommunications solutions in Birmingham, UK, specializing in data cable installation and infrastructure development. We are seeking a skilled Data Cable Engineer to install, maintain, and troubleshoot data cable systems for...

  • Lead Data Engineer GCP

    Found in: Talent UK 2A C2 - 2 weeks ago


    Birmingham, United Kingdom Xcede Full time

    Lead Data Engineer£100,000 Salary + Bonus/ BenefitsRemote (UK)OVERVIEWA very successful health-tech company with a strong team, who are working on a very interesting and socially positive project, are hiring for a Lead Data Engineer (GCP) to join their health-tech Data team in delivering challenging, impactful and socially positive Data Engineering...