Data Engineer

4 weeks ago

Leeds, Leeds, United Kingdom Onyx-Conseil Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team in DWP Digital. As a Data Engineer, you will be responsible for developing, testing, maintaining, deploying, and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage.

Key Responsibilities
  • Design, develop, and deploy data-centric solutions using Hive SQL, Spark SQL, Python, PySpark, and Bash.
  • Work with a wide variety of structured and unstructured data to deliver high-quality data products.
  • Collaborate with cross-functional teams to ensure data security, integrity, and cloud-based technology.
What We Offer

We offer a competitive salary of up to £58,347, a brilliant civil service pension with employer contributions worth 28.97%, and a generous leave package starting at 26 days and rising to 27 days after one year. You will also have access to flexible working, discounts and savings on shopping, fun days out, and more, as well as interest-free loans to buy a bike or a season ticket.

We are committed to providing a supportive and inclusive work environment, with opportunities for professional development, coaching, mentoring, and career progression.

Requirements
  • Experience of developing, testing, maintaining, deploying, and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage.
  • Strong coding skills using Hive SQL, Spark SQL, Python, PySpark, and Bash.
  • Experience of working with a wide variety of structured and unstructured data.
Location

You will join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds, Manchester, Newcastle-upon-Tyne, and Sheffield, whichever is most convenient for you.

Hybrid Working

We work a hybrid model - you will spend some time working at home and some time collaborating face-to-face in a hub.

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Data Engineer OpportunityRise Technical Recruitment Limited is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing the company's data infrastructure.Key Responsibilities:Design and implement data ingestion pipelines using AzureBuild and maintain databases...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Data Engineer OpportunityRise Technical Recruitment Limited is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing the company's data infrastructure.Key Responsibilities:Design and implement data ingestion pipelines using AzureBuild and maintain databases...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom YourCode Recruitment Full time

    Senior Data Engineer (PowerBI)We are seeking a highly skilled Senior Data Engineer to join our team at YourCode Recruitment in Leeds. The ideal candidate will have extensive experience in PowerBI, data engineering, and a deep understanding of data warehousing and business intelligence.Key Responsibilities:Design, develop, and maintain data pipelinesCreate...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Job Title: Data EngineerJob Summary:Rise Technical Recruitment Limited is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data infrastructure, including data ingestion, CI/CD pipelines, and data governance policies.Key Responsibilities:Design and implement data...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Job Title: Data EngineerJob Summary:Rise Technical Recruitment Limited is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data infrastructure, including data ingestion, CI/CD pipelines, and data governance policies.Key Responsibilities:Design and implement data...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Data Engineer OpportunityRise Technical Recruitment Limited is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing the company's data infrastructure.Key Responsibilities:Design and implement data ingestion pipelines using AzureBuild and maintain databases...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Data Engineer OpportunityRise Technical Recruitment Limited is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing the company's data infrastructure.Key Responsibilities:Design and implement data ingestion pipelines using AzureBuild and maintain databases...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Pharmacy2U Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pharmacy2U Ltd. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining our data flows and systems.Key ResponsibilitiesDesign and implement data flows to connect production and analytical systems.Communicate with stakeholders to understand...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Pharmacy2U Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pharmacy2U Ltd. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining our data flows and systems.Key ResponsibilitiesDesign and implement data flows to connect production and analytical systems.Communicate with stakeholders to understand...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Pharmacy2U Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pharmacy2U Ltd. As a Data Engineer, you will play a critical role in designing, documenting, and delivering data flows that connect production and analytical systems.Key ResponsibilitiesDesign and implement data flows to connect production and analytical systems, ensuring...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Pharmacy2U Ltd Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pharmacy2U Ltd. As a Data Engineer, you will play a critical role in designing, documenting, and delivering data flows that connect production and analytical systems.Key ResponsibilitiesDesign and implement data flows to connect production and analytical systems, ensuring...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Data Engineer OpportunityRise Technical Recruitment Limited is seeking a skilled Data Engineer to join their team. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing the company's data infrastructure.Key Responsibilities:Design and implement data ingestion pipelines using AzureBuild and maintain databases...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Opportunity for a Data EngineerWe are seeking a highly skilled Data Engineer with experience in Azure to join our team at Rise Technical Recruitment Limited. As a Data Engineer, you will play a key role in designing, implementing, and optimizing our data infrastructure.About the RoleDesign and implement data ingestion pipelines using Azure...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Rise Technical Recruitment Limited Full time

    Exciting Opportunity for a Data EngineerWe are seeking a highly skilled Data Engineer with experience in Azure to join our team at Rise Technical Recruitment Limited. As a Data Engineer, you will play a key role in designing, implementing, and optimizing our data infrastructure.About the RoleDesign and implement data ingestion pipelines using Azure...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom twentyAI Full time

    Cloud Data Engineer OpportunitytwentyAI is partnering with a leading global insurance company to deliver innovative risk solutions across various sectors.This Data Engineer will play a key role in supporting the rollout of Master Data Management services and collaborating with the engineering team to develop code.Key Responsibilities:Support the rollout of...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    Job Title: Data EngineerLocation: Bath, Manchester, or Leeds - mostly remoteJob Type: Full-timeSalary: Competitive Salary + Bonus + Healthcare + Life Assurance + Income Protection + Shares Options + MoreAbout the Role:We are seeking a highly skilled Data Engineer to join our team in Bath, Manchester, or Leeds. As a Data Engineer, you will play a key role in...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    Job Title: Data EngineerLocation: Bath, Manchester, or Leeds - mostly remoteJob Type: Full-timeSalary: Competitive Salary + Bonus + Healthcare + Life Assurance + Income Protection + Shares Options + MoreAbout the Role:We are seeking a highly skilled Data Engineer to join our team in Bath, Manchester, or Leeds. As a Data Engineer, you will play a key role in...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom twentyAI Full time

    Cloud Data Engineer Opportunity at twentyAItwentyAI is partnering with a leading global insurance company to deliver innovative risk solutions across various sectors. We are seeking a talented Cloud Data Engineer to join our dynamic technology team in Leeds.This role will play a key part in supporting the roll-out of new Master Data Management services and...

  • Data Engineer

    3 weeks ago

    Leeds, Leeds, United Kingdom twentyAI Full time

    Cloud Data Engineer Opportunity at twentyAItwentyAI is partnering with a leading global insurance company to deliver innovative risk solutions across various sectors. We are seeking a talented Cloud Data Engineer to join our dynamic technology team in Leeds.This role will play a key part in supporting the roll-out of new Master Data Management services and...

  • Data Engineer

    4 weeks ago

    Leeds, Leeds, United Kingdom Onyx-Conseil Full time

    Job Title: Data EngineerJob Description:We are seeking a highly skilled Data Engineer to join our team in Bath, Manchester, or Leeds. As a Data Engineer, you will play a key role in designing, implementing, and optimizing our data infrastructure using Azure.Key Responsibilities:Design and implement data ingestion pipelines using Azure servicesBuild and...