Data Engineer

1 week ago


Leeds, United Kingdom DWP Digital Full time

Digital with Purpose.

DWP Digital is seeking a Data Engineer who is passionate about utilising cutting-edge technologies to deliver impactful data products.

DWP is the UK's largest department, every year we pay over £195 billion to over 20 million citizens.

DWP services cover everything from helping children & families right through to supporting relatives of lost loved ones.

We help people find jobs, and support people financially when they are unable to work due to health conditions and make ensure everybody has the money they need to live during their retirement years.

The scale of what we do is outstanding, and our purpose is unique. We'd love you to join us.

Your role:

You'll be part of our DataWorks team. We deliver proactive, innovative, and insightful data products in an Agile environment.

DataWorksis an AWS platform that provides Universal Credit data to data scientists and analysts for reporting and statistical purposes.

The team is currently working on two key remits that involve technically standardising the platform to be DWP digitally compliant and providing users with the data they need to evaluate and improve the Universal Credit service's performance.

You'll play a vital role in code development activities for the delivery of data transformation products.

You'll decide the right approach, and integrate different data sources. You'll make sure that appropriate data quality, integrity and alerting is built into all solutions.

You'll conduct proof of concept and discovery work and evaluate proposed changes that might impact data performance, models, or reports.

You will also coach and mentor more junior colleagues, helping to build data engineering knowledge and capability within the team and across government.

Essential criteria:

  • Experience of developing, testing, maintaining, deploying, and supporting efficient, scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage
  • Strong coding skills using Python, PySpark, Hive SQL and Spark SQL
  • Experience of working with a wide variety of structured and unstructured data

It's also great if you have the following (if not, don't worry, you'll have lots of opportunity to learn skills like this here):

  • Knowledge or experience of the following tools: Hue, GitHub/Lab, Azkaban (or similar scheduling tools), CI/CD (Concourse or similar), R-Studio, Juypter-Lab, Kafka and Bash

Details. Wages. Perks.

You'll join us based at one of our brilliant digital hubs in either Blackpool, Leeds, Newcastle or Sheffield .

We also have all the tools and tech we need to enable our people to work flexibly. We operate a hybrid working model with a mix of home working and some time in the office.

In return for your skills, we offer a competitive salary of up to £43,347 . There is also a Digital Allowance of up to £15,000 per annum available for exceptional candidates.

You'll be eligible for a brilliant civil service pension with employer contributions worth 28.97% (worth up to £12,557 a year).

You'll get a generous leave package starting at 26 days, plus all the usual bank holidays, and the option to take extra days off on flexi leave.

We also have a broad benefits package built around your work-life balance which includes:

  • Flexible working, flexi hours and flexi days
  • Hybrid working: some time in a hub with the team, some time at home
  • Family-friendly policies
  • Time off volunteering and charitable giving
  • Bring your authentic self to work with 'I Can Be Me in DWP'
  • Discounts and savings on shopping, fun days out and more
  • Interest-free loans to buy a bike or a season ticket
  • Sports and social activities
  • Working in an award-winning environment and culture
  • Professional development, coaching, mentoring and career progression opportunities

Click 'Apply' for more information and to start an application on Civil Service Jobs.

Please note, this role requires you to pass Security Check clearance


ADZN1_UKTJ


  • Data Centre Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Abs Data Full time

    Job title: Data Centre Engineer – PART TIME Company: Salute Job description : Are you Data Center Facility Engineer looking for a great opportunity but only available part time? Salute has several great opportunities in our key locations – supporting critical facilities – working on a 1 in 3 week call out rota.Salute is a global leader in...

  • Data Engineer

    3 weeks ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **DATA ENGINEER** **Coventry 1x week** **Up to £50,000 per annum** **THE COMPANY** This company is one of the largest electrical wholesalers in the UK, which has now branched out to the USA, and is turning over $3 billion per year! They work with businesses and independent customers to provide the highest service and pride themselves ontheir fantastic...


  • Leeds, United Kingdom ON Data Staffing Full time

    We are seeking a dynamic and experienced Data Engnieering professional to join our client, a growing consultancy, as a Data Engineering Manager.As Data Engineering Manager, you will play a pivotal role in driving the success of our client's Data Engineering practice through your expertise in presales, strong technical acumen, consulting skills, and effective...

  • Lead Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    Lead Data EngineerUp to £100,000 per annumLocation - Remote - attend office in London once every 3 weeksURGENT HIRE Lead Data Engineer sought for a well-established insurance companyThe CompanyThis company is a fast-growing data-focused general insurance provider. They offer a range of products and services, which include car, bike, van, and home insurance...

  • Senior Data Engineer

    3 weeks ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior Data Engineer** **Fully Remote** **Up to £85, 000** **Permanent** A major telecommunications company is looking for a Data Engineer to join them and assist with their migration to AWS. **The Company** An exciting opportunity for a Senior Data Engineer, or an experienced Data Engineer looking for their next career step, has opened up in a...

  • Senior Data Engineer

    3 weeks ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Senior Data Engineer** **Remote - 1 day per month in London per month** **Up to £80, 000** **Permanent** An opportunity for a Senior Data Engineer has opened up at a massive media company, who are looking to build out their APIs and query the datasets. **The Company** An excellent opportunity for a Senior Data Engineer to join a prestigious media...

  • Lead Data Engineer

    1 month ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **Lead Data Engineer** **Up to £95,000 per annum** **Location** - Fully remote We have a fantastic opportunity for a Lead Data Engineer! **The Company** This client operates within the aviation industry and is one of the UK's leading service providers. They have a network of over 1000 routes across 35 countries. They lead the industry in data, digital,...

  • Head of Data

    4 weeks ago


    Leeds, United Kingdom Harnham - Data & Analytics Recruitment Full time

    **HEAD OF DATA** **REMOTE (MUST be UK based)** **Up to £150,000 + 15% bonus** **THE COMPANY** I'm hiring for a Head of Data to join a B2B food-tech start-up business that uses AI to match food and catering to certain environments (e.g. schools and hospitals). The role reports to the Head of DevOps and the role is a stand-alone, with it being the first...

  • Data Engineer

    2 weeks ago


    Leeds, United Kingdom SPG Resourcing Full time

    Salary: 70k Location: Home-based (UK only) with some travel within the UK Start Date: Immediate An innovative Professional Services company is seeking a highly skilled and experienced Senior Azure Data Engineer to join their team and play a pivotal role in their data modernisation journey. Amongst other initiatives, you will be a part of a wider team of...

  • Data Engineer

    2 days ago


    Leeds, United Kingdom SPG Resourcing Full time

    Day Rate: £400-£500 Location: Home-based (UK only) with some travel within the UK Start Date: Immediate An innovative Professional Services company is seeking a highly skilled and experienced Senior Azure Data Engineer to join their team and play a pivotal role in their data modernisation journey. Amongst other initiatives, you will be a part of a wider...

  • Data Engineer

    3 weeks ago


    Leeds, United Kingdom Harnham Full time

    **DATA ENGINEER** **UP TO £55,000** **REMOTE** **THE COMPANY**: A global information and insights company that handles data from banks across the UK and enables companies to make better financial decisions. **THE ROLE**: The role will involve: - Integrating data from various sources - Cleaning, processing, and transforming data - Designing, building,...

  • Data Engineer

    2 weeks ago


    Leeds, United Kingdom SPG Resourcing Full time

    An innovative Professional Services company is seeking a highly skilled and experienced Senior Azure Data Engineer to join their team and play a pivotal role in their data modernisation journey.Amongst other initiatives, you will be a part of a wider team of data engineers who can design, build, and maintain robust data pipelines and solutions on the...

  • Data Engineer

    2 weeks ago


    Leeds, United Kingdom SPG Resourcing Full time

    An innovative Professional Services company is seeking a highly skilled and experienced Senior Azure Data Engineer to join their team and play a pivotal role in their data modernisation journey.To be considered for an interview, please make sure your application is full in line with the job specs as found below.Amongst other initiatives, you will be a part...

  • Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Interface Recruitment UK Full time

    Job Title : Senior Data EngineerThe Role:Chance to work with Cloud technology Big data environment Pioneering technology Truly creative / studio environment Flexbility Leeds City location but with free parking Friendly team with a one for all attitude Summary of position The senior data engineer will be working across our client and SaaS product...

  • Data Engineer

    4 weeks ago


    Leeds, United Kingdom BJSS Full time

    About UsnWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    2 weeks ago


    Leeds, Leeds, United Kingdom Fruition IT Full time

    Job DescriptionData EngineerLeeds - on site 2x per weekup to £55,000Looking to join a dynamic team in the financial sector? Fruition IT are looking for an experienced Data Engineer to join a leading company specializing in financial solutions.Working closely with the Senior Data Engineer and Architects, you will play a crucial role in their journey of...

  • Data Engineer

    1 month ago


    Leeds, United Kingdom BJSS Full time

    Job Description About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won...

  • Data Engineer

    4 weeks ago


    Leeds, United Kingdom BJSS Full time

    About UsWe’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day.In the last 30 years we won several awards,...

  • Data Engineer

    1 month ago


    Leeds, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...

  • Data Engineer

    1 month ago


    Leeds, United Kingdom BJSS Full time

    About Us We’re an award-winning innovative tech consultancy - a team of creative problem solvers. Since 1993 we’ve been finding better, more sustainable ways to solve complex technology problems for some of the world’s leading organisations and delivered solutions that millions of people use every day. In the last 30 years we won several awards,...