Python Data Engineer Azure

6 days ago


London, United Kingdom Brightbox GRP Full time

Python Data Engineer Azure & PySpark - SC ClearedContract£400-£458pd (Inside IR35)SC Clearance is EssentialSummary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high-quality, test-driven code in a cloud environment.What youll doBuild and maintain Python/PySpark pipelines for data ingestion, processing, and validation.Write unit and BDD tests using Behave, including mocking and patching.Create and optimize Delta Lake tables for reliable, performant data storage.Use Docker to manage consistent development, testing, and deployment environments.Build configurable, parameter-driven code for modular data solutions.Work with Azure Functions, Key Vault, and Blob Storage for cloud-based workflows.Collaborate with architects, data scientists, and DevOps on CI/CD and deployment.Tune and troubleshoot Spark jobs in production.Document solutions and follow cloud security and governance best practices.Skills you needStrong Python skills with a focus on clean, test-driven code.Experience writing Behave tests and using mocking/patching techniques....


  • Data Engineer

    11 hours ago


    London, United Kingdom CPS Group Full time

    Data Engineer - Python - Spark / DataBricks - Azure DevOps CPS Group are currently working with a large organization who are looking to secure the services of an experienced Data Engineer to provide assistance on a critical project for the next 6 months Role: Data Engineer - Python - Spark / DataBricks - Azure DevOps Rate: £600 per day Location: UK - Fully...


  • London, Greater London, United Kingdom Montash Full time £200,000 - £800,000 per year

    Job Title:SC Cleared Python Data Engineer – Azure & PySparkContract Type:12 Month ContractDay Rate:Up to £400 a day inside IR35Location:Remote or hybrid (as agreed)Start Date:January 5th 2026Clearance required:Must be holding active SC ClearanceWe are seeking an experienced Python Data Engineer to support the design, development, and optimisation of...


  • London, United Kingdom Method Resourcing Full time

    **Data Engineer | Mid Level | Consultancy | London | Hybrid | Azure | Python | Spark | ETL | SQL | £45,000 - £60,000** Are you an Azure specialist? Could you see yourself working in a team that previously delivered the largest Azure implementation project EVER? Method Resourcing is very pleased to say that we've partnered with the fastest-growing,...

  • Azure Data Engineer

    2 weeks ago


    London, United Kingdom Method Resourcing Full time

    **Data Engineer | Azure l ADF l Data warehouse l Snowflake l Python l £550 - £575 PD l Outside IR35 l 6 months** Method Resourcing are partnering with a financial start-up to build a brand-new streaming data platform in Azure. - Experience building data warehouses using Snowflake - ETL pipelines - Python - Strong Stakeholder management experience - Data...

  • Azure Data Engineer

    1 week ago


    City of London, United Kingdom BCT Resourcing Full time

    Azure Data Engineer | Financial Services Client City of London £60,000 - £80,000 per annum Company client is working with a renowned Financial Services business looking to hire a Senior Data Engineer to join the Data team. This is an opportunity to work with a technology and data-focused business who's size demands agility and gives you a chance to help...

  • Azure Data Engineer

    11 hours ago


    London, United Kingdom BCT Resourcing Full time

    **Azure Data Engineer - Outside IR35 Contract** **Location: London - Hybrid (3 days p/week in London)** **Daily Rate: £500 - £600 p/day** I am currently working with a London based, up and coming, Insurance organisation that is looking for a talented Azure Data Engineer to join their Insight team. The Data Engineer will be working within the technology...

  • Data Engineer

    1 week ago


    London, United Kingdom Data Idols Full time

    **Data Engineer** Data Idols are proud to be working with a growing veterinary business who are extremely data driven and have a great mission to use data to improve the welfare of animals. They have a revolutionary data team who want to be recognised as the UK's leadingveterinary group and are home to some of the best clinicians world-wide; would you like...


  • London, United Kingdom eFinancialCareers Full time

    **Key Requirements**: - Significant experience as a Data Engineering Lead with strong people management and stakeholder management skills. - Excellent understanding of modern code development practices and cloud data solutions and principles - Experience of ETL technical design, automated data quality testing, QA and documentation, data warehousing, data...

  • Azure Data Engineer

    6 hours ago


    London, United Kingdom Recann Full time

    OverviewAzure Data Engineer – Hybrid / London – Up to £70k + BenefitsRecann is recruiting on behalf of a leading international professional services firm seeking a skilled and proactive Azure Data Engineer to join its collaborative Data team. This role will be at the forefront of optimising the organisation’s data infrastructure on Microsoft Azure,...


  • London, United Kingdom Experis Full time

    Python Azure AI Engineer 6 Months Telford 2 days a week £519As an AI Engineer within the programme, you will be part of a multidisciplinary team driving digital transformation for one of the UK's most critical government departments. This role focuses on designing, developing, and deploying AI-driven solutions to modernise legacy systems, enhance...