Senior Data Engineer

1 month ago


London, UK, United Kingdom Prism Digital Full time

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / Charity


Rate: £500-650 per day

Duration: 6-12 months

IR35: Outside

Location: Remote with occasional travel to London (Once every two months max)


Essential skills required:

  • Azure – solid experience required of the Azure Data ecosystem
  • Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark
  • Azure Synapse - ESSENTIAL as is used heavily
  • Spark
  • Azure Data Lake / Data Bricks / Data Factory
  • Be happy to act as a lead and mentor to the other permanent Azure Data Engineers


This is the chance to work for a unique organisation Our client is a not-for-profit charity that reviews/certifies companies, governments and financial institutions for their environmental impact and awareness. Our client is the main global authority that certifies and monitors the environmental impact that companies/governments have on the natural environment. Essentially, they provide the equivalent of the “Fair Trade” sticker that you would see on a jar of coffee but for businesses and local governments.


The organisation is over 20 years old, headquartered in the UK with an office in central London and has 700 staff globally (100 circa in the UK).


You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps.


As this is a lead role 50% of your time will be leading and assisting the other data engineers and the other 50% will be hands-on with the tech. Due to the nature of our client’s product and service, they’re a huge data-centric organisation so dealing with larger data sets and managing this data is essential.


The tech stack you will be working on is:

  • Azure – a very solid Azure cloud native experience is essential
  • Data platforms on Azure; Synapse, Spark, Azure Data Factory
  • Python
  • Data design patterns, such as medallion architecture & data vault
  • SQL queries, views, stored procs, CTE etc – strong experience required
  • Terraform used for IaC
  • Azure DevOps used for CI/CD
  • DP-203 certification preferred but not essential


Specifics you will be working on in this contract:

  • Building data lakes

Implement medallion design

Created data standardisation and cleansing pipelines across zones/layers

Familiar with partitioning and efficient storage patterns

Work with high-volume pipelines in batch or streaming mode

  • Data Engineering

Configure Azure Synapse components such as integration runtimes, spark clusters and dedicated pools

Work with delta tables and Lakehouse architecture

Familiar with Synapse CI/CD

  • Azure Purview or another governance tool experience. Familiar with building Catalogs and lineage


This is an urgent contract, so if you are interested apply ASAP.


Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good / Charity


  • Senior Data Engineer

    2 weeks ago


    London, UK, UK, United Kingdom Data Idols Full time

    Senior Data EngineerSalary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand....

  • Senior Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Mentmore Full time

    Senior Data Engineer / Up to £95k + Benefits // Global Facilities Services BusinessSenior Data Engineer1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out a robust data platform on Databricks, with a primary focus on facilitating seamless...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Scalexperts Full time

    Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function.They are looking for a Senior Data Engineer to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all...

  • Senior Data Engineer

    1 month ago


    London,, UK, United Kingdom Xcede Full time

    SENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office. Commutable from London.)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Xcede Full time

    SENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office. Commutable from London.)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Anson McCade Full time

    Senior Data EngineerLocation: London (2 days a week in office)Salary: £75k - £90k (DOE)About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge technology to drive business...


  • London,, UK, United Kingdom Oho Group Ltd Full time

    A leading MediaTech is seeking a Senior Data Engineer to join their growing team!Onsite in their swish London officeDesign and building complex pipelines using SnowflakePython and JavaScript development Advancing Machine Learning across AWS and Azure platformsWorking alongside senior stakeholders and Data ScientistsThis is a great opportunity to not only...

  • Senior Data Engineer

    3 weeks ago


    London, UK, United Kingdom Fourier Ltd Full time

    A leading financial institution with around £50bn AUM is hiring a Senior Data Engineer be a key figure head in a brand new Data team. The role will allow you to collaborate with numerous teams throughout the firm, making a tangible impact though developing ETL pipelines from scratch, building critical data tools and contributing to the development and...


  • London, UK, United Kingdom Paritas Recruitment - Data & Tech Full time

    We are seeking a Data Architect to take the lead in a newly formed department within a trading house. Leading a multi disciplinary team, we are seeking individuals who can come in and make the decisions on future architecture designs, contribute to a wider data strategy and face off to a range of senior stakeholders across the business. Experience in other...


  • London,, UK, United Kingdom Oliver Bernard Full time

    JVM / Data Engineer - PermanentLooking for a Senior JVM/Data Engineer to work on a new project at a Fintech client of ours. Ideally looking for a Java or Kotlin Developer who has a strong understanding in the Data Engineering space.Client - FintechStack - Java, Kotlin, Python, Airflow, Snowflake, Terraform, Spark, AWS.1 day a week in the City of...

  • Senior Data Engineer

    1 month ago


    London,, UK, United Kingdom Burns Sheehan Full time

    Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Burns Sheehan Full time

    Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the...

  • Senior Data Engineer

    1 month ago


    London,, UK, United Kingdom MBN Solutions Full time

    Senior Data Engineer £50-£60k DOEMainly Remote working, in office twice a month in Exter offices. The company :Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier geospatial datasets, place us at...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom MBN Solutions Full time

    Senior Data Engineer £50-£60k DOEMainly Remote working, in office twice a month in Exter offices. The company :Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier geospatial datasets, place us at...


  • London,, UK, United Kingdom PURVIEW Full time

    Purview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Senior SAS Data EngineerLocation: London & EdinburghDuration: Permanent and ContractWork Mode: Fully remote with openness to travel occasionally when requiredWe are looking for strong Senior SAS Data Engineer...


  • London,, UK, United Kingdom PURVIEW Full time

    Purview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Senior SAS Data EngineerLocation: London & EdinburghDuration: Permanent and ContractWork Mode: Fully remote with openness to travel occasionally when requiredWe are looking for strong Senior SAS Data Engineer...

  • Senior Data Engineer

    1 month ago


    London,, UK, United Kingdom Movement8 Full time

    Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience.Work...

  • Senior Data Engineer

    4 weeks ago


    London,, UK, United Kingdom Movement8 Full time

    Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience.Work...

  • Senior Data Engineer

    2 weeks ago


    London,, UK, United Kingdom Amicus Full time

    Senior Data Platform Engineer – Python / AWS / Snowflake – Remote (UK) OR London I am partnered with an European BioTech start-up having recently secured the next round of funding they are looking to expand their Engineering steam with addition of multiple mid-Senior engineers.CompanyThe business specialises in building tools and systems to further the...

  • Senior Data Engineer

    1 month ago


    London,, UK, United Kingdom IC Resources Full time

    Senior Data Engineer (No Sponsorship Available)I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will have experience using Azure Platforms for consolidating data sources...