![Prism Digital](https://media.trabajo.org/img/noimg.jpg)
Senior Data Engineer
1 month ago
Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good / Charity
Rate: £500-650 per day
Duration: 6-12 months
IR35: Outside
Location: Remote with occasional travel to London (Once every two months max)
Essential skills required:
- Azure – solid experience required of the Azure Data ecosystem
- Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark
- Azure Synapse - ESSENTIAL as is used heavily
- Spark
- Azure Data Lake / Data Bricks / Data Factory
- Be happy to act as a lead and mentor to the other permanent Azure Data Engineers
This is the chance to work for a unique organisation Our client is a not-for-profit charity that reviews/certifies companies, governments and financial institutions for their environmental impact and awareness. Our client is the main global authority that certifies and monitors the environmental impact that companies/governments have on the natural environment. Essentially, they provide the equivalent of the “Fair Trade” sticker that you would see on a jar of coffee but for businesses and local governments.
The organisation is over 20 years old, headquartered in the UK with an office in central London and has 700 staff globally (100 circa in the UK).
You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps.
As this is a lead role 50% of your time will be leading and assisting the other data engineers and the other 50% will be hands-on with the tech. Due to the nature of our client’s product and service, they’re a huge data-centric organisation so dealing with larger data sets and managing this data is essential.
The tech stack you will be working on is:
- Azure – a very solid Azure cloud native experience is essential
- Data platforms on Azure; Synapse, Spark, Azure Data Factory
- Python
- Data design patterns, such as medallion architecture & data vault
- SQL queries, views, stored procs, CTE etc – strong experience required
- Terraform used for IaC
- Azure DevOps used for CI/CD
- DP-203 certification preferred but not essential
Specifics you will be working on in this contract:
- Building data lakes
Implement medallion design
Created data standardisation and cleansing pipelines across zones/layers
Familiar with partitioning and efficient storage patterns
Work with high-volume pipelines in batch or streaming mode
- Data Engineering
Configure Azure Synapse components such as integration runtimes, spark clusters and dedicated pools
Work with delta tables and Lakehouse architecture
Familiar with Synapse CI/CD
- Azure Purview or another governance tool experience. Familiar with building Catalogs and lineage
This is an urgent contract, so if you are interested apply ASAP.
Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good / Charity
-
Senior Data Engineer
2 weeks ago
London, UK, UK, United Kingdom Data Idols Full timeSenior Data EngineerSalary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased volumes of data and demand....
-
Senior Data Engineer
2 weeks ago
London,, UK, United Kingdom Mentmore Full timeSenior Data Engineer / Up to £95k + Benefits // Global Facilities Services BusinessSenior Data Engineer1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out a robust data platform on Databricks, with a primary focus on facilitating seamless...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom Scalexperts Full timeScalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function.They are looking for a Senior Data Engineer to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all...
-
Senior Data Engineer
1 month ago
London,, UK, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office. Commutable from London.)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom Xcede Full timeSENIOR DATA ENGINEER(Hertfordshire HQ – circa x1 day a week in office. Commutable from London.)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom Anson McCade Full timeSenior Data EngineerLocation: London (2 days a week in office)Salary: £75k - £90k (DOE)About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge technology to drive business...
-
Senior Data Engineer
7 days ago
London,, UK, United Kingdom Oho Group Ltd Full timeA leading MediaTech is seeking a Senior Data Engineer to join their growing team!Onsite in their swish London officeDesign and building complex pipelines using SnowflakePython and JavaScript development Advancing Machine Learning across AWS and Azure platformsWorking alongside senior stakeholders and Data ScientistsThis is a great opportunity to not only...
-
Senior Data Engineer
3 weeks ago
London, UK, United Kingdom Fourier Ltd Full timeA leading financial institution with around £50bn AUM is hiring a Senior Data Engineer be a key figure head in a brand new Data team. The role will allow you to collaborate with numerous teams throughout the firm, making a tangible impact though developing ETL pipelines from scratch, building critical data tools and contributing to the development and...
-
Head of Data Architecture
3 weeks ago
London, UK, United Kingdom Paritas Recruitment - Data & Tech Full timeWe are seeking a Data Architect to take the lead in a newly formed department within a trading house. Leading a multi disciplinary team, we are seeking individuals who can come in and make the decisions on future architecture designs, contribute to a wider data strategy and face off to a range of senior stakeholders across the business. Experience in other...
-
Senior Data Engineer
1 week ago
London,, UK, United Kingdom Oliver Bernard Full timeJVM / Data Engineer - PermanentLooking for a Senior JVM/Data Engineer to work on a new project at a Fintech client of ours. Ideally looking for a Java or Kotlin Developer who has a strong understanding in the Data Engineering space.Client - FintechStack - Java, Kotlin, Python, Airflow, Snowflake, Terraform, Spark, AWS.1 day a week in the City of...
-
Senior Data Engineer
1 month ago
London,, UK, United Kingdom Burns Sheehan Full timeSenior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom Burns Sheehan Full timeSenior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the...
-
Senior Data Engineer
1 month ago
London,, UK, United Kingdom MBN Solutions Full timeSenior Data Engineer £50-£60k DOEMainly Remote working, in office twice a month in Exter offices. The company :Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier geospatial datasets, place us at...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom MBN Solutions Full timeSenior Data Engineer £50-£60k DOEMainly Remote working, in office twice a month in Exter offices. The company :Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier geospatial datasets, place us at...
-
Senior SAS Data Engineer
1 month ago
London,, UK, United Kingdom PURVIEW Full timePurview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Senior SAS Data EngineerLocation: London & EdinburghDuration: Permanent and ContractWork Mode: Fully remote with openness to travel occasionally when requiredWe are looking for strong Senior SAS Data Engineer...
-
Senior SAS Data Engineer
4 weeks ago
London,, UK, United Kingdom PURVIEW Full timePurview is hiring Senior SAS Data Engineerwith one of our valued clients. If you're interested, please reply for more details. Job Details:Role: Senior SAS Data EngineerLocation: London & EdinburghDuration: Permanent and ContractWork Mode: Fully remote with openness to travel occasionally when requiredWe are looking for strong Senior SAS Data Engineer...
-
Senior Data Engineer
1 month ago
London,, UK, United Kingdom Movement8 Full timeSenior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience.Work...
-
Senior Data Engineer
4 weeks ago
London,, UK, United Kingdom Movement8 Full timeSenior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience.Work...
-
Senior Data Engineer
2 weeks ago
London,, UK, United Kingdom Amicus Full timeSenior Data Platform Engineer – Python / AWS / Snowflake – Remote (UK) OR London I am partnered with an European BioTech start-up having recently secured the next round of funding they are looking to expand their Engineering steam with addition of multiple mid-Senior engineers.CompanyThe business specialises in building tools and systems to further the...
-
Senior Data Engineer
1 month ago
London,, UK, United Kingdom IC Resources Full timeSenior Data Engineer (No Sponsorship Available)I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal candidate will have experience using Azure Platforms for consolidating data sources...