SC Cleared Databricks Data Engineer
2 weeks ago
Job DescriptionJob Title: SC Cleared Databricks Data Engineer - Azure CloudContract Type: Freelance/B2BDay Rate: Up to £400 a day inside IR35Location: Remote or hybrid (as agreed)Start Date: January 5th 2026Clearance required: Must be holding active SC ClearanceOverviewWe are seeking an experienced Databricks Data Engineer to design, build, and optimise large-scale data workflows within the Databricks Data Intelligence Platform.The role focuses on delivering high-performing batch and streaming pipelines using PySpark, Delta Lake, and Azure services, with additional emphasis on governance, lineage tracking, and workflow orchestration. Client information remains confidential.Key ResponsibilitiesBuild and orchestrate Databricks data pipelines using Notebooks, Jobs, and WorkflowsOptimise Spark and Delta Lake workloads through cluster tuning, adaptive execution, scaling, and cachingConduct performance benchmarking and cost optimisation across workloadsImplement data quality, lineage, and governance practices aligned with Unity CatalogDevelop PySpark-based ETL and transformation logic using modular, reusable coding standardsCreate and manage Delta Lake tables with ACID compliance, schema evolution, and time travelIntegrate Databricks assets with Azure Data Lake Storage, Key Vault, and Azure FunctionsCollaborate with cloud architects, data analysts, and engineering teams on end-to-end workflow designSupport automated deployment of Databricks artefacts via CI/CD pipelinesMaintain clear technical documentation covering architecture, performance, and governance configurationRequired Skills and ExperienceStrong experience with the Databricks Data Intelligence PlatformHands-on experience with Databricks Jobs and WorkflowsDeep PySpark expertise, including schema management and optimisationStrong understanding of Delta Lake architecture and incremental design principlesProven Spark performance engineering and cluster tuning capabilitiesUnity Catalog experience (data lineage, access policies, metadata governance)Azure experience across ADLS Gen2, Key Vault, and serverless componentsFamiliarity with CI/CD deployment for DatabricksSolid troubleshooting skills in distributed environmentsPreferred QualificationsExperience working across multiple Databricks workspaces and governed catalogsKnowledge of Synapse, Power BI, or related Azure analytics servicesUnderstanding of cost optimisation for data compute workloadsStrong communication and cross-functional collaboration skills
-
SC Cleared Python Data Engineer
2 weeks ago
Purley, United Kingdom Montash Full timeJob DescriptionJob Title: SC Cleared Python Data Engineer - Azure & PySparkContract Type: 12 Month ContractDay Rate: Up to £400 a day inside IR35Location: Remote or hybrid (as agreed)Start Date: January 5th 2026Clearance required: Must be holding active SC ClearanceOverviewWe are seeking an experienced Python Data Engineer to support the design,...
-
SC cleared Data Scientist/ML Engineer
5 days ago
Purley, United Kingdom fortice Full timeJob DescriptionI'm partnering with a specialist UK technology consultancy to support the hire of an experienced Contract Data Scientist/ML Engineer for a major Generative AI project within a secure public-sector environment.This is an opportunity to work on high-impact AI initiatives, helping to redesign complex human-driven processes through LLMs and...
-
SC Cleared
2 weeks ago
Purley, United Kingdom Synergize Consulting Ltd Full timeJob DescriptionWe are seeking an experienced SC Cleared SAP Plant Maintenance (PM) Functional Consultant to support a number of secure, large-scale SAP transformation programmes across the UK. This role is ideal for consultants with strong SAP PM expertise who have worked in Defence, Government, or other security-cleared environments and can operate...
-
SC Cleared Full Stack Engineer Developer REMOTE
2 weeks ago
Purley, United Kingdom TELSTRA Associates Full timeJob DescriptionA leading IT Consultancy is seeking a Full Stack Engineer Developer on a contract basis to work on a project with a Government department.You must hold an active SC Clearance The Full Stack Engineer Developer will be required to Design, build, test and operate secure, scalable, and accessible full-stack services. You will deliver high-quality,...
-
Dynatrace Consultant
5 days ago
Purley, United Kingdom Bench IT Limited Full timeJob DescriptionDynatrace Consultant (SC Cleared), £500 per day outside IR353 months rolling, Remote WorkingBench IT require an experienced Dynatrace Consultant to join a large organisation starting ASAP working remotely with occasional site visits. The Consultant will be responsible to define and own the observability strategy for enterprise systems,...
-
Technical Architect
7 days ago
Purley, United Kingdom AdRoc Group Full timeJob DescriptionWe are looking for an experienced Technical Architect to join one of our public sector clients.Rate: up to £500 (Outside IR35) Duration: 31/03/26 (extensions likely)Location: UKTravel: RemoteStart date: ASAPClearance: Active SC Clearance is a mustExperience Knowledge of JVM Back End, JS and Node Front End and AWS. While these are not hands-on...
-
VMWare Engineer
2 weeks ago
Purley, United Kingdom Curo Services Full timeJob DescriptionVMWare Engineer - VCF, VCP, PowerShell, SC ClearanceOur Global Enterprise client is looking for a VMware Specialist Engineer to join the team who has strong VMware Cloud Foundation 5 skills and experience.Start Date: 15th January 2026Duration: 120 days (initially)Pay Rate: £466 p/d (PLEASE NOTE: Employer NI is paid for by the client)Total...
-
Senior Backend Developer
2 weeks ago
Purley, United Kingdom Ark Data Centres Full timeJob DescriptionThe roleOverview & purposeReporting to the Data Strategy Lead, the Senior Backend Developer will help design and build software solutions in organised, testable and reusable manner. While Ark Data Centres have offices in Farnborough, Corsham and London, this role is 100% remote and the candidate can work anywhere in the UK.Key responsibilities...
-
Purley, United Kingdom Staffworx Limited Full timeJob DescriptionData & AI Senior Consultants Location - We are flexible: onsite, hybrid or fully remote, depending on what works for you and the client, UK or Netherlands based.What you will actually be doingThis is not a role where you build clever models that never get used. Your focus is on creating measurable value for clients using data science, machine...
-
SC cleared Senior CyberArk Architect SME
2 weeks ago
Purley, United Kingdom Synergize Consulting Ltd Full timeJob DescriptionOur client is seeking an experienced Senior CyberArk Architect SME to lead the design, integration, optimisation, and ongoing operations of CyberArk Privileged Access Management (PAM) solutions within a large, complex, secure environment. This is a business-critical role requiring deep CyberArk expertise, strong architectural capability, and...