Databricks Data Engineer Azure Cloud
4 days ago
Databricks Data Engineer Azure Cloud & Performance Optimization£400-£458pd (Inside IR35)SC Clearance is EssentialRemoteOverview We are seeking a Databricks Data Engineer experienced in building high-quality data pipelines and optimizing large-scale workloads on the Databricks Data Intelligence Platform. The ideal candidate is strong in PySpark, Delta Lake, Azure services, workflow automation, and performance tuning.Key ResponsibilitiesBuild and maintain scalable batch and streaming pipelines using Databricks notebooks, Jobs, and Workflows.Optimize Spark and Delta Lake performance through cluster tuning, efficient configurations, AQE, and caching.Run performance tests and ensure workloads are cost-efficient and reliable.Apply data quality, lineage, and access controls using Unity Catalog and governance best practices.Develop reusable PySpark ETL and data transformation code.Manage Delta Lake tables with ACID transactions, schema evolution, and time-travel capabilities.Integrate Databricks with Azure ADLS, Key Vault, Azure Functions, and related services.Work with architects and analysts to design end-to-end data solutions for analytics and ML.Support CI/CD automation for Databricks via Azure DevOps or similar tools.Maintai...
-
Cloud Data Engineer
3 days ago
Greater London, United Kingdom Betway Group Full timeA leading digital gaming company in the UK seeks a Data Engineer to modernise their data infrastructure. This role includes designing scalable data solutions using Azure and Databricks, supporting migration initiatives, and building CI/CD pipelines. The ideal candidate will have strong experience in C# and .NET, cloud-native development, and a proactive...
-
Databricks Data Engineer
6 days ago
London Area, United Kingdom NTT DATA Full time £80,000 - £120,000 per yearThe team you'll be working with:We are seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. The successful candidate will have deep expertise in building scalable data pipelines, optimizing Lakehouse architectures and enabling advanced analytics and AI use cases on the Databricks platform. This role is critical in building and...
-
Data Engineer
2 weeks ago
London, United Kingdom SR2 Full time**Data Engineer - Azure - Databricks** Data Engineer required by a consultancy to support an in-flight data transformation programme. The end client is a major healthcare provider who is undergoing a large migration. **Skills**: - Python - Apache Spark - SQL - Databricks - Azure Data Factory This is an urgent role offering a quick turnaround and start.
-
Databricks Data Engineer
1 week ago
King William Street, London, ECN , United Kingdom Ntt Data Full time £60,000 - £120,000 per yearThe team you';ll be working with:We are seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. The successful candidate will have deep expertise in building scalable data pipelines, optimizing Lakehouse architectures and enabling advanced analytics and AI use cases on the Databricks platform. This role is critical in building...
-
Data Engineer
4 weeks ago
City of London, United Kingdom Omnis Partners Full time📍London💼 Full Time | Hybrid (2-3 days in office)💰Up to £75,000 + 20% BonusOmnis Partners is proud to represent a leading data and AI consultancy that is driving transformation across industries. Our client empowers organisations to harness the full potential of their data, reducing costs, mitigating risk, and uncovering new revenue opportunities...
-
Data Engineer
4 weeks ago
City of London, Greater London, United Kingdom Omnis Partners Full time📍London 💼 Full Time | Hybrid (2-3 days in office)💰Up to £75,000 + 20% Bonus Omnis Partners is proud to represent a leading data and AI consultancy that is driving transformation across industries. Our client empowers organisations to harness the full potential of their data, reducing costs, mitigating risk, and uncovering new revenue opportunities...
-
Databricks Data Engineer
1 week ago
London, Greater London, United Kingdom EXL Full time £60,000 - £120,000 per yearDescriptionEXL (NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations for the world's...
-
Senior Data Engineer
2 weeks ago
London, United Kingdom Crimson Full timeSenior Data Engineer - Azure Databricks/ SC Clearance - ContractActive SC Clearance is required for this position Hybrid working - 3 days / week on site required Up to £620 / day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data...
-
Senior Data Engineer
2 weeks ago
London, United Kingdom Crimson Full timeSenior Data Engineer - Azure Databricks/ SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days / week on site required Up to £620 / day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data...
-
Remote Senior Data Engineer
4 days ago
City Of London, United Kingdom Nasstar Full timeA leading cloud services provider is looking for a Senior Data Engineer to design and implement a robust cloud-based data platform. The role involves developing ETL processes, collaborating with architects for system integration, and ensuring data quality. The ideal candidate has strong expertise in Azure data tools, and enjoys working in a remote team....