Senior Engineer, Data Engineering
7 days ago
Senior Data Engineer - Azure & Databricks Lakehouse Glasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer Business
No sponsorship/ relocation provided sadly
Our incredibly successful client, consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into a fully automated Azure Enterprise Landing Zone + Databricks Lakehouse .
They are building a modern data platform from the ground up using Lakeflow Declarative Pipelines , Unity Catalog , and Azure Data Factory , and this role sits right at the heart of that transformation.
This is a rare opportunity to join early, influence architecture, and help define engineering standards, pipelines, curated layers and best practices that will support Operations, Finance, Sales, Logistics and Customer Care.
Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines , PySpark , and Spark SQL across a full Medallion Architecture (Bronze - Silver - Gold) .
Implement ingestion patterns for files, APIs, SaaS platforms (e.g. subscription billing), SQL sources, SharePoint and SFTP using ADF + metadata-driven frameworks .
Apply Lakeflow expectations for data quality, schema validation and operational reliability.
Curated Data Layers & Modelling
Deliver star schemas, harmonisation logic, SCDs and business marts to power high-performance Power BI datasets .
Design and optimise orchestration using Lakeflow Workflows and Azure Data Factory .
Implement monitoring, alerting, SLAs/SLIs, runbooks and cost-optimisation across the platform.
DevOps & Platform Engineering
Build CI/CD pipelines in Azure DevOps for notebooks, Lakeflow pipelines, SQL models and ADF artefacts.
Ensure secure, enterprise-grade platform operation across Dev Prod , using private endpoints, managed identities and Key Vault.
Work closely with BI/Analytics teams to deliver curated datasets powering dashboards across the organisation.
Influence architecture decisions and uplift engineering maturity within a growing data function.
Databricks : Lakeflow Declarative Pipelines, Workflows, Unity Catalog, SQL Warehouses
Azure : ADLS Gen2, Data Factory, Key Vault, vNets & Private Endpoints
Languages : PySpark, Spark SQL, Python, Git
DevOps : Azure DevOps Repos, Pipelines, CI/CD
Power BI, Fabric
Significant commercial experience of Data Engineering with years delivering production workloads on Azure + Databricks .
Strong PySpark/Spark SQL and distributed data processing expertise.
Comfort with Git, CI/CD, automated deployments and modern engineering standards.
Databricks Certified Data Engineer Associate
-
Senior Engineer, Data Engineering
7 days ago
Paisley, Renfrewshire, United Kingdom RES Full timeWe're the world's largest independent renewable energy company. We're driven by a simple yet powerful vision: to create a future where everyone has access to affordable, zero carbon energy. Because we're tackling some of the world's toughest problems, we need the very best people to help us. They're our most important asset so that's why we continually...
-
Engineer / Senior Civil Engineer - Drainage
7 days ago
Paisley, Renfrewshire, United Kingdom Turner Lovell Full timeSenior Civil Design Engineer / Civil Design Engineer Grid Connections & Substations Scotland (Hybrid or Remote Working) Salary: £50,000 - £80,000 + benefits (depending upon experience). Turner Lovell is recruiting for a Senior Civil Design Engineer to join a rapidly growing engineering design consultant and grid connection contractor expanding...
-
Senior Quality Engineer
3 weeks ago
Paisley, Renfrewshire, United Kingdom Altrad UK, Ireland & Nordics Full timeJob Title: Senior Quality Engineer Location: Glasgow Contract Type: Permanent We are the leading provider of infrastructure services. At Altrad, we transform our nation's critical infrastructure to operate safely and sustainably. With over 11,000 talented people, we provide the full spectrum of critical engineering and construction services for industries...
-
Data Operations Manager
3 weeks ago
Paisley, Renfrewshire, United Kingdom Data Science Talent Full timeData Operations Manager Hybrid - two days per week onsite in Glasgow £75k - £85k + bonus & benefits --- Step into a newly defined data operations management position at the centre of a major data transformation. You'll lead a small, capable team responsible for the reliability, performance, and observability of modern data platforms that power decisions...
-
Senior Mechanical Engineer
7 days ago
Paisley, Renfrewshire, United Kingdom Blue Lynx Full timeOur client is a global engineering services provider specialising in the maintenance and optimisation of industrial gas turbines used in power generation and the energy sector. With a focus on major OEM technologies, they deliver comprehensive field services, inspections, and overhauls to clients worldwide. They are now seeking an experienced and dedicated ...
-
Senior DevOps Engineer
7 days ago
Paisley, Renfrewshire, United Kingdom Provn Full timeSenior DevOps Engineer We're looking for an experienced Senior DevOps Engineer to join a client responsible for changing the face of modern life sciences. You'll help shape their internal infrastructure, manage and maintain containerisation processes, and aid in advancing newly established technologies. This role is ideal for someone who thrives in highly...
-
Senior Mechanical Engineer
7 days ago
Paisley, Renfrewshire, United Kingdom Blue Lynx Full timeOur client is a global engineering services provider specialising in the maintenance and optimisation of industrial gas turbines used in power generation and the energy sector. With a focus on major OEM technologies, they deliver comprehensive field services, inspections, and overhauls to clients worldwide. They are now seeking an experienced and dedicated...
-
Senior Mechanical Engineer
7 days ago
Paisley, Renfrewshire, United Kingdom Blue Lynx Full timeOur client is a global engineering services provider specialising in the maintenance and optimisation of industrial gas turbines used in power generation and the energy sector. With a focus on major OEM technologies, they deliver comprehensive field services, inspections, and overhauls to clients worldwide. They are now seeking an experienced and dedicated...
-
Senior Software Engineer — Linux Engineer
2 weeks ago
Paisley, Renfrewshire, United Kingdom PACE Anti-Piracy Europe Ltd Full timeWe are seeking a Senior Software Engineer with deep experience developing and porting software to Linux systems. The ideal candidate has a proven history of shipping commercial software products and is comfortable working across multiple layers of the stack - from system-level components through to application and UI frameworks. This role will be based in...
-
Lead Developer
7 days ago
Paisley, Renfrewshire, United Kingdom JPMorganChase Full timeAre you ready to take your software engineering career to the next level? Join JPMorgan Chase as a Software Engineer III within the Corporate Technology Engineering Platforms and Experience team. As a seasoned member of an agile team, you'll design and deliver market-leading technology products securely and scalably, supporting the firm’s business...