Senior Data Engineer
1 week ago
Role Title: Sr. Databricks Engineer
Location: Glasgow
Duration: 31/12/2026
Days on site: 2-3
MUST BE PAYE THROUGH UMBRELLA
Role Description:
We are currently migrating our data pipelines from AWS to Databricks, and are seeking
a Senior Databricks Engineer to lead and contribute to this transformation. This is a
hands-on engineering role focused on designing, building, and optimizing scalable data
solutions using the Databricks platform.
Key Responsibilities:
• Lead the migration of existing AWS-based data pipelines to Databricks.
• Design and implement scalable data engineering solutions using Apache Spark on
Databricks.
• Collaborate with cross-functional teams to understand data requirements and translate
them into efficient pipelines.
• Optimize performance and cost-efficiency of Databricks workloads.
• Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.
• Ensure data quality and reliability through robust unit testing and validation
frameworks.
• Implement best practices for data governance, security, and access control within
Databricks.
• Provide technical mentorship and guidance to junior engineers.
Must-Have Skills:
• Strong hands-on experience with Databricks and Apache Spark (preferably PySpark).
• Proven track record of building and optimizing data pipelines in cloud environments.
• Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM,
and VPC.
• Proficiency in Python for data engineering tasks.
• Familiarity with GitLab for version control and CI/CD.
• Strong understanding of unit testing and data validation techniques.
Preferred Qualifications:
• Experience with Databricks Delta Lake, Unity Catalog, and MLflow.
• Knowledge of CloudFormation or other infrastructure-as-code tools.
• AWS or Databricks certifications.
• Experience in large-scale data migration projects.
• Background in Finance Industry.
-
Senior Data Engineer
4 days ago
Glasgow, Glasgow City, United Kingdom Alphayotta Full timeWe are seeking experiencedSenior Data Engineer (with Power BI expertise) at GlasgowPlease Note: No VISA Sponsorship.Senior Data Engineer (with Power BI expertise)Location: GlasgowDuration: 8 MonthsHybrid work – 2 to 3 days a week onsite mandatory(Eligibility : Should be eligible for SC Clearance)Senior Data Engineer (with Power BI expertise)Lead design,...
-
Senior Data Engineer
6 days ago
Glasgow, Glasgow City, United Kingdom Vanloq - Workforce Solutions Full time £60,000 - £90,000 per yearSenior Data Engineer – ContractLocation:Glasgow (Hybrid – 3 days per week on-site)Duration:6 MonthsDay Rate:CompetitiveSector:Financial ServicesOverview:We're looking for a highly skilled Senior Data Engineer to join a leading financial services organisation on a 6-month contract. You'll be working on a hybrid basis from their Glasgow office (3 days per...
-
Senior Data Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom FDM Group Full time £90,000 - £120,000 per yearAbout The RoleFDM is a global business and technology consultancy seeking a Senior Data Engineer to work for our client within the financial services sector. This is initially a 12-month contract with the potential to extend and will be a hybrid role based in Edinburgh.Our client is looking for looking for a passionate and experienced Data Engineer in the...
-
Senior Data Engineer
4 days ago
Glasgow, Glasgow City, United Kingdom Scott Logic Full time £60,000 - £120,000 per yearWe work with some of the UK's biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice.Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for...
-
Senior Data Engineer
2 weeks ago
Glasgow, Glasgow City, United Kingdom Scott Logic Full time £60,000 - £100,000 per yearWe work with some of the UK's biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for...
-
Senior Data Engineer
4 days ago
Glasgow, Glasgow City, United Kingdom RES Full time £60,000 - £120,000 per yearDo you want to work to make Power for Good?We're the world's largest independent renewable energy company. We're driven by a simple yet powerful vision: to create a future where everyone has access to affordable, zero carbon energy.We know that achieving our ambitions would be impossible without our people. Because we're tackling some of the world's toughest...
-
Senior Data Engineer
4 hours ago
Glasgow, Glasgow City, United Kingdom Head Resourcing Full time £60,000 - £100,000 per yearSenior Data Engineer - Azure & Databricks LakehouseGlasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer BusinessNo sponsorship/ relocation provided sadlyOur incredibly successful client, consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into...
-
Senior Scientific Data Engineer
1 week ago
Glasgow, Glasgow City, United Kingdom Chemify Ltd Full time £90,000 - £120,000 per yearAbout ChemifyChemify is revolutionising chemistry. We are creating a future where the synthesis of previously unimaginable molecules, drugs, and materials is instantly accessible. By combining AI, robotics, and the worlds largest continually expanding database of chemical programs, we are accelerating chemical discovery to improve quality of life and extend...
-
Senior Cloud Data Platform Engineer
1 week ago
Glasgow, Glasgow City, United Kingdom hackajob Full time £60,000 - £120,000 per yearhackajob*is collaborating withBarclaysto connect them with exceptional tech professionals for this role.*Purpose of the role**To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.AccountabilitiesBuild and maintenance...
-
Data Engineer
4 days ago
Glasgow, Glasgow City, United Kingdom Bounteous Full time £60,000 - £120,000 per yearSenior Data Architect/EngineerLocation: Glasgow, UK or Anywhere in UKExperience: Minimum of 5 - 7 years of experienceSnowflake and/or databricks is must - hands on experienceThis role will be key to helping our divisional leadership to making informed, data-driven decisions by developing a sophisticated, scalable and explainable decision model to aid...