Senior Databricks Engineer CGEMJP00319492
2 days ago
Role Title Senior Databricks Engineer Duration contract to run until 31/12/2026 Location Glasgow, hybrid 2/3 days per week onsite Rate up to £414 p/d Umbrella inside IR35 Role purpose / summary We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands‑on engineering role focused on designing, building, and optimizing scalable data solutions using the Databricks platform. Key Skills/ requirements Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance and cost‑efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must‑Have Skills Strong hands‑on experience with Databricks and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. Preferred Qualifications Experience with Databricks Delta Lake, Unity Catalog, and MLflow. Knowledge of CloudFormation or other infrastructure‑as‑code tools. AWS or Databricks certifications. Experience in large‑scale data migration projects. Background in Finance Industry. All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply #J-18808-Ljbffr
-
Senior Databricks Engineer CGEMJP00319492
3 days ago
Glasgow, United Kingdom Experis Full timeLocation: Glasgow Job Type: Contract Industry: Cloud & Infrastructure Job reference: BBBH427796_1763129781 Posted: 5 days ago Role Title: Senior Databricks EngineerDuration: contract to run until 31/12/2026Location: Glasgow, hybrid 2/3 days per week onsiteRate: up to £414 p/d Umbrella inside IR35Role purpose / summaryWe are currently migrating our data...
-
Senior Databricks Engineer
5 days ago
Glasgow, Glasgow City, United Kingdom Capgemini Full time £35,000 - £40,000 per yearGET THE FUTURE YOU WANT Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the...
-
Databricks Engineer
3 weeks ago
glasgow, United Kingdom Capgemini Full timeGET THE FUTURE YOU WANT! Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations...
-
Senior Databricks Engineer
7 days ago
Glasgow, Glasgow City, United Kingdom Capgemini Engineering Full time €60,000 - €120,000 per yearGET THE FUTURE YOU WANTChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the...
-
Databricks Engineer
2 weeks ago
Glasgow, United Kingdom ShareForce Full timeJoin to apply for the Databricks Engineer - SC Cleared role at ShareForce. This is an exciting contract opportunity for an SC Cleared Databricks Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks...
-
Databricks Engineer
7 days ago
Glasgow, Glasgow City, United Kingdom Derisk360 Full time £60,000 - £100,000 per yearHiring Now: Databricks Engineer | AWS | Financial Services | Glasgow (Hybrid)Location:Glasgow, UK (Hybrid — 2 days onsite per week)Availability:Immediate Joiner PreferredDomain:Financial ServicesCertification Advantage:Databricks Certified EngineersAbout the RoleWe're looking for askilled Databricks Engineerto join a leadingfinancial institutionand work on...
-
Senior Databricks Engineer
3 days ago
Glasgow, United Kingdom Experis Full timeA leading recruitment firm is seeking a Senior Databricks Engineer in Glasgow to lead data pipeline migrations from AWS to Databricks. Responsibilities include designing and optimizing data engineering solutions while ensuring data quality and collaborating with cross-functional teams. Strong hands-on experience with Databricks, Apache Spark, and AWS...
-
Databricks SME
4 weeks ago
Glasgow, United Kingdom X4 Technology Full timeJob Title: Solutions Architect (Databricks Expert)Rate: CompetitiveLocation: EuropeContract Length: 6-12 monthsA consultancy client of ours have secured a project requiring a Databricks expert. This is an exciting opportunity to work on cutting-edge AI projects and build cloud-based systems that deliver real impact. Databricks Solution Architect Key...
-
Senior Data Engineer — Databricks
7 days ago
Glasgow, United Kingdom Renewable Energy Systems Ltd Full timeA leading renewable energy company in Scotland seeks a Senior Data Engineer to develop scalable data solutions within their Digital Solutions business. The role emphasizes mentoring junior engineers and optimizing data strategies, particularly utilizing Databricks. Ideal candidates will have over 5 years of experience in data engineering and proficiency in...
-
Senior Data Engineer: Databricks
6 days ago
Glasgow, United Kingdom RES Full timeA leading renewable energy company in Glasgow is seeking a Senior Data Engineer to architect scalable data solutions. The ideal candidate will have strong expertise in Databricks and experience in data engineering. Responsibilities include designing data pipelines, mentoring junior engineers, and collaborating with teams to set data governance standards....